00010000:00010000:3.0F:1746112069.122056:0:8435:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0F:1746112069.230122:0:3305:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095613b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b9e4a025-dac9-4232-9189-a0d3f6ef1c31:3305:1830931125067776:0@lo:400:kworker.0 00000100:00100000:1.0F:1746112069.230122:0:3304:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1746112069.230141:0:3304:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095610a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1830931125068160:0@lo:400:kworker.0 00000100:00100000:0.0F:1746112069.230155:0:3306:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095613480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3306:1830931125067904:0@lo:400:kworker.0 00000100:00100000:2.0:1746112069.230182:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746112069.230182:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746112069.230219:0:3306:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746112069.230220:0:7081:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830931125067776 00000100:00100000:3.0:1746112069.230227:0:7081:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830931125067776 00000100:00100000:2.0:1746112069.230237:0:3305:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095611880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3305:1830931125068288:0@lo:400:kworker.0 00000100:00100000:1.0:1746112069.230238:0:3304:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095613800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3304:1830931125068032:0@lo:400:kworker.0 00000100:00100000:0.0:1746112069.230247:0:3306:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095612300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3306:1830931125068416:0@lo:400:kworker.0 00000100:00100000:3.0:1746112069.230256:0:7081:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 216 00000100:00100000:2.0:1746112069.230258:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746112069.230262:0:7081:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a6d2c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b9e4a025-dac9-4232-9189-a0d3f6ef1c31+18:3305:x1830931125067776:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1746112069.230268:0:3306:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746112069.230274:0:7088:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830931125067904 00000100:00100000:1.0:1746112069.230278:0:7088:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830931125067904 00000100:00100000:2.0:1746112069.230298:0:10391:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830931125068160 00000100:00100000:1.0:1746112069.230299:0:7088:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830931125068288 00000100:00100000:3.0:1746112069.230300:0:7081:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a6d2c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b9e4a025-dac9-4232-9189-a0d3f6ef1c31+18:3305:x1830931125067776:12345-0@lo:400:kworker.0 Request processed in 38us (119us total) trans 0 rc 0/0 00000100:00100000:1.0:1746112069.230301:0:7088:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830931125068288 00000100:00100000:2.0:1746112069.230302:0:10391:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830931125068160 00000100:00100000:3.0:1746112069.230304:0:7081:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 216 00000100:00100000:0.0:1746112069.230308:0:8420:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830931125068416 00000100:00100000:0.0:1746112069.230314:0:8420:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830931125068416 00000100:00100000:2.0:1746112069.230338:0:10391:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1746112069.230341:0:7088:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1746112069.230343:0:10391:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a2992d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+10:3304:x1830931125068160:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1746112069.230348:0:7088:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095610380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1830931125067904:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1746112069.230351:0:3305:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095613b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b9e4a025-dac9-4232-9189-a0d3f6ef1c31:3305:1830931125067776:0@lo:400:kworker.0 00000100:00100000:0.0:1746112069.230365:0:8420:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1746112069.230373:0:8420:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095612680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3306:x1830931125068416:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1746112069.230374:0:10391:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a2992d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+10:3304:x1830931125068160:12345-0@lo:400:kworker.0 Request processed in 31us (194us total) trans 0 rc 0/0 00000100:00100000:2.0:1746112069.230378:0:10391:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1746112069.230383:0:7087:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1746112069.230385:0:7088:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095610380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1830931125067904:12345-0@lo:400:kworker.0 Request processed in 37us (165us total) trans 0 rc 0/0 00000100:00100000:3.0:1746112069.230389:0:7087:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095732d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1830931125068288:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1746112069.230391:0:7088:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00080000:2.0:1746112069.230398:0:7084:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1746112069.230413:0:8420:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095612680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3306:x1830931125068416:12345-0@lo:400:kworker.0 Request processed in 41us (144us total) trans 0 rc 0/0 00000100:00100000:1.0:1746112069.230414:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746112069.230420:0:8420:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1746112069.230431:0:7087:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095732d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1830931125068288:12345-0@lo:400:kworker.0 Request processed in 43us (172us total) trans 0 rc 0/0 00000100:00100000:3.0:1746112069.230435:0:7087:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1746112069.230441:0:3304:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095610a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1830931125068160:0@lo:400:kworker.0 00000100:00100000:3.0:1746112069.230444:0:7087:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830931125068032 00000100:00100000:3.0:1746112069.230446:0:7087:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830931125068032 00000100:00100000:2.0:1746112069.230451:0:3305:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095611880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3305:1830931125068288:0@lo:400:kworker.0 00000100:00100000:0.0:1746112069.230457:0:3306:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095613480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3306:1830931125067904:0@lo:400:kworker.0 00000100:00080000:2.0:1746112069.230463:0:7084:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1746112069.230466:0:3306:0:(client.c:2927:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967332 gen 2 00000100:00100000:3.0:1746112069.230467:0:7087:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1746112069.230470:0:7087:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013054e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1830931125068032:12345-0@lo:400:kworker.0 00000004:00080000:0.0:1746112069.230472:0:3306:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880134a6df80, transno 4294967323 00000004:00080000:0.0:1746112069.230480:0:3306:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880130d7a680, transno 4294967324 00000004:00080000:0.0:1746112069.230483:0:3306:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012cfa9180, transno 4294967325 00000004:00080000:0.0:1746112069.230486:0:3306:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880094d82d80, transno 4294967327 00000004:00080000:0.0:1746112069.230489:0:3306:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880094d83100, transno 4294967328 00000100:00100000:3.0:1746112069.230491:0:7087:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013054e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1830931125068032:12345-0@lo:400:kworker.0 Request processed in 21us (79us total) trans 0 rc 0/0 00000004:00080000:0.0:1746112069.230491:0:3306:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a675d500, transno 4294967329 00000004:00080000:0.0:1746112069.230493:0:3306:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a675dc00, transno 4294967330 00000100:00100000:3.0:1746112069.230495:0:7087:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000004:00080000:0.0:1746112069.230496:0:3306:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009b33b100, transno 4294967331 00000004:00080000:0.0:1746112069.230498:0:3306:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009b33a680, transno 4294967332 00000100:00100000:0.0:1746112069.230502:0:3306:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095612300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3306:1830931125068416:0@lo:400:kworker.0 00000100:00100000:1.0:1746112069.230505:0:3304:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095613800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3304:1830931125068032:0@lo:400:kworker.0 00000004:00080000:3.0:1746112069.230672:0:10388:0:(osp_sync.c:1188:osp_sync_process_committed()) lustre-OST0001-osc-MDT0000: 0 changes, 0 in progress, 0 in flight, 9 done 00000100:00100000:0.0:1746112069.246087:0:3303:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a6db8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1830931125068544:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1746112069.246159:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746112069.246216:0:8422:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830931125068544 00000100:00100000:0.0:1746112069.246224:0:8422:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830931125068544 00000100:00100000:0.0:1746112069.246280:0:8422:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1746112069.246288:0:8422:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095612300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1830931125068544:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1746112069.246339:0:8422:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3858759680 avail 3856662528 00000100:00100000:0.0:1746112069.246378:0:8422:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095612300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1830931125068544:12345-0@lo:13:osp-pre-1-0.0 Request processed in 91us (220us total) trans 0 rc 0/0 00000100:00100000:0.0:1746112069.246385:0:8422:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1746112069.246418:0:3303:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a6db8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1830931125068544:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1746112070.124082:0:7077:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1746112070.826880:0:18015:0:(debug.c:792:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-flr test 0j: test lfs mirror read/write commands ========================================================== 11:07:50 (1746112070) 00000100:00100000:2.0:1746112070.839788:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746112070.839834:0:7087:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830931118974720 00000100:00100000:0.0:1746112070.839844:0:7087:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830931118974720 00000100:00080000:2.0:1746112070.839874:0:7084:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1746112070.839909:0:7087:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 960 00000100:00100000:0.0:1746112070.839920:0:7087:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095732a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f1df1976-268d-4a53-a91b-09bc5fc9fdfb+16:14397:x1830931118974720:12345-192.168.204.23@tcp:101:lfs.0 00010000:00010000:0.0:1746112070.839945:0:7087:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746112070.839966:0:7087:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012db09e00/0x519b45e1080344c2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xac2804473d2035ba expref: -99 pid: 7087 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746112070.840052:0:7087:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012db08400/0x519b45e1080344c9 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7087 initiator: MDT0 00010000:00010000:0.0:1746112070.840066:0:7087:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012db08400/0x519b45e1080344c9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7087 initiator: MDT0 00010000:00010000:0.0:1746112070.840077:0:7087:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012db08400/0x519b45e1080344c9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7087 initiator: MDT0 00010000:00010000:0.0:1746112070.840089:0:7087:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012db09600/0x519b45e1080344d0 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xbccb0c83 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7087 initiator: MDT0 00010000:00010000:0.0:1746112070.840095:0:7087:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012db09600/0x519b45e1080344d0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xbccb0c83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7087 initiator: MDT0 00010000:00010000:0.0:1746112070.840102:0:7087:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012db09600/0x519b45e1080344d0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xbccb0c83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7087 initiator: MDT0 00010000:00010000:0.0:1746112070.840184:0:7087:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012db08400/0x519b45e1080344c9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7087 initiator: MDT0 00010000:00010000:0.0:1746112070.840191:0:7087:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012db08400/0x519b45e1080344c9 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7087 initiator: MDT0 00010000:00010000:0.0:1746112070.840197:0:7087:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012db08400/0x519b45e1080344c9 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7087 initiator: MDT0 00010000:00010000:0.0:1746112070.840203:0:7087:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012db08400 already unused, calling callback (ffffffffa1360690) 00010000:00010000:0.0:1746112070.840207:0:7087:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012db08400/0x519b45e1080344c9 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7087 initiator: MDT0 00010000:00010000:0.0:1746112070.840214:0:7087:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012db08400/0x519b45e1080344c9 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7087 initiator: MDT0 00010000:00010000:0.0:1746112070.840226:0:7087:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff880095820b00) 00010000:00010000:0.0:1746112070.840229:0:7087:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746112070.840233:0:7087:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012db08400/0x519b45e1080344c9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7087 initiator: MDT0 00010000:00010000:0.0:1746112070.840239:0:7087:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012db08400/0x519b45e1080344c9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7087 initiator: MDT0 00010000:00010000:0.0:1746112070.840248:0:7087:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012db09600/0x519b45e1080344d0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xbccb0c83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7087 initiator: MDT0 00010000:00010000:0.0:1746112070.840254:0:7087:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012db09600/0x519b45e1080344d0 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xbccb0c83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7087 initiator: MDT0 00010000:00010000:0.0:1746112070.840259:0:7087:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012db09600/0x519b45e1080344d0 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xbccb0c83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7087 initiator: MDT0 00010000:00010000:0.0:1746112070.840263:0:7087:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012db09600 already unused, calling callback (ffffffffa1360690) 00010000:00010000:0.0:1746112070.840271:0:7087:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012db09600/0x519b45e1080344d0 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xbccb0c83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7087 initiator: MDT0 00010000:00010000:0.0:1746112070.840277:0:7087:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012db09600/0x519b45e1080344d0 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xbccb0c83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7087 initiator: MDT0 00010000:00010000:0.0:1746112070.840284:0:7087:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xbccb0c83 (ffff88009cddb900) 00010000:00010000:0.0:1746112070.840286:0:7087:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746112070.840289:0:7087:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012db09600/0x519b45e1080344d0 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xbccb0c83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7087 initiator: MDT0 00010000:00010000:0.0:1746112070.840311:0:7087:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012db09600/0x519b45e1080344d0 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xbccb0c83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7087 initiator: MDT0 00010000:00010000:0.0:1746112070.840357:0:7087:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012db09e00/0x519b45e1080344c2 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xac2804473d2035ba expref: 17 pid: 7087 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746112070.840365:0:7087:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012db09e00/0x519b45e1080344c2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xac2804473d2035ba expref: 17 pid: 7087 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746112070.840372:0:7087:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012db09e00, rc 0) 00000100:00100000:0.0:1746112070.840430:0:7087:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095732a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f1df1976-268d-4a53-a91b-09bc5fc9fdfb+16:14397:x1830931118974720:12345-192.168.204.23@tcp:101:lfs.0 Request processed in 513us (647us total) trans 0 rc 301/301 00000100:00100000:0.0:1746112070.840438:0:7087:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 960 00000100:00100000:0.0:1746112070.841959:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1746112070.841999:0:7087:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830931118974976 00000100:00100000:1.0:1746112070.842003:0:7087:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830931118974976 00000100:00100000:1.0:1746112070.842025:0:7087:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 961 00000100:00100000:1.0:1746112070.842032:0:7087:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095613480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f1df1976-268d-4a53-a91b-09bc5fc9fdfb+16:14397:x1830931118974976:12345-192.168.204.23@tcp:101:lfs.0 00010000:00010000:1.0:1746112070.842040:0:7087:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746112070.842042:0:7087:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1746112070.842055:0:7087:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012f4ddc00/0x519b45e10803424c lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.23@tcp remote: 0xac2804473d2034f6 expref: 16 pid: 7086 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746112070.842065:0:7087:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff880095820b00) 00010000:00010000:1.0:1746112070.842075:0:7087:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746112070.842081:0:7087:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012cf40800/0x519b45e1080344d7 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xac2804473d2035c1 expref: -99 pid: 7087 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746112070.842135:0:7087:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88012cf41400/0x519b45e1080344de lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7087 initiator: MDT0 00010000:00010000:1.0:1746112070.842140:0:7087:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012cf41400/0x519b45e1080344de lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7087 initiator: MDT0 00010000:00010000:1.0:1746112070.842145:0:7087:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012cf41400/0x519b45e1080344de lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7087 initiator: MDT0 00010000:00010000:1.0:1746112070.842150:0:7087:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88012cf41000/0x519b45e1080344e5 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xbccb0c83 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7087 initiator: MDT0 00010000:00010000:1.0:1746112070.842153:0:7087:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012cf41000/0x519b45e1080344e5 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xbccb0c83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7087 initiator: MDT0 00010000:00010000:1.0:1746112070.842157:0:7087:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012cf41000/0x519b45e1080344e5 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xbccb0c83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7087 initiator: MDT0 00010000:00010000:1.0:1746112070.842592:0:7087:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a592b400/0x519b45e1080344ec lrc: 3/1,0 mode: --/PR res: [0x200000401:0x22:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7087 initiator: MDT0 00010000:00010000:1.0:1746112070.842597:0:7087:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a592b400/0x519b45e1080344ec lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x22:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7087 initiator: MDT0 00010000:00010000:1.0:1746112070.842601:0:7087:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a592b400/0x519b45e1080344ec lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x22:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7087 initiator: MDT0 00000004:00200000:1.0:1746112070.842608:0:7087:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000401:0x22:0x0]: returning size 0 00010000:00010000:1.0:1746112070.842621:0:7087:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88012cf41400/0x519b45e1080344de lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7087 initiator: MDT0 00010000:00010000:1.0:1746112070.842625:0:7087:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012cf41400/0x519b45e1080344de lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7087 initiator: MDT0 00010000:00010000:1.0:1746112070.842633:0:7087:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012cf41400/0x519b45e1080344de lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7087 initiator: MDT0 00010000:00010000:1.0:1746112070.842636:0:7087:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012cf41400 already unused, calling callback (ffffffffa1360690) 00010000:00010000:1.0:1746112070.842638:0:7087:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012cf41400/0x519b45e1080344de lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7087 initiator: MDT0 00010000:00010000:1.0:1746112070.842641:0:7087:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012cf41400/0x519b45e1080344de lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7087 initiator: MDT0 00010000:00010000:1.0:1746112070.842645:0:7087:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009cb69b00) 00010000:00010000:1.0:1746112070.842647:0:7087:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746112070.842648:0:7087:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012cf41400/0x519b45e1080344de lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7087 initiator: MDT0 00010000:00010000:1.0:1746112070.842651:0:7087:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012cf41400/0x519b45e1080344de lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7087 initiator: MDT0 00000004:00010000:1.0:1746112070.842656:0:7087:0:(mdt_handler.c:4446:mdt_save_lock()) ### save lock request ffff880095613480 reply state ffff8801310b2000 transno 4294967659 ns: mdt-lustre-MDT0000_UUID lock: ffff88012cf41000/0x519b45e1080344e5 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xbccb0c83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7087 initiator: MDT0 00000100:00100000:1.0:1746112070.842661:0:7087:0:(service.c:173:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1746112070.842674:0:7087:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012cf40800/0x519b45e1080344d7 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xac2804473d2035c1 expref: 18 pid: 7087 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746112070.842684:0:7087:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a592b400/0x519b45e1080344ec lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x22:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.23@tcp remote: 0xac2804473d2035c1 expref: 17 pid: 7087 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746112070.842688:0:7087:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x22:0x0].0x0 (ffff88009cb69700) 00010000:00010000:1.0:1746112070.842690:0:7087:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1746112070.842692:0:7087:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a592b400, rc 0) 00000100:00100000:1.0:1746112070.842730:0:7087:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095613480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f1df1976-268d-4a53-a91b-09bc5fc9fdfb+18:14397:x1830931118974976:12345-192.168.204.23@tcp:101:lfs.0 Request processed in 698us (772us total) trans 4294967659 rc 0/0 00000100:00100000:1.0:1746112070.842736:0:7087:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 961 00010000:00010000:3.0:1746112070.843337:0:3289:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88012cf41000/0x519b45e1080344e5 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xbccb0c83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7087 initiator: MDT0 00010000:00010000:3.0:1746112070.843345:0:3289:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012cf41000/0x519b45e1080344e5 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xbccb0c83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7087 initiator: MDT0 00010000:00010000:3.0:1746112070.843354:0:3289:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012cf41000/0x519b45e1080344e5 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xbccb0c83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7087 initiator: MDT0 00010000:00010000:3.0:1746112070.843358:0:3289:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012cf41000 already unused, calling callback (ffffffffa1360690) 00010000:00010000:3.0:1746112070.843359:0:3289:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012cf41000/0x519b45e1080344e5 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xbccb0c83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7087 initiator: MDT0 00010000:00010000:3.0:1746112070.843362:0:3289:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012cf41000/0x519b45e1080344e5 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xbccb0c83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7087 initiator: MDT0 00010000:00010000:3.0:1746112070.843369:0:3289:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xbccb0c83 (ffff88009cb69300) 00010000:00010000:3.0:1746112070.843370:0:3289:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746112070.843372:0:3289:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012cf41000/0x519b45e1080344e5 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xbccb0c83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7087 initiator: MDT0 00010000:00010000:3.0:1746112070.843375:0:3289:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012cf41000/0x519b45e1080344e5 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xbccb0c83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7087 initiator: MDT0 00000100:00100000:0.0:1746112070.843904:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1746112070.843951:0:7087:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830931118975232 00000100:00100000:2.0:1746112070.843956:0:7087:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830931118975232 00000100:00100000:2.0:1746112070.844004:0:7087:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 962 00000100:00100000:2.0:1746112070.844012:0:7087:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095610000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f1df1976-268d-4a53-a91b-09bc5fc9fdfb+17:14397:x1830931118975232:12345-192.168.204.23@tcp:101:lfs.0 00010000:00010000:2.0:1746112070.844020:0:7087:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746112070.844027:0:7087:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880130842000/0x519b45e1080344fa lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xac2804473d2035c8 expref: -99 pid: 7087 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746112070.844059:0:7087:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff880130843400/0x519b45e108034501 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x22:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7087 initiator: MDT0 00010000:00010000:2.0:1746112070.844066:0:7087:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a592b400/0x519b45e1080344ec lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x22:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.23@tcp remote: 0xac2804473d2035c1 expref: 18 pid: 7087 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746112070.844078:0:7087:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880130843400/0x519b45e108034501 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x22:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7087 initiator: MDT0 00010000:00010000:2.0:1746112070.844103:0:7087:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800a592b400/0x519b45e1080344ec lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x22:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.23@tcp remote: 0xac2804473d2035c1 expref: 18 pid: 7087 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746112070.844111:0:7087:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a592b400/0x519b45e1080344ec lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x22:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.23@tcp remote: 0xac2804473d2035c1 expref: 18 pid: 7087 timeout: 218 lvb_type: 0 00000100:00100000:2.0:1746112070.844121:0:7087:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095731180 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:7087:1830931125068672:192.168.204.23@tcp:104: 00000100:00100000:2.0:1746112070.844179:0:7087:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800ac488e40 going to sleep for 11 seconds 00000100:00100000:3.0:1746112070.844897:0:7087:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095731180 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:7087:1830931125068672:192.168.204.23@tcp:104: 00010000:00010000:3.0:1746112070.844912:0:7087:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880130843400/0x519b45e108034501 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x22:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7087 initiator: MDT0 00000100:00100000:0.0:1746112070.845060:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1746112070.845078:0:8436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830931118975360 00000100:00100000:3.0:1746112070.845084:0:8436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830931118975360 00010000:00010000:3.0:1746112070.845102:0:8436:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a592b400/0x519b45e1080344ec lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x22:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.23@tcp remote: 0xac2804473d2035c1 expref: 19 pid: 7087 timeout: 218 lvb_type: 0 00000100:00100000:3.0:1746112070.845122:0:8436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 203 00000100:00100000:3.0:1746112070.845128:0:8436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095611c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f1df1976-268d-4a53-a91b-09bc5fc9fdfb+19:1965:x1830931118975360:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746112070.845138:0:8436:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746112070.845148:0:8436:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800a592b400/0x519b45e1080344ec lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x22:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.23@tcp remote: 0xac2804473d2035c1 expref: 19 pid: 7087 timeout: 218 lvb_type: 0 00010000:00010000:3.0:1746112070.845158:0:8436:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800a592b400/0x519b45e1080344ec lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x22:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.23@tcp remote: 0xac2804473d2035c1 expref: 19 pid: 7087 timeout: 218 lvb_type: 0 00010000:00010000:3.0:1746112070.845169:0:8436:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a592b400/0x519b45e1080344ec lrc: 0/0,0 mode: --/PR res: [0x200000401:0x22:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.23@tcp remote: 0xac2804473d2035c1 expref: 19 pid: 7087 timeout: 218 lvb_type: 0 00010000:00010000:3.0:1746112070.845178:0:8436:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x22:0x0].0x0 (ffff88009cb69700) 00010000:00010000:3.0:1746112070.845182:0:8436:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff880130843400/0x519b45e108034501 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x22:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7087 initiator: MDT0 00010000:00010000:3.0:1746112070.845190:0:8436:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880130843400/0x519b45e108034501 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x22:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 7087 initiator: MDT0 00010000:00010000:3.0:1746112070.845195:0:8436:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880130843400/0x519b45e108034501 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x22:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 7087 initiator: MDT0 00010000:00010000:3.0:1746112070.845216:0:8436:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746112070.845220:0:7087:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880130843400/0x519b45e108034501 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x22:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7087 initiator: MDT0 00010000:00010000:2.0:1746112070.845226:0:7087:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880130843400/0x519b45e108034501 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x22:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7087 initiator: MDT0 00000004:00200000:2.0:1746112070.845234:0:7087:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000401:0x22:0x0]: returning size 0 00000100:00100000:3.0:1746112070.845238:0:8436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095611c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f1df1976-268d-4a53-a91b-09bc5fc9fdfb+18:1965:x1830931118975360:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 110us (180us total) trans 0 rc 0/0 00000100:00100000:3.0:1746112070.845244:0:8436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 203 00000004:00080000:2.0:1746112070.845458:0:7087:0:(osp_object.c:1637:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x1e:0x0], index 1: 0 00000004:00080000:2.0:1746112070.845466:0:7087:0:(osp_object.c:1637:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x1f:0x0], index 0: 0 00010000:00010000:2.0:1746112070.845563:0:7087:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff880130843400/0x519b45e108034501 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x22:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7087 initiator: MDT0 00010000:00010000:2.0:1746112070.845568:0:7087:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880130843400/0x519b45e108034501 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x22:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7087 initiator: MDT0 00010000:00010000:2.0:1746112070.845572:0:7087:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880130843400/0x519b45e108034501 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x22:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7087 initiator: MDT0 00010000:00010000:2.0:1746112070.845575:0:7087:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880130843400 already unused, calling callback (ffffffffa1360690) 00010000:00010000:2.0:1746112070.845579:0:7087:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880130843400/0x519b45e108034501 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x22:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7087 initiator: MDT0 00010000:00010000:2.0:1746112070.845583:0:7087:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880130843400/0x519b45e108034501 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x22:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7087 initiator: MDT0 00010000:00010000:2.0:1746112070.845589:0:7087:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x22:0x0].0x0 (ffff88009cb69700) 00010000:00010000:2.0:1746112070.845591:0:7087:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1746112070.845593:0:7087:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880130843400/0x519b45e108034501 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x22:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7087 initiator: MDT0 00010000:00010000:2.0:1746112070.845596:0:7087:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880130843400/0x519b45e108034501 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x22:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7087 initiator: MDT0 00010000:00010000:2.0:1746112070.845618:0:7087:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880130842000/0x519b45e1080344fa lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xac2804473d2035c8 expref: 18 pid: 7087 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746112070.845623:0:7087:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880130842000/0x519b45e1080344fa lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xac2804473d2035c8 expref: 18 pid: 7087 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746112070.845628:0:7087:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880130842000, rc 0) 00000100:00100000:2.0:1746112070.845657:0:7087:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095610000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f1df1976-268d-4a53-a91b-09bc5fc9fdfb+17:14397:x1830931118975232:12345-192.168.204.23@tcp:101:lfs.0 Request processed in 1647us (1755us total) trans 4294967660 rc 301/301 00000100:00100000:2.0:1746112070.845661:0:7087:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 962 00000100:00100000:0.0:1746112070.846878:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1746112070.846918:0:7090:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830931118975616 00000100:00100000:2.0:1746112070.846922:0:7090:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830931118975616 00000100:00100000:2.0:1746112070.846946:0:7090:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 229 00000100:00100000:2.0:1746112070.846951:0:7090:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095612d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f1df1976-268d-4a53-a91b-09bc5fc9fdfb+17:14397:x1830931118975616:12345-192.168.204.23@tcp:35:lfs.0 00000100:00100000:2.0:1746112070.847096:0:7090:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095612d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f1df1976-268d-4a53-a91b-09bc5fc9fdfb+18:14397:x1830931118975616:12345-192.168.204.23@tcp:35:lfs.0 Request processed in 139us (214us total) trans 4294967661 rc 0/0 00000100:00100000:2.0:1746112070.847110:0:7090:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 229 00000100:00100000:3.0:1746112070.847771:0:3298:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1746112070.847789:0:7090:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830931118975872 00000100:00100000:2.0:1746112070.847793:0:7090:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830931118975872 00000100:00100000:2.0:1746112070.847815:0:7090:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 230 00000100:00100000:2.0:1746112070.847820:0:7090:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a6dbbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f1df1976-268d-4a53-a91b-09bc5fc9fdfb+18:14397:x1830931118975872:12345-192.168.204.23@tcp:35:lfs.0 00000100:00100000:2.0:1746112070.847888:0:7090:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a6dbbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f1df1976-268d-4a53-a91b-09bc5fc9fdfb+19:14397:x1830931118975872:12345-192.168.204.23@tcp:35:lfs.0 Request processed in 66us (117us total) trans 4294967662 rc 0/0 00000100:00100000:2.0:1746112070.847894:0:7090:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 230 00000100:00100000:3.0:1746112070.851353:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1746112070.851387:0:7087:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830931118976000 00000100:00100000:2.0:1746112070.851392:0:7087:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830931118976000 00000100:00100000:2.0:1746112070.851417:0:7087:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 963 00000100:00100000:2.0:1746112070.851422:0:7087:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a6db8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f1df1976-268d-4a53-a91b-09bc5fc9fdfb+19:14405:x1830931118976000:12345-192.168.204.23@tcp:101:cp.0 00010000:00010000:2.0:1746112070.851433:0:7087:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746112070.851446:0:7087:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880130842200/0x519b45e10803450f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xac2804473d2035cf expref: -99 pid: 7087 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746112070.851484:0:7087:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880130842c00/0x519b45e108034516 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7087 initiator: MDT0 00010000:00010000:2.0:1746112070.851492:0:7087:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880130842c00/0x519b45e108034516 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7087 initiator: MDT0 00010000:00010000:2.0:1746112070.851499:0:7087:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880130842c00/0x519b45e108034516 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7087 initiator: MDT0 00000004:00200000:2.0:1746112070.851534:0:7087:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 11776 00000004:00200000:2.0:1746112070.851536:0:7087:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 6 stripe count 1 MDT count 1 00000004:00010000:2.0:1746112070.851545:0:7087:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff880130842c00/0x519b45e108034516 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7087 initiator: MDT0 00010000:00010000:2.0:1746112070.851566:0:7087:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880130842200/0x519b45e10803450f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xac2804473d2035cf expref: 21 pid: 7087 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746112070.851578:0:7087:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880130842c00/0x519b45e108034516 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.23@tcp remote: 0xac2804473d2035cf expref: 20 pid: 7087 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746112070.851586:0:7087:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff880094f17f00) 00010000:00010000:2.0:1746112070.851589:0:7087:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1746112070.851591:0:7087:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880130842c00, rc 0) 00000100:00100000:2.0:1746112070.851628:0:7087:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a6db8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f1df1976-268d-4a53-a91b-09bc5fc9fdfb+20:14405:x1830931118976000:12345-192.168.204.23@tcp:101:cp.0 Request processed in 205us (276us total) trans 0 rc 0/0 00000100:00100000:2.0:1746112070.851634:0:7087:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 963 00000100:00100000:0.0:1746112070.852440:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1746112070.852482:0:7087:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830931118976128 00000100:00100000:2.0:1746112070.852486:0:7087:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830931118976128 00000100:00100000:2.0:1746112070.852504:0:7087:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 964 00000100:00100000:2.0:1746112070.852510:0:7087:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095611500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f1df1976-268d-4a53-a91b-09bc5fc9fdfb+20:14405:x1830931118976128:12345-192.168.204.23@tcp:101:cp.0 00010000:00010000:2.0:1746112070.852517:0:7087:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746112070.852524:0:7087:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880130843000/0x519b45e10803451d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xac2804473d2035d6 expref: -99 pid: 7087 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746112070.852551:0:7087:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a631e600/0x519b45e108034524 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7087 initiator: MDT0 00010000:00010000:2.0:1746112070.852558:0:7087:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a631e600/0x519b45e108034524 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7087 initiator: MDT0 00010000:00010000:2.0:1746112070.852565:0:7087:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a631e600/0x519b45e108034524 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7087 initiator: MDT0 00010000:00010000:2.0:1746112070.852585:0:7087:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880095ebc400/0x519b45e10803452b lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xbccb0c83 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7087 initiator: MDT0 00010000:00010000:2.0:1746112070.852591:0:7087:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880095ebc400/0x519b45e10803452b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xbccb0c83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7087 initiator: MDT0 00010000:00010000:2.0:1746112070.852597:0:7087:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880095ebc400/0x519b45e10803452b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xbccb0c83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7087 initiator: MDT0 00010000:00010000:2.0:1746112070.852668:0:7087:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880095ebde00/0x519b45e108034532 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x22:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7087 initiator: MDT0 00010000:00010000:2.0:1746112070.852675:0:7087:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880095ebde00/0x519b45e108034532 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x22:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7087 initiator: MDT0 00010000:00010000:2.0:1746112070.852681:0:7087:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880095ebde00/0x519b45e108034532 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x22:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7087 initiator: MDT0 00000004:00200000:2.0:1746112070.852697:0:7087:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000401:0x22:0x0]: returning size 0 00000004:00200000:2.0:1746112070.852700:0:7087:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1746112070.852706:0:7087:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff880095ebde00/0x519b45e108034532 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x22:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7087 initiator: MDT0 00010000:00010000:2.0:1746112070.852714:0:7087:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880095ebde00/0x519b45e108034532 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x22:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7087 initiator: MDT0 00010000:00010000:2.0:1746112070.852721:0:7087:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a631e600/0x519b45e108034524 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7087 initiator: MDT0 00010000:00010000:2.0:1746112070.852726:0:7087:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a631e600/0x519b45e108034524 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7087 initiator: MDT0 00010000:00010000:2.0:1746112070.852732:0:7087:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a631e600/0x519b45e108034524 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7087 initiator: MDT0 00010000:00010000:2.0:1746112070.852744:0:7087:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a631e600 already unused, calling callback (ffffffffa1360690) 00010000:00010000:2.0:1746112070.852748:0:7087:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a631e600/0x519b45e108034524 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7087 initiator: MDT0 00010000:00010000:2.0:1746112070.852753:0:7087:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a631e600/0x519b45e108034524 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7087 initiator: MDT0 00010000:00010000:2.0:1746112070.852762:0:7087:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff880094f17f00) 00010000:00010000:2.0:1746112070.852765:0:7087:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746112070.852768:0:7087:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a631e600/0x519b45e108034524 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7087 initiator: MDT0 00010000:00010000:2.0:1746112070.852772:0:7087:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a631e600/0x519b45e108034524 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7087 initiator: MDT0 00010000:00010000:2.0:1746112070.852779:0:7087:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880095ebc400/0x519b45e10803452b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xbccb0c83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7087 initiator: MDT0 00010000:00010000:2.0:1746112070.852784:0:7087:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880095ebc400/0x519b45e10803452b lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xbccb0c83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7087 initiator: MDT0 00010000:00010000:2.0:1746112070.852788:0:7087:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880095ebc400/0x519b45e10803452b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xbccb0c83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7087 initiator: MDT0 00010000:00010000:2.0:1746112070.852792:0:7087:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880095ebc400 already unused, calling callback (ffffffffa1360690) 00010000:00010000:2.0:1746112070.852795:0:7087:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880095ebc400/0x519b45e10803452b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xbccb0c83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7087 initiator: MDT0 00010000:00010000:2.0:1746112070.852799:0:7087:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880095ebc400/0x519b45e10803452b lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xbccb0c83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7087 initiator: MDT0 00010000:00010000:2.0:1746112070.852805:0:7087:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xbccb0c83 (ffff880094f17b00) 00010000:00010000:2.0:1746112070.852807:0:7087:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746112070.852812:0:7087:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880095ebc400/0x519b45e10803452b lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xbccb0c83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7087 initiator: MDT0 00010000:00010000:2.0:1746112070.852817:0:7087:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880095ebc400/0x519b45e10803452b lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xbccb0c83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7087 initiator: MDT0 00010000:00010000:2.0:1746112070.852837:0:7087:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880130843000/0x519b45e10803451d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xac2804473d2035d6 expref: 22 pid: 7087 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746112070.852846:0:7087:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880095ebde00/0x519b45e108034532 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x22:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.23@tcp remote: 0xac2804473d2035d6 expref: 21 pid: 7087 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746112070.852852:0:7087:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x22:0x0].0x0 (ffff880094f17100) 00010000:00010000:2.0:1746112070.852853:0:7087:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1746112070.852855:0:7087:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095ebde00, rc 0) 00000100:00100000:2.0:1746112070.852888:0:7087:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095611500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f1df1976-268d-4a53-a91b-09bc5fc9fdfb+21:14405:x1830931118976128:12345-192.168.204.23@tcp:101:cp.0 Request processed in 377us (449us total) trans 0 rc 0/0 00000100:00100000:2.0:1746112070.852894:0:7087:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 964 00000100:00100000:3.0:1746112070.853893:0:3298:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1746112070.853913:0:8419:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830931118976256 00000100:00100000:1.0:1746112070.853917:0:8419:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830931118976256 00000100:00080000:3.0:1746112070.853935:0:7084:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1746112070.853946:0:8419:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 230 00000100:00100000:1.0:1746112070.853952:0:8419:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a6dba680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f1df1976-268d-4a53-a91b-09bc5fc9fdfb+20:1966:x1830931118976256:12345-192.168.204.23@tcp:101:cp.0 00010000:00010000:1.0:1746112070.853960:0:8419:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746112070.853971:0:8419:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012cf40200/0x519b45e108034539 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xac2804473d2035dd expref: -99 pid: 8419 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1746112070.854009:0:8419:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x1f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1746112070.854023:0:8419:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746112070.854025:0:8419:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746112070.854032:0:8419:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012cf40200/0x519b45e108034539 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xac2804473d2035dd expref: 21 pid: 8419 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746112070.854045:0:8419:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012cf40200/0x519b45e108034539 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xac2804473d2035dd expref: 21 pid: 8419 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746112070.854054:0:8419:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012cf40200, rc 0) 00000100:00100000:1.0:1746112070.854083:0:8419:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a6dba680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f1df1976-268d-4a53-a91b-09bc5fc9fdfb+21:1966:x1830931118976256:12345-192.168.204.23@tcp:101:cp.0 Request processed in 131us (192us total) trans 0 rc 0/0 00000100:00100000:1.0:1746112070.854087:0:8419:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 230 00000100:00100000:3.0:1746112070.855193:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746112070.855231:0:7087:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830931118976512 00000100:00100000:0.0:1746112070.855239:0:7087:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830931118976512 00000100:00100000:0.0:1746112070.855272:0:7087:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 965 00000100:00100000:0.0:1746112070.855278:0:7087:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a6db8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f1df1976-268d-4a53-a91b-09bc5fc9fdfb+21:14405:x1830931118976512:12345-192.168.204.23@tcp:101:cp.0 00010000:00010000:0.0:1746112070.855287:0:7087:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746112070.855308:0:7087:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012db08400/0x519b45e108034540 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xac2804473d2035e4 expref: -99 pid: 7087 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746112070.855359:0:7087:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88012db08a00/0x519b45e108034547 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x22:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7087 initiator: MDT0 00010000:00010000:0.0:1746112070.855369:0:7087:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880095ebde00/0x519b45e108034532 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x22:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.23@tcp remote: 0xac2804473d2035d6 expref: 22 pid: 7087 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746112070.855377:0:7087:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012db08a00/0x519b45e108034547 lrc: 4/0,1 mode: --/CW res: [0x200000401:0x22:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7087 initiator: MDT0 00010000:00010000:0.0:1746112070.855403:0:7087:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880095ebde00/0x519b45e108034532 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x22:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.23@tcp remote: 0xac2804473d2035d6 expref: 22 pid: 7087 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746112070.855416:0:7087:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880095ebde00/0x519b45e108034532 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x22:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.23@tcp remote: 0xac2804473d2035d6 expref: 22 pid: 7087 timeout: 218 lvb_type: 0 00000100:00100000:0.0:1746112070.855428:0:7087:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095610e00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:7087:1830931125068800:192.168.204.23@tcp:104: 00000100:00100000:0.0:1746112070.855492:0:7087:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009cf4b900 going to sleep for 11 seconds 00000100:00100000:1.0:1746112070.856133:0:7087:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095610e00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:7087:1830931125068800:192.168.204.23@tcp:104: 00010000:00010000:1.0:1746112070.856150:0:7087:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88012db08a00/0x519b45e108034547 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x22:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7087 initiator: MDT0 00000100:00100000:3.0:1746112070.856312:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746112070.856336:0:8436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830931118976640 00000100:00100000:0.0:1746112070.856340:0:8436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830931118976640 00010000:00010000:0.0:1746112070.856355:0:8436:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880095ebde00/0x519b45e108034532 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x22:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.23@tcp remote: 0xac2804473d2035d6 expref: 23 pid: 7087 timeout: 218 lvb_type: 0 00000100:00100000:0.0:1746112070.856376:0:8436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 204 00000100:00100000:0.0:1746112070.856386:0:8436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a6db8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f1df1976-268d-4a53-a91b-09bc5fc9fdfb+23:1965:x1830931118976640:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746112070.856393:0:8436:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746112070.856396:0:8436:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880095ebde00/0x519b45e108034532 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x22:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.23@tcp remote: 0xac2804473d2035d6 expref: 23 pid: 7087 timeout: 218 lvb_type: 0 00010000:00010000:0.0:1746112070.856403:0:8436:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880095ebde00/0x519b45e108034532 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x22:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.23@tcp remote: 0xac2804473d2035d6 expref: 23 pid: 7087 timeout: 218 lvb_type: 0 00010000:00010000:0.0:1746112070.856412:0:8436:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880095ebde00/0x519b45e108034532 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x22:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.23@tcp remote: 0xac2804473d2035d6 expref: 23 pid: 7087 timeout: 218 lvb_type: 0 00010000:00010000:0.0:1746112070.856419:0:8436:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x22:0x0].0x0 (ffff880094f17100) 00010000:00010000:0.0:1746112070.856422:0:8436:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88012db08a00/0x519b45e108034547 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x22:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7087 initiator: MDT0 00010000:00010000:0.0:1746112070.856426:0:8436:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012db08a00/0x519b45e108034547 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x22:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 7087 initiator: MDT0 00010000:00010000:0.0:1746112070.856430:0:8436:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012db08a00/0x519b45e108034547 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x22:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 7087 initiator: MDT0 00010000:00010000:0.0:1746112070.856439:0:8436:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746112070.856445:0:7087:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88012db08a00/0x519b45e108034547 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x22:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7087 initiator: MDT0 00010000:00010000:2.0:1746112070.856452:0:7087:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012db08a00/0x519b45e108034547 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x22:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7087 initiator: MDT0 00000004:00200000:2.0:1746112070.856460:0:7087:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000401:0x22:0x0]: returning size 0 00000100:00100000:0.0:1746112070.856464:0:8436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a6db8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f1df1976-268d-4a53-a91b-09bc5fc9fdfb+22:1965:x1830931118976640:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 78us (170us total) trans 0 rc 0/0 00000100:00100000:0.0:1746112070.856468:0:8436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 204 00010000:00010000:2.0:1746112070.856531:0:7087:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012db08400/0x519b45e108034540 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xac2804473d2035e4 expref: 23 pid: 7087 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746112070.856538:0:7087:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012db08a00/0x519b45e108034547 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x22:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.23@tcp remote: 0xac2804473d2035e4 expref: 22 pid: 7087 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746112070.856543:0:7087:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x22:0x0].0x0 (ffff880094f17100) 00010000:00010000:2.0:1746112070.856548:0:7087:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1746112070.856549:0:7087:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012db08a00, rc 0) 00000100:00100000:2.0:1746112070.856567:0:7087:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a6db8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f1df1976-268d-4a53-a91b-09bc5fc9fdfb+22:14405:x1830931118976512:12345-192.168.204.23@tcp:101:cp.0 Request processed in 1291us (1377us total) trans 4294967663 rc 0/0 00000100:00100000:2.0:1746112070.856572:0:7087:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 965 00000100:00100000:3.0:1746112070.857271:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1746112070.857321:0:7087:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830931118976896 00000100:00100000:2.0:1746112070.857325:0:7087:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830931118976896 00000100:00100000:2.0:1746112070.857344:0:7087:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 966 00000100:00100000:2.0:1746112070.857349:0:7087:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a6db9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f1df1976-268d-4a53-a91b-09bc5fc9fdfb+22:14405:x1830931118976896:12345-192.168.204.23@tcp:36:cp.0 00010000:00010000:2.0:1746112070.857499:0:7087:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880095ebcc00/0x519b45e108034555 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x22:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7087 initiator: MDT0 00010000:00010000:2.0:1746112070.857508:0:7087:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880095ebcc00/0x519b45e108034555 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x22:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7087 initiator: MDT0 00010000:00010000:2.0:1746112070.857515:0:7087:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880095ebcc00/0x519b45e108034555 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x22:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7087 initiator: MDT0 00000001:00080000:2.0:1746112070.857557:0:7087:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 4294967664 00000004:00010000:2.0:1746112070.857577:0:7087:0:(mdt_handler.c:4446:mdt_save_lock()) ### save lock request ffff8800a6db9500 reply state ffff8800955f8000 transno 4294967665 ns: mdt-lustre-MDT0000_UUID lock: ffff880095ebcc00/0x519b45e108034555 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x22:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7087 initiator: MDT0 00000100:00100000:2.0:1746112070.857585:0:7087:0:(service.c:173:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1746112070.857629:0:7087:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a6db9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f1df1976-268d-4a53-a91b-09bc5fc9fdfb+25:14405:x1830931118976896:12345-192.168.204.23@tcp:36:cp.0 Request processed in 278us (358us total) trans 4294967665 rc 0/0 00000100:00100000:2.0:1746112070.857635:0:7087:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 966 00000020:00080000:2.0:1746112070.857639:0:7087:0:(tgt_main.c:782:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1746112070.858194:0:3290:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff880095ebcc00/0x519b45e108034555 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x22:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7087 initiator: MDT0 00010000:00010000:2.0:1746112070.858202:0:3290:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880095ebcc00/0x519b45e108034555 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x22:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7087 initiator: MDT0 00010000:00010000:2.0:1746112070.858214:0:3290:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880095ebcc00/0x519b45e108034555 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x22:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7087 initiator: MDT0 00010000:00010000:2.0:1746112070.858219:0:3290:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880095ebcc00 already unused, calling callback (ffffffffa1360690) 00010000:00010000:2.0:1746112070.858222:0:3290:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880095ebcc00/0x519b45e108034555 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x22:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7087 initiator: MDT0 00010000:00010000:2.0:1746112070.858229:0:3290:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880095ebcc00/0x519b45e108034555 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x22:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7087 initiator: MDT0 00010000:00010000:2.0:1746112070.858238:0:3290:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x22:0x0].0x0 (ffff880094f17100) 00010000:00010000:2.0:1746112070.858240:0:3290:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746112070.858243:0:3290:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880095ebcc00/0x519b45e108034555 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x22:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7087 initiator: MDT0 00010000:00010000:2.0:1746112070.858249:0:3290:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880095ebcc00/0x519b45e108034555 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x22:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7087 initiator: MDT0 00000100:00100000:3.0:1746112070.858340:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1746112070.858395:0:7087:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830931118977024 00000100:00100000:2.0:1746112070.858399:0:7087:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830931118977024 00000100:00100000:2.0:1746112070.858418:0:7087:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 967 00000100:00100000:2.0:1746112070.858423:0:7087:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a675d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f1df1976-268d-4a53-a91b-09bc5fc9fdfb+24:14405:x1830931118977024:12345-192.168.204.23@tcp:101:cp.0 00010000:00010000:2.0:1746112070.858432:0:7087:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746112070.858439:0:7087:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880095ebc600/0x519b45e10803455c lrc: 2/0,0 mode: --/CR res: [0x200000401:0x22:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xac2804473d2035eb expref: -99 pid: 7087 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746112070.858462:0:7087:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880095ebc600/0x519b45e10803455c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x22:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.23@tcp remote: 0xac2804473d2035eb expref: 25 pid: 7087 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746112070.858471:0:7087:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880095ebc600/0x519b45e10803455c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x22:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xac2804473d2035eb expref: 25 pid: 7087 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746112070.858490:0:7087:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x22:0x0].0x0 (ffff880094f17100) 00010000:00010000:2.0:1746112070.858493:0:7087:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1746112070.858495:0:7087:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095ebc600, rc 0) 00000100:00100000:2.0:1746112070.858517:0:7087:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a675d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f1df1976-268d-4a53-a91b-09bc5fc9fdfb+25:14405:x1830931118977024:12345-192.168.204.23@tcp:101:cp.0 Request processed in 94us (178us total) trans 0 rc 0/0 00000100:00100000:2.0:1746112070.858523:0:7087:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 967 00000100:00100000:2.0:1746112070.859419:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1746112070.859467:0:9033:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830931118977280 00000100:00100000:3.0:1746112070.859471:0:9033:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830931118977280 00000100:00100000:3.0:1746112070.859492:0:9033:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 968 00000100:00100000:3.0:1746112070.859496:0:9033:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095730380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f1df1976-268d-4a53-a91b-09bc5fc9fdfb+25:14405:x1830931118977280:12345-192.168.204.23@tcp:101:cp.0 00010000:00010000:3.0:1746112070.859503:0:9033:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746112070.859505:0:9033:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1746112070.859515:0:9033:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880095ebc600/0x519b45e10803455c lrc: 0/0,0 mode: --/CR res: [0x200000401:0x22:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.23@tcp remote: 0xac2804473d2035eb expref: 25 pid: 7087 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746112070.859523:0:9033:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x22:0x0].0x0 (ffff880094f17100) 00010000:00010000:3.0:1746112070.859526:0:9033:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746112070.859530:0:9033:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012cc01200/0x519b45e108034563 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x22:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xac2804473d2035f2 expref: -99 pid: 9033 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746112070.859552:0:9033:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88012cc00c00/0x519b45e10803456a lrc: 3/0,1 mode: --/EX res: [0x200000401:0x22:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9033 initiator: MDT0 00010000:00010000:3.0:1746112070.859558:0:9033:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012cc00c00/0x519b45e10803456a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x22:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9033 initiator: MDT0 00010000:00010000:3.0:1746112070.859563:0:9033:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012cc00c00/0x519b45e10803456a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x22:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9033 initiator: MDT0 00000040:00080000:3.0:1746112070.859825:0:9033:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x6:0x0].11, 88 off9136 00000004:00080000:3.0:1746112070.859831:0:9033:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 118924849639ns, next at 0ns, rc = 0 00000040:00080000:3.0:1746112070.859867:0:9033:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x3:0x0].12, 88 off9176 00000004:00080000:3.0:1746112070.859871:0:9033:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 118924890406ns, next at 112471106980ns, rc = 0 00000001:00080000:1.0:1746112070.869063:0:7138:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967659 is committed 00000001:00080000:1.0:1746112070.869074:0:7138:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967665 is committed 00010000:00010000:3.0:1746112070.869081:0:9033:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012cc00c00/0x519b45e10803456a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x22:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000000 nid: 192.168.204.23@tcp remote: 0xac2804473d2035f2 expref: 25 pid: 9033 timeout: 0 lvb_type: 0 00000001:00080000:1.0:1746112070.869091:0:7138:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967666 is committed 00010000:00010000:3.0:1746112070.869095:0:9033:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x22:0x0].0x0 (ffff880094f17100) 00000004:00080000:1.0:1746112070.869095:0:7138:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 13 committed 00010000:00010000:3.0:1746112070.869103:0:9033:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00000004:00080000:1.0:1746112070.869104:0:7138:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 11 committed 00010000:00010000:3.0:1746112070.869120:0:9033:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012cc01200/0x519b45e108034563 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x22:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xac2804473d2035f2 expref: 18 pid: 9033 timeout: 0 lvb_type: 3 00010000:00010000:3.0:1746112070.869131:0:9033:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012cc00c00/0x519b45e10803456a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x22:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.23@tcp remote: 0xac2804473d2035f2 expref: 17 pid: 9033 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746112070.869159:0:9033:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x22:0x0].0x0 (ffff880094f17100) 00000100:00100000:2.0:1746112070.869159:0:3305:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88013054f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1830931125069056:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746112070.869160:0:3304:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095611180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1830931125068928:0@lo:2:osp-syn-0-0.0 00010000:00010000:3.0:1746112070.869162:0:9033:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:3.0:1746112070.869164:0:9033:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012cc00c00, rc 0) 00000100:00100000:1.0:1746112070.869225:0:3304:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746112070.869229:0:9033:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095730380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f1df1976-268d-4a53-a91b-09bc5fc9fdfb+17:14405:x1830931118977280:12345-192.168.204.23@tcp:101:cp.0 Request processed in 9730us (9808us total) trans 4294967666 rc 0/0 00000100:00100000:3.0:1746112070.869239:0:9033:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 968 00000100:00100000:2.0:1746112070.869240:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746112070.869248:0:8419:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830931125068928 00000100:00100000:0.0:1746112070.869255:0:8419:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830931125068928 00000100:00100000:0.0:1746112070.869291:0:8419:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830931125069056 00000100:00100000:0.0:1746112070.869309:0:8419:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830931125069056 00000100:00100000:2.0:1746112070.869310:0:10391:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 231 00000100:00100000:2.0:1746112070.869316:0:10391:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013054f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+10:3304:x1830931125068928:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746112070.869328:0:8419:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 232 00000100:00100000:0.0:1746112070.869334:0:8419:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095731f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3305:x1830931125069056:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:2.0:1746112070.869446:0:10391:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x1f:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1746112070.869448:0:10391:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x1f:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:2.0:1746112070.869450:0:10391:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x1f:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1746112070.869451:0:10391:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x1f:0x0] updating lvb ctime from disk: 0 -> 0 00002000:00010000:2.0:1746112070.869452:0:10391:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x1f:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:2.0:1746112070.869478:0:10391:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013054f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+11:3304:x1830931125068928:12345-0@lo:2:osp-syn-0-0.0 Request processed in 162us (253us total) trans 4294967354 rc 0/0 00000100:00100000:2.0:1746112070.869484:0:10391:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 231 00000100:00100000:0.0:1746112070.869514:0:8419:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095731f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3305:x1830931125069056:12345-0@lo:2:osp-syn-1-0.0 Request processed in 180us (272us total) trans 4294967333 rc 0/0 00000004:00080000:1.0:1746112070.869519:0:3304:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880095611180/2, rc 0, transno 4294967354 00000100:00100000:0.0:1746112070.869521:0:8419:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 232 00000100:00100000:1.0:1746112070.869524:0:3304:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095611180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1830931125068928:0@lo:2:osp-syn-0-0.0 00000100:00080000:0.0:1746112070.869539:0:7084:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1746112070.869542:0:7084:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000004:00080000:0.0:1746112070.869556:0:3305:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88013054f100/2, rc 0, transno 4294967333 00000100:00100000:0.0:1746112070.869561:0:3305:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88013054f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1830931125069056:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746112070.870898:0:3298:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746112070.870957:0:8420:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830931118977408 00000100:00100000:0.0:1746112070.870961:0:8420:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830931118977408 00000100:00080000:2.0:1746112070.871005:0:7084:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1746112070.871025:0:8420:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 233 00000100:00100000:0.0:1746112070.871032:0:8420:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a675dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f1df1976-268d-4a53-a91b-09bc5fc9fdfb+15:14405:x1830931118977408:12345-192.168.204.23@tcp:101:cp.0 00010000:00010000:0.0:1746112070.871042:0:8420:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746112070.871055:0:8420:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880134a4c200/0x519b45e108034571 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xac2804473d2035f9 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1746112070.871070:0:8420:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x1e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1746112070.871084:0:8420:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746112070.871086:0:8420:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746112070.871092:0:8420:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880134a4c200/0x519b45e108034571 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.204.23@tcp remote: 0xac2804473d2035f9 expref: 16 pid: 8420 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746112070.871105:0:8420:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880134a4c200/0x519b45e108034571 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.204.23@tcp remote: 0xac2804473d2035f9 expref: 16 pid: 8420 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746112070.871117:0:8420:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880134a4c200, rc 0) 00000100:00100000:0.0:1746112070.871151:0:8420:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a675dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f1df1976-268d-4a53-a91b-09bc5fc9fdfb+16:14405:x1830931118977408:12345-192.168.204.23@tcp:101:cp.0 Request processed in 119us (254us total) trans 0 rc 0/0 00000100:00100000:0.0:1746112070.871167:0:8420:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 233 00000100:00100000:3.0:1746112070.871930:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1746112070.872001:0:8426:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830931118977536 00000100:00100000:2.0:1746112070.872006:0:8426:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830931118977536 00002000:00010000:2.0:1746112070.872025:0:8426:0:(ofd_dev.c:2706:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/30 (0->18446744073709551615) 00002000:00100000:2.0:1746112070.872029:0:8426:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094d82d80 with x1830931118977536 ext(0->18446744073709551615) 00002000:00010000:2.0:1746112070.872036:0:8426:0:(ofd_dev.c:2711:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094d82d80. 00000100:00100000:2.0:1746112070.872058:0:8426:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 24 00000100:00100000:2.0:1746112070.872065:0:8426:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094d82d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:f1df1976-268d-4a53-a91b-09bc5fc9fdfb+16:1965:x1830931118977536:12345-192.168.204.23@tcp:10:cp.0 00002000:00010000:2.0:1746112070.872335:0:8426:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x1e:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1746112070.872337:0:8426:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x1e:0x0] updating lvb mtime from disk: 0 -> 1746112070 00002000:00010000:2.0:1746112070.872338:0:8426:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x1e:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1746112070.872340:0:8426:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x1e:0x0] updating lvb ctime from disk: 0 -> 1746112070 00002000:00010000:2.0:1746112070.872341:0:8426:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x1e:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:2.0:1746112070.872366:0:8426:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094d82d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:f1df1976-268d-4a53-a91b-09bc5fc9fdfb+17:1965:x1830931118977536:12345-192.168.204.23@tcp:10:cp.0 Request processed in 302us (438us total) trans 4294967334 rc 0/0 00000100:00100000:2.0:1746112070.872371:0:8426:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 24 00002000:00010000:2.0:1746112070.872373:0:8426:0:(ofd_dev.c:2706:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/30 (0->18446744073709551615) 00002000:00100000:2.0:1746112070.872375:0:8426:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094d82d80 with x1830931118977536 ext(0->18446744073709551615) 00002000:00010000:2.0:1746112070.872378:0:8426:0:(ofd_dev.c:2711:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094d82d80. 00000100:00100000:2.0:1746112070.874384:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1746112070.874434:0:9033:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830931118977664 00000100:00100000:3.0:1746112070.874439:0:9033:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830931118977664 00000100:00100000:3.0:1746112070.874464:0:9033:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 969 00000100:00100000:3.0:1746112070.874471:0:9033:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095731500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f1df1976-268d-4a53-a91b-09bc5fc9fdfb+17:14405:x1830931118977664:12345-192.168.204.23@tcp:101:cp.0 00010000:00010000:3.0:1746112070.874485:0:9033:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746112070.874496:0:9033:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012d05cc00/0x519b45e108034578 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x22:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xac2804473d203600 expref: -99 pid: 9033 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746112070.874563:0:9033:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800b1a44e00/0x519b45e10803457f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x22:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9033 initiator: MDT0 00010000:00010000:3.0:1746112070.874573:0:9033:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012db08a00/0x519b45e108034547 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x22:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.23@tcp remote: 0xac2804473d2035e4 expref: 18 pid: 7087 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746112070.874586:0:9033:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800b1a44e00/0x519b45e10803457f lrc: 4/1,0 mode: --/PR res: [0x200000401:0x22:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9033 initiator: MDT0 00010000:00010000:3.0:1746112070.874608:0:9033:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88012db08a00/0x519b45e108034547 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x22:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.23@tcp remote: 0xac2804473d2035e4 expref: 18 pid: 7087 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746112070.874617:0:9033:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88012db08a00/0x519b45e108034547 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x22:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.23@tcp remote: 0xac2804473d2035e4 expref: 18 pid: 7087 timeout: 218 lvb_type: 0 00000100:00100000:3.0:1746112070.874625:0:9033:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094d83100 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9033:1830931125069184:192.168.204.23@tcp:104: 00000100:00100000:3.0:1746112070.874685:0:9033:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009414b480 going to sleep for 11 seconds 00000100:00100000:0.0:1746112070.875545:0:9033:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094d83100 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9033:1830931125069184:192.168.204.23@tcp:104: 00010000:00010000:0.0:1746112070.875563:0:9033:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8800b1a44e00/0x519b45e10803457f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x22:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9033 initiator: MDT0 00000100:00100000:2.0:1746112070.875571:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1746112070.875609:0:8436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830931118977792 00000100:00100000:1.0:1746112070.875613:0:8436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830931118977792 00010000:00010000:1.0:1746112070.875629:0:8436:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012db08a00/0x519b45e108034547 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x22:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.23@tcp remote: 0xac2804473d2035e4 expref: 19 pid: 7087 timeout: 218 lvb_type: 0 00000100:00100000:1.0:1746112070.875646:0:8436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 205 00000100:00100000:1.0:1746112070.875652:0:8436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095731c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f1df1976-268d-4a53-a91b-09bc5fc9fdfb+19:1966:x1830931118977792:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746112070.875660:0:8436:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746112070.875665:0:8436:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88012db08a00/0x519b45e108034547 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x22:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.23@tcp remote: 0xac2804473d2035e4 expref: 19 pid: 7087 timeout: 218 lvb_type: 0 00010000:00010000:1.0:1746112070.875675:0:8436:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88012db08a00/0x519b45e108034547 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x22:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.23@tcp remote: 0xac2804473d2035e4 expref: 19 pid: 7087 timeout: 218 lvb_type: 0 00010000:00010000:1.0:1746112070.875691:0:8436:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012db08a00/0x519b45e108034547 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x22:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.23@tcp remote: 0xac2804473d2035e4 expref: 19 pid: 7087 timeout: 218 lvb_type: 0 00010000:00010000:1.0:1746112070.875701:0:8436:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x22:0x0].0x0 (ffff880094f17100) 00010000:00010000:1.0:1746112070.875711:0:8436:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8800b1a44e00/0x519b45e10803457f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x22:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9033 initiator: MDT0 00010000:00010000:1.0:1746112070.875717:0:8436:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800b1a44e00/0x519b45e10803457f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x22:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 9033 initiator: MDT0 00010000:00010000:1.0:1746112070.875723:0:8436:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800b1a44e00/0x519b45e10803457f lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x22:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 9033 initiator: MDT0 00010000:00010000:1.0:1746112070.875744:0:8436:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1746112070.875765:0:9033:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8800b1a44e00/0x519b45e10803457f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x22:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9033 initiator: MDT0 00010000:00010000:0.0:1746112070.875774:0:9033:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800b1a44e00/0x519b45e10803457f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x22:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9033 initiator: MDT0 00000100:00100000:1.0:1746112070.875777:0:8436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095731c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f1df1976-268d-4a53-a91b-09bc5fc9fdfb+18:1966:x1830931118977792:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 124us (206us total) trans 0 rc 0/0 00000100:00100000:1.0:1746112070.875784:0:8436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 205 00000004:00200000:0.0:1746112070.875802:0:9033:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000401:0x22:0x0]: returning size 2 00000004:00200000:0.0:1746112070.875807:0:9033:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1746112070.875823:0:9033:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8800b1a44e00/0x519b45e10803457f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x22:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9033 initiator: MDT0 00010000:00010000:0.0:1746112070.875848:0:9033:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012d05cc00/0x519b45e108034578 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x22:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xac2804473d203600 expref: 18 pid: 9033 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746112070.875861:0:9033:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800b1a44e00/0x519b45e10803457f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x22:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.23@tcp remote: 0xac2804473d203600 expref: 17 pid: 9033 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746112070.875867:0:9033:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x22:0x0].0x0 (ffff880094f17100) 00010000:00010000:0.0:1746112070.875870:0:9033:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1746112070.875873:0:9033:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800b1a44e00, rc 0) 00000100:00100000:0.0:1746112070.875908:0:9033:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095731500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f1df1976-268d-4a53-a91b-09bc5fc9fdfb+17:14405:x1830931118977664:12345-192.168.204.23@tcp:101:cp.0 Request processed in 1437us (1524us total) trans 0 rc 0/0 00000100:00100000:0.0:1746112070.875915:0:9033:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 969 00000100:00100000:0.0:1746112070.877229:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1746112070.877264:0:7090:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830931118978048 00000100:00100000:2.0:1746112070.877268:0:7090:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830931118978048 00000100:00100000:2.0:1746112070.877288:0:7090:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 231 00000100:00100000:2.0:1746112070.877304:0:7090:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095610e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f1df1976-268d-4a53-a91b-09bc5fc9fdfb+17:14405:x1830931118978048:12345-192.168.204.23@tcp:35:cp.0 00000100:00100000:2.0:1746112070.877577:0:7090:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095610e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f1df1976-268d-4a53-a91b-09bc5fc9fdfb+18:14405:x1830931118978048:12345-192.168.204.23@tcp:35:cp.0 Request processed in 283us (348us total) trans 4294967667 rc 0/0 00000100:00100000:2.0:1746112070.877582:0:7090:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 231 00000100:00100000:3.0:1746112070.882373:0:3298:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746112070.882415:0:9033:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830931118978176 00000100:00100000:0.0:1746112070.882423:0:9033:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830931118978176 00000100:00100000:0.0:1746112070.882464:0:9033:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 970 00000100:00100000:0.0:1746112070.882469:0:9033:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094d81500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f1df1976-268d-4a53-a91b-09bc5fc9fdfb+18:14406:x1830931118978176:12345-192.168.204.23@tcp:101:lfs.0 00010000:00010000:0.0:1746112070.882487:0:9033:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746112070.882501:0:9033:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880134a4da00/0x519b45e108034586 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xac2804473d203607 expref: -99 pid: 9033 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746112070.882550:0:9033:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880134a4d200/0x519b45e10803458d lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9033 initiator: MDT0 00010000:00010000:0.0:1746112070.882560:0:9033:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880134a4d200/0x519b45e10803458d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9033 initiator: MDT0 00010000:00010000:0.0:1746112070.882568:0:9033:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880134a4d200/0x519b45e10803458d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9033 initiator: MDT0 00010000:00010000:0.0:1746112070.882575:0:9033:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880134a4de00/0x519b45e108034594 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xbccb0c83 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9033 initiator: MDT0 00010000:00010000:0.0:1746112070.882579:0:9033:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880134a4de00/0x519b45e108034594 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xbccb0c83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9033 initiator: MDT0 00010000:00010000:0.0:1746112070.882583:0:9033:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880134a4de00/0x519b45e108034594 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xbccb0c83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9033 initiator: MDT0 00010000:00010000:0.0:1746112070.882671:0:9033:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880134a4ca00/0x519b45e10803459b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x22:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9033 initiator: MDT0 00010000:00010000:0.0:1746112070.882676:0:9033:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880134a4ca00/0x519b45e10803459b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x22:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9033 initiator: MDT0 00010000:00010000:0.0:1746112070.882679:0:9033:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880134a4ca00/0x519b45e10803459b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x22:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9033 initiator: MDT0 00000004:00200000:0.0:1746112070.882712:0:9033:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000401:0x22:0x0]: returning size 159 00000004:00200000:0.0:1746112070.882715:0:9033:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1746112070.882724:0:9033:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff880134a4ca00/0x519b45e10803459b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x22:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9033 initiator: MDT0 00010000:00010000:0.0:1746112070.882732:0:9033:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880134a4ca00/0x519b45e10803459b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x22:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9033 initiator: MDT0 00010000:00010000:0.0:1746112070.882737:0:9033:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880134a4d200/0x519b45e10803458d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9033 initiator: MDT0 00010000:00010000:0.0:1746112070.882741:0:9033:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880134a4d200/0x519b45e10803458d lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9033 initiator: MDT0 00010000:00010000:0.0:1746112070.882745:0:9033:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880134a4d200/0x519b45e10803458d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9033 initiator: MDT0 00010000:00010000:0.0:1746112070.882749:0:9033:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880134a4d200 already unused, calling callback (ffffffffa1360690) 00010000:00010000:0.0:1746112070.882752:0:9033:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880134a4d200/0x519b45e10803458d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9033 initiator: MDT0 00010000:00010000:0.0:1746112070.882756:0:9033:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880134a4d200/0x519b45e10803458d lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9033 initiator: MDT0 00010000:00010000:0.0:1746112070.882763:0:9033:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff880094f17f00) 00010000:00010000:0.0:1746112070.882765:0:9033:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746112070.882768:0:9033:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880134a4d200/0x519b45e10803458d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9033 initiator: MDT0 00010000:00010000:0.0:1746112070.882771:0:9033:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880134a4d200/0x519b45e10803458d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9033 initiator: MDT0 00010000:00010000:0.0:1746112070.882777:0:9033:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880134a4de00/0x519b45e108034594 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xbccb0c83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9033 initiator: MDT0 00010000:00010000:0.0:1746112070.882784:0:9033:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880134a4de00/0x519b45e108034594 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xbccb0c83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9033 initiator: MDT0 00010000:00010000:0.0:1746112070.882787:0:9033:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880134a4de00/0x519b45e108034594 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xbccb0c83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9033 initiator: MDT0 00010000:00010000:0.0:1746112070.882790:0:9033:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880134a4de00 already unused, calling callback (ffffffffa1360690) 00010000:00010000:0.0:1746112070.882791:0:9033:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880134a4de00/0x519b45e108034594 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xbccb0c83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9033 initiator: MDT0 00010000:00010000:0.0:1746112070.882794:0:9033:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880134a4de00/0x519b45e108034594 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xbccb0c83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9033 initiator: MDT0 00010000:00010000:0.0:1746112070.882797:0:9033:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xbccb0c83 (ffff88009cddbc00) 00010000:00010000:0.0:1746112070.882799:0:9033:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746112070.882800:0:9033:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880134a4de00/0x519b45e108034594 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xbccb0c83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9033 initiator: MDT0 00010000:00010000:0.0:1746112070.882802:0:9033:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880134a4de00/0x519b45e108034594 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xbccb0c83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9033 initiator: MDT0 00010000:00010000:0.0:1746112070.882821:0:9033:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880134a4da00/0x519b45e108034586 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xac2804473d203607 expref: 20 pid: 9033 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746112070.882828:0:9033:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880134a4ca00/0x519b45e10803459b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x22:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.23@tcp remote: 0xac2804473d203607 expref: 19 pid: 9033 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746112070.882832:0:9033:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x22:0x0].0x0 (ffff880094f17100) 00010000:00010000:0.0:1746112070.882833:0:9033:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1746112070.882834:0:9033:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880134a4ca00, rc 0) 00000100:00100000:0.0:1746112070.882873:0:9033:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094d81500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f1df1976-268d-4a53-a91b-09bc5fc9fdfb+19:14406:x1830931118978176:12345-192.168.204.23@tcp:101:lfs.0 Request processed in 405us (510us total) trans 0 rc 0/0 00000100:00100000:0.0:1746112070.882882:0:9033:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 970 00000100:00100000:0.0:1746112070.883888:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1746112070.883936:0:8436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830931118978304 00000100:00100000:1.0:1746112070.883941:0:8436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830931118978304 00000100:00100000:1.0:1746112070.883972:0:8436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 7 00000100:00100000:1.0:1746112070.883995:0:8436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095613800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f1df1976-268d-4a53-a91b-09bc5fc9fdfb+19:1967:x1830931118978304:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746112070.884004:0:8436:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746112070.884015:0:8436:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880134a4ca00/0x519b45e10803459b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x22:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.23@tcp remote: 0xac2804473d203607 expref: 19 pid: 9033 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746112070.884025:0:8436:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x22:0x0].0x0 (ffff880094f17100) 00010000:00010000:1.0:1746112070.884029:0:8436:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746112070.884058:0:8436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095613800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f1df1976-268d-4a53-a91b-09bc5fc9fdfb+18:1967:x1830931118978304:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 80us (170us total) trans 0 rc 0/0 00000100:00100000:1.0:1746112070.884064:0:8436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 7 00000100:00100000:3.0:1746112070.884146:0:3298:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746112070.884159:0:9033:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830931118978560 00000100:00100000:0.0:1746112070.884163:0:9033:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830931118978560 00000100:00100000:0.0:1746112070.884190:0:9033:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 971 00000100:00100000:0.0:1746112070.884197:0:9033:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094d83b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f1df1976-268d-4a53-a91b-09bc5fc9fdfb+18:14406:x1830931118978560:12345-192.168.204.23@tcp:101:lfs.0 00010000:00010000:0.0:1746112070.884204:0:9033:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746112070.884210:0:9033:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880134a4ce00/0x519b45e1080345a2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xac2804473d20360e expref: -99 pid: 9033 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746112070.884247:0:9033:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880134a4dc00/0x519b45e1080345a9 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x22:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9033 initiator: MDT0 00010000:00010000:0.0:1746112070.884254:0:9033:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800b1a44e00/0x519b45e10803457f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x22:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.23@tcp remote: 0xac2804473d203600 expref: 19 pid: 9033 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746112070.884259:0:9033:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880134a4dc00/0x519b45e1080345a9 lrc: 4/0,1 mode: --/CW res: [0x200000401:0x22:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9033 initiator: MDT0 00010000:00010000:0.0:1746112070.884280:0:9033:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800b1a44e00/0x519b45e10803457f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x22:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.23@tcp remote: 0xac2804473d203600 expref: 19 pid: 9033 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746112070.884288:0:9033:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800b1a44e00/0x519b45e10803457f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x22:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.23@tcp remote: 0xac2804473d203600 expref: 19 pid: 9033 timeout: 218 lvb_type: 0 00000100:00100000:0.0:1746112070.884312:0:9033:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095611880 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9033:1830931125069312:192.168.204.23@tcp:104: 00000100:00100000:0.0:1746112070.884368:0:9033:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009cf4be40 going to sleep for 11 seconds 00000100:00100000:2.0:1746112070.885000:0:9033:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095611880 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9033:1830931125069312:192.168.204.23@tcp:104: 00010000:00010000:2.0:1746112070.885014:0:9033:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880134a4dc00/0x519b45e1080345a9 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x22:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9033 initiator: MDT0 00000100:00100000:3.0:1746112070.885111:0:3298:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1746112070.885151:0:8436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830931118978688 00000100:00100000:1.0:1746112070.885155:0:8436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830931118978688 00010000:00010000:1.0:1746112070.885165:0:8436:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800b1a44e00/0x519b45e10803457f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x22:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.23@tcp remote: 0xac2804473d203600 expref: 20 pid: 9033 timeout: 218 lvb_type: 0 00000100:00100000:1.0:1746112070.885192:0:8436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 206 00000100:00100000:1.0:1746112070.885196:0:8436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094d80a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f1df1976-268d-4a53-a91b-09bc5fc9fdfb+20:1966:x1830931118978688:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746112070.885202:0:8436:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746112070.885205:0:8436:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800b1a44e00/0x519b45e10803457f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x22:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.23@tcp remote: 0xac2804473d203600 expref: 20 pid: 9033 timeout: 218 lvb_type: 0 00010000:00010000:1.0:1746112070.885212:0:8436:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800b1a44e00/0x519b45e10803457f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x22:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.23@tcp remote: 0xac2804473d203600 expref: 20 pid: 9033 timeout: 218 lvb_type: 0 00010000:00010000:1.0:1746112070.885221:0:8436:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800b1a44e00/0x519b45e10803457f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x22:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.23@tcp remote: 0xac2804473d203600 expref: 20 pid: 9033 timeout: 218 lvb_type: 0 00010000:00010000:1.0:1746112070.885227:0:8436:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x22:0x0].0x0 (ffff880094f17100) 00010000:00010000:1.0:1746112070.885230:0:8436:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880134a4dc00/0x519b45e1080345a9 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x22:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9033 initiator: MDT0 00010000:00010000:1.0:1746112070.885235:0:8436:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880134a4dc00/0x519b45e1080345a9 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x22:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 9033 initiator: MDT0 00010000:00010000:1.0:1746112070.885238:0:8436:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880134a4dc00/0x519b45e1080345a9 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x22:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 9033 initiator: MDT0 00010000:00010000:1.0:1746112070.885246:0:8436:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746112070.885252:0:9033:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880134a4dc00/0x519b45e1080345a9 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x22:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9033 initiator: MDT0 00010000:00010000:2.0:1746112070.885257:0:9033:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880134a4dc00/0x519b45e1080345a9 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x22:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9033 initiator: MDT0 00000004:00200000:2.0:1746112070.885265:0:9033:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000401:0x22:0x0]: returning size 159 00000100:00100000:1.0:1746112070.885267:0:8436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094d80a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f1df1976-268d-4a53-a91b-09bc5fc9fdfb+19:1966:x1830931118978688:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 70us (157us total) trans 0 rc 0/0 00000100:00100000:1.0:1746112070.885270:0:8436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 206 00010000:00010000:2.0:1746112070.885366:0:9033:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880134a4ce00/0x519b45e1080345a2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xac2804473d20360e expref: 20 pid: 9033 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746112070.885378:0:9033:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880134a4dc00/0x519b45e1080345a9 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x22:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.23@tcp remote: 0xac2804473d20360e expref: 19 pid: 9033 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746112070.885385:0:9033:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x22:0x0].0x0 (ffff880094f17100) 00010000:00010000:2.0:1746112070.885387:0:9033:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1746112070.885389:0:9033:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880134a4dc00, rc 0) 00000100:00100000:2.0:1746112070.885421:0:9033:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094d83b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f1df1976-268d-4a53-a91b-09bc5fc9fdfb+19:14406:x1830931118978560:12345-192.168.204.23@tcp:101:lfs.0 Request processed in 1225us (1277us total) trans 4294967668 rc 0/0 00000100:00100000:2.0:1746112070.885426:0:9033:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 971 00000100:00100000:3.0:1746112070.886241:0:3298:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1746112070.886282:0:9033:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830931118978816 00000100:00100000:2.0:1746112070.886286:0:9033:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830931118978816 00000100:00100000:2.0:1746112070.886319:0:9033:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 972 00000100:00100000:2.0:1746112070.886323:0:9033:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094d80700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f1df1976-268d-4a53-a91b-09bc5fc9fdfb+19:14406:x1830931118978816:12345-192.168.204.23@tcp:101:lfs.0 00010000:00010000:2.0:1746112070.886330:0:9033:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746112070.886337:0:9033:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012eb67400/0x519b45e1080345b7 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x22:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xac2804473d203615 expref: -99 pid: 9033 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746112070.886367:0:9033:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012eb66400/0x519b45e1080345be lrc: 3/1,0 mode: --/PR res: [0x200000401:0x22:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9033 initiator: MDT0 00010000:00010000:2.0:1746112070.886377:0:9033:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880134a4dc00/0x519b45e1080345a9 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x22:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.23@tcp remote: 0xac2804473d20360e expref: 20 pid: 9033 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746112070.886382:0:9033:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012eb66400/0x519b45e1080345be lrc: 4/1,0 mode: --/PR res: [0x200000401:0x22:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9033 initiator: MDT0 00010000:00010000:2.0:1746112070.886393:0:9033:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880134a4dc00/0x519b45e1080345a9 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x22:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.23@tcp remote: 0xac2804473d20360e expref: 20 pid: 9033 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746112070.886399:0:9033:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880134a4dc00/0x519b45e1080345a9 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x22:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.23@tcp remote: 0xac2804473d20360e expref: 20 pid: 9033 timeout: 218 lvb_type: 0 00000100:00100000:2.0:1746112070.886405:0:9033:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095731180 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9033:1830931125069440:192.168.204.23@tcp:104: 00000100:00100000:2.0:1746112070.886441:0:9033:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800ac488000 going to sleep for 11 seconds 00000100:00100000:2.0:1746112070.887025:0:9033:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095731180 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9033:1830931125069440:192.168.204.23@tcp:104: 00010000:00010000:2.0:1746112070.887035:0:9033:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88012eb66400/0x519b45e1080345be lrc: 3/1,0 mode: --/PR res: [0x200000401:0x22:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9033 initiator: MDT0 00000100:00100000:3.0:1746112070.887145:0:3298:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1746112070.887186:0:8436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830931118978944 00000100:00100000:1.0:1746112070.887189:0:8436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830931118978944 00010000:00010000:1.0:1746112070.887210:0:8436:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880134a4dc00/0x519b45e1080345a9 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x22:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.23@tcp remote: 0xac2804473d20360e expref: 21 pid: 9033 timeout: 218 lvb_type: 0 00000100:00100000:1.0:1746112070.887236:0:8436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 207 00000100:00100000:1.0:1746112070.887242:0:8436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094d83100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f1df1976-268d-4a53-a91b-09bc5fc9fdfb+21:1966:x1830931118978944:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746112070.887249:0:8436:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746112070.887254:0:8436:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880134a4dc00/0x519b45e1080345a9 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x22:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.23@tcp remote: 0xac2804473d20360e expref: 21 pid: 9033 timeout: 218 lvb_type: 0 00010000:00010000:1.0:1746112070.887263:0:8436:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880134a4dc00/0x519b45e1080345a9 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x22:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.23@tcp remote: 0xac2804473d20360e expref: 21 pid: 9033 timeout: 218 lvb_type: 0 00010000:00010000:1.0:1746112070.887275:0:8436:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880134a4dc00/0x519b45e1080345a9 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x22:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.23@tcp remote: 0xac2804473d20360e expref: 21 pid: 9033 timeout: 218 lvb_type: 0 00010000:00010000:1.0:1746112070.887284:0:8436:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x22:0x0].0x0 (ffff880094f17100) 00010000:00010000:1.0:1746112070.887288:0:8436:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88012eb66400/0x519b45e1080345be lrc: 3/1,0 mode: --/PR res: [0x200000401:0x22:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9033 initiator: MDT0 00010000:00010000:1.0:1746112070.887308:0:8436:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012eb66400/0x519b45e1080345be lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x22:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 9033 initiator: MDT0 00010000:00010000:1.0:1746112070.887314:0:8436:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012eb66400/0x519b45e1080345be lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x22:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 9033 initiator: MDT0 00010000:00010000:1.0:1746112070.887334:0:8436:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746112070.887342:0:9033:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88012eb66400/0x519b45e1080345be lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x22:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9033 initiator: MDT0 00010000:00010000:2.0:1746112070.887348:0:9033:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012eb66400/0x519b45e1080345be lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x22:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9033 initiator: MDT0 00000100:00100000:1.0:1746112070.887360:0:8436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094d83100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f1df1976-268d-4a53-a91b-09bc5fc9fdfb+20:1966:x1830931118978944:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 118us (215us total) trans 0 rc 0/0 00000004:00200000:2.0:1746112070.887361:0:9033:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000401:0x22:0x0]: returning size 159 00000004:00200000:2.0:1746112070.887363:0:9033:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000100:00100000:1.0:1746112070.887367:0:8436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 207 00000004:00010000:2.0:1746112070.887369:0:9033:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88012eb66400/0x519b45e1080345be lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x22:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9033 initiator: MDT0 00010000:00010000:2.0:1746112070.887382:0:9033:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012eb67400/0x519b45e1080345b7 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x22:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xac2804473d203615 expref: 20 pid: 9033 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746112070.887395:0:9033:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012eb66400/0x519b45e1080345be lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x22:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.23@tcp remote: 0xac2804473d203615 expref: 19 pid: 9033 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746112070.887402:0:9033:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x22:0x0].0x0 (ffff880094f17100) 00010000:00010000:2.0:1746112070.887405:0:9033:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1746112070.887407:0:9033:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012eb66400, rc 0) 00000100:00100000:2.0:1746112070.887440:0:9033:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094d80700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f1df1976-268d-4a53-a91b-09bc5fc9fdfb+19:14406:x1830931118978816:12345-192.168.204.23@tcp:101:lfs.0 Request processed in 1115us (1198us total) trans 0 rc 0/0 00000100:00100000:2.0:1746112070.887447:0:9033:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 972 00000100:00100000:3.0:1746112070.888283:0:3298:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1746112070.888331:0:9033:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830931118979200 00000100:00100000:2.0:1746112070.888335:0:9033:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830931118979200 00000100:00100000:2.0:1746112070.888358:0:9033:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 973 00000100:00100000:2.0:1746112070.888362:0:9033:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009cd02680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f1df1976-268d-4a53-a91b-09bc5fc9fdfb+19:14406:x1830931118979200:12345-192.168.204.23@tcp:101:lfs.0 00010000:00010000:2.0:1746112070.888369:0:9033:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746112070.888374:0:9033:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012eb67c00/0x519b45e1080345c5 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x22:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xac2804473d20361c expref: -99 pid: 9033 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746112070.888403:0:9033:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88012eb67a00/0x519b45e1080345cc lrc: 3/0,1 mode: --/PW res: [0x200000401:0x22:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9033 initiator: MDT0 00010000:00010000:2.0:1746112070.888408:0:9033:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012eb67a00/0x519b45e1080345cc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x22:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9033 initiator: MDT0 00010000:00010000:2.0:1746112070.888414:0:9033:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012eb67a00/0x519b45e1080345cc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x22:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9033 initiator: MDT0 00000004:00200000:2.0:1746112070.888419:0:9033:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000401:0x22:0x0]: returning size 159 00010000:00010000:2.0:1746112070.888456:0:9033:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012eb67c00/0x519b45e1080345c5 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x22:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xac2804473d20361c expref: 22 pid: 9033 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746112070.888468:0:9033:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012eb67a00/0x519b45e1080345cc lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x22:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.23@tcp remote: 0xac2804473d20361c expref: 21 pid: 9033 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746112070.888473:0:9033:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x22:0x0].0x0 (ffff880094f17100) 00010000:00010000:2.0:1746112070.888475:0:9033:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1746112070.888476:0:9033:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012eb67a00, rc 0) 00000100:00100000:2.0:1746112070.888501:0:9033:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009cd02680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f1df1976-268d-4a53-a91b-09bc5fc9fdfb+21:14406:x1830931118979200:12345-192.168.204.23@tcp:101:lfs.0 Request processed in 138us (220us total) trans 4294967669 rc 0/0 00000100:00100000:2.0:1746112070.888505:0:9033:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 973 00000100:00100000:0.0:1746112070.889124:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1746112070.889163:0:8420:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830931118979328 00000100:00100000:2.0:1746112070.889168:0:8420:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830931118979328 00000100:00100000:2.0:1746112070.889197:0:8420:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 234 00000100:00100000:2.0:1746112070.889203:0:8420:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095610a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f1df1976-268d-4a53-a91b-09bc5fc9fdfb+17:1965:x1830931118979328:12345-192.168.204.23@tcp:1:lfs.0 00010000:00010000:2.0:1746112070.889230:0:8420:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88012eb67e00/0x519b45e1080345da lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746112070.889242:0:8420:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880134a4c200/0x519b45e108034571 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.204.23@tcp remote: 0xac2804473d2035f9 expref: 17 pid: 8420 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746112070.889247:0:8420:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746112070.889248:0:8420:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746112070.889250:0:8420:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012eb67e00/0x519b45e1080345da lrc: 4/0,1 mode: --/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746112070.889262:0:8420:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880134a4c200/0x519b45e108034571 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000020 nid: 192.168.204.23@tcp remote: 0xac2804473d2035f9 expref: 17 pid: 8420 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746112070.889276:0:8420:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880134a4c200/0x519b45e108034571 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480000020 nid: 192.168.204.23@tcp remote: 0xac2804473d2035f9 expref: 17 pid: 8420 timeout: 218 lvb_type: 0 00000100:00100000:2.0:1746112070.889285:0:8420:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095731180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8420:1830931125069568:192.168.204.23@tcp:104: 00000100:00100000:2.0:1746112070.889336:0:8420:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800ac488000 going to sleep for 11 seconds 00000100:00100000:2.0:1746112070.889888:0:8420:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095731180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8420:1830931125069568:192.168.204.23@tcp:104: 00010000:00010000:2.0:1746112070.889896:0:8420:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88012eb67e00/0x519b45e1080345da lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746112070.890034:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1746112070.890066:0:15550:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830931118979456 00000100:00100000:2.0:1746112070.890069:0:15550:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830931118979456 00002000:00100000:2.0:1746112070.890085:0:15550:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x1e:0x0] (0->158) req@ffff880095613b80 x1830931118979456/t0(0) o4->f1df1976-268d-4a53-a91b-09bc5fc9fdfb@192.168.204.23@tcp:176/0 lens 648/0 e 0 to 0 dl 1746112081 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 00002000:00100000:2.0:1746112070.890094:0:15550:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095613b80 with x1830931118979456 ext(0->158) 00010000:00010000:2.0:1746112070.890100:0:15550:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880134a4c200/0x519b45e108034571 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480000020 nid: 192.168.204.23@tcp remote: 0xac2804473d2035f9 expref: 18 pid: 8420 timeout: 218 lvb_type: 0 00010000:00010000:2.0:1746112070.890110:0:15550:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880134a4c200/0x519b45e108034571 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480000020 nid: 192.168.204.23@tcp remote: 0xac2804473d2035f9 expref: 18 pid: 8420 timeout: 218 lvb_type: 0 00002000:00010000:2.0:1746112070.890117:0:15550:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880095613b80 00000100:00100000:2.0:1746112070.890133:0:15550:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 2 00000100:00100000:2.0:1746112070.890139:0:15550:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095613b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:f1df1976-268d-4a53-a91b-09bc5fc9fdfb+18:1966:x1830931118979456:12345-192.168.204.23@tcp:4:cp.0 00000100:00100000:2.0:1746112070.890432:0:15550:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095613b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:f1df1976-268d-4a53-a91b-09bc5fc9fdfb+20:1966:x1830931118979456:12345-192.168.204.23@tcp:4:cp.0 Request processed in 294us (399us total) trans 4294967335 rc 0/0 00000100:00100000:2.0:1746112070.890440:0:15550:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 2 00002000:00100000:2.0:1746112070.890444:0:15550:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x1e:0x0] (0->158) req@ffff880095613b80 x1830931118979456/t4294967335(0) o4->f1df1976-268d-4a53-a91b-09bc5fc9fdfb@192.168.204.23@tcp:176/0 lens 648/448 e 0 to 0 dl 1746112081 ref 1 fl Complete:H/200/0 rc 0/0 job:'cp.0' uid:0 gid:0 00002000:00100000:2.0:1746112070.890450:0:15550:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095613b80 with x1830931118979456 ext(0->158) 00010000:00010000:2.0:1746112070.890453:0:15550:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880134a4c200/0x519b45e108034571 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480000020 nid: 192.168.204.23@tcp remote: 0xac2804473d2035f9 expref: 20 pid: 8420 timeout: 218 lvb_type: 0 00010000:00010000:2.0:1746112070.890460:0:15550:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880134a4c200/0x519b45e108034571 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480000020 nid: 192.168.204.23@tcp remote: 0xac2804473d2035f9 expref: 20 pid: 8420 timeout: 218 lvb_type: 0 00002000:00010000:2.0:1746112070.890465:0:15550:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880095613b80 00000100:00100000:3.0:1746112070.891177:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1746112070.891218:0:8436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830931118979584 00000100:00100000:1.0:1746112070.891226:0:8436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830931118979584 00010000:00010000:1.0:1746112070.891237:0:8436:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880134a4c200/0x519b45e108034571 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480000020 nid: 192.168.204.23@tcp remote: 0xac2804473d2035f9 expref: 20 pid: 8420 timeout: 218 lvb_type: 0 00000100:00100000:1.0:1746112070.891256:0:8436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 208 00000100:00100000:1.0:1746112070.891260:0:8436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800ac479050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f1df1976-268d-4a53-a91b-09bc5fc9fdfb+20:1968:x1830931118979584:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746112070.891266:0:8436:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:1.0:1746112070.891273:0:8436:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x1e:0x0] updating lvb size from disk: 0 -> 159 00010000:00010000:1.0:1746112070.891277:0:8436:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880134a4c200/0x519b45e108034571 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480000020 nid: 192.168.204.23@tcp remote: 0xac2804473d2035f9 expref: 20 pid: 8420 timeout: 218 lvb_type: 0 00010000:00010000:1.0:1746112070.891283:0:8436:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880134a4c200/0x519b45e108034571 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480000020 nid: 192.168.204.23@tcp remote: 0xac2804473d2035f9 expref: 20 pid: 8420 timeout: 218 lvb_type: 0 00010000:00010000:1.0:1746112070.891311:0:8436:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880134a4c200/0x519b45e108034571 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480000020 nid: 192.168.204.23@tcp remote: 0xac2804473d2035f9 expref: 20 pid: 8420 timeout: 218 lvb_type: 0 00010000:00010000:1.0:1746112070.891322:0:8436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746112070.891324:0:8436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746112070.891327:0:8436:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012eb67e00/0x519b45e1080345da lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746112070.891335:0:8436:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012eb67e00/0x519b45e1080345da lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746112070.891356:0:8436:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746112070.891367:0:8420:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88012eb67e00/0x519b45e1080345da lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746112070.891374:0:8420:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012eb67e00/0x519b45e1080345da lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746112070.891384:0:8420:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88012eb67e00/0x519b45e1080345da lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746112070.891385:0:8436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800ac479050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f1df1976-268d-4a53-a91b-09bc5fc9fdfb+19:1968:x1830931118979584:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 123us (209us total) trans 0 rc 0/0 00010000:00010000:2.0:1746112070.891388:0:8420:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88012eb67e00/0x519b45e1080345da lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746112070.891393:0:8420:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88012eb67e00/0x519b45e1080345da lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746112070.891400:0:8436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 208 00010000:00010000:2.0:1746112070.891405:0:8420:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012eb67e00 already unused, calling callback (ffffffffa0889d70) 00010000:00010000:2.0:1746112070.891407:0:8420:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88012eb67e00/0x519b45e1080345da lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746112070.891411:0:8420:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88012eb67e00/0x519b45e1080345da lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746112070.891419:0:8420:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88012eb67e00/0x519b45e1080345da lrc: 2/0,0 mode: --/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746112070.891422:0:8420:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012eb67e00/0x519b45e1080345da lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746112070.891457:0:8420:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095610a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f1df1976-268d-4a53-a91b-09bc5fc9fdfb+18:1965:x1830931118979328:12345-192.168.204.23@tcp:1:lfs.0 Request processed in 2254us (2334us total) trans 0 rc 0/0 00000100:00100000:2.0:1746112070.891461:0:8420:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 234 00000100:00100000:3.0:1746112070.892102:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1746112070.892134:0:9033:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830931118979840 00000100:00100000:2.0:1746112070.892138:0:9033:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830931118979840 00000100:00100000:2.0:1746112070.892159:0:9033:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 974 00000100:00100000:2.0:1746112070.892163:0:9033:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009cd00380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f1df1976-268d-4a53-a91b-09bc5fc9fdfb+21:14406:x1830931118979840:12345-192.168.204.23@tcp:36:lfs.0 00010000:00010000:2.0:1746112070.892184:0:9033:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:2.0:1746112070.892193:0:9033:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012eb66400/0x519b45e1080345be lrc: 0/0,0 mode: --/PR res: [0x200000401:0x22:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.23@tcp remote: 0xac2804473d203615 expref: 21 pid: 9033 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746112070.892203:0:9033:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012cc00c00/0x519b45e10803456a lrc: 0/0,0 mode: --/CR res: [0x200000401:0x22:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.23@tcp remote: 0xac2804473d2035f2 expref: 20 pid: 9033 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746112070.892220:0:9033:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x22:0x0].0x0 (ffff880094f17100) 00010000:00010000:2.0:1746112070.892222:0:9033:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746112070.892235:0:9033:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88012eb67200/0x519b45e1080345e1 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x22:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9033 initiator: MDT0 00010000:00010000:2.0:1746112070.892242:0:9033:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012eb67200/0x519b45e1080345e1 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x22:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9033 initiator: MDT0 00010000:00010000:2.0:1746112070.892249:0:9033:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012eb67200/0x519b45e1080345e1 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x22:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9033 initiator: MDT0 00000040:00080000:2.0:1746112070.892546:0:9033:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x6:0x0].12, 88 off9224 00000004:00080000:2.0:1746112070.892551:0:9033:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 118957570004ns, next at 0ns, rc = 0 00000040:00080000:2.0:1746112070.892605:0:9033:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x3:0x0].13, 88 off9264 00000004:00080000:2.0:1746112070.892609:0:9033:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 118957628307ns, next at 112471106980ns, rc = 0 00000004:00010000:0.0:1746112070.898257:0:9033:0:(mdt_handler.c:4446:mdt_save_lock()) ### save lock request ffff88009cd00380 reply state ffff8800a66fa000 transno 4294967670 ns: mdt-lustre-MDT0000_UUID lock: ffff88012eb67200/0x519b45e1080345e1 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x22:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9033 initiator: MDT0 00000001:00080000:1.0:1746112070.898268:0:7138:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967670 is committed 00000100:00100000:0.0:1746112070.898268:0:9033:0:(service.c:173:ptlrpc_save_lock()) nlocks 0 00000004:00080000:1.0:1746112070.898273:0:7138:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 14 committed 00000004:00080000:1.0:1746112070.898279:0:7138:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 12 committed 00010000:00080000:0.0:1746112070.898338:0:9033:0:(ldlm_lib.c:3369:target_send_reply()) Schedule reply immediately 00000100:00100000:1.0:1746112070.898348:0:3305:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1746112070.898350:0:9033:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009cd00380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f1df1976-268d-4a53-a91b-09bc5fc9fdfb+17:14406:x1830931118979840:12345-192.168.204.23@tcp:36:lfs.0 Request processed in 6184us (6246us total) trans 4294967670 rc 0/0 00010000:00010000:3.0:1746112070.898356:0:3289:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88012eb67200/0x519b45e1080345e1 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x22:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9033 initiator: MDT0 00000100:00100000:0.0:1746112070.898357:0:9033:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 974 00000100:00100000:1.0:1746112070.898359:0:3305:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88013054f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1830931125069696:0@lo:2:osp-syn-1-0.0 00010000:00010000:3.0:1746112070.898362:0:3289:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012eb67200/0x519b45e1080345e1 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x22:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9033 initiator: MDT0 00010000:00010000:3.0:1746112070.898366:0:3289:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012eb67200/0x519b45e1080345e1 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x22:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9033 initiator: MDT0 00010000:00010000:3.0:1746112070.898370:0:3289:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012eb67200 already unused, calling callback (ffffffffa1360690) 00010000:00010000:3.0:1746112070.898376:0:3289:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012eb67200/0x519b45e1080345e1 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x22:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9033 initiator: MDT0 00010000:00010000:3.0:1746112070.898380:0:3289:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012eb67200/0x519b45e1080345e1 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x22:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9033 initiator: MDT0 00010000:00010000:3.0:1746112070.898389:0:3289:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x22:0x0].0x0 (ffff880094f17100) 00010000:00010000:3.0:1746112070.898391:0:3289:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1746112070.898393:0:3289:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012eb67200/0x519b45e1080345e1 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x22:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9033 initiator: MDT0 00000100:00100000:1.0:1746112070.898394:0:3305:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1746112070.898396:0:3289:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012eb67200/0x519b45e1080345e1 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x22:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9033 initiator: MDT0 00000100:00100000:0.0:1746112070.898396:0:3303:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095611c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1830931125069824:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746112070.898407:0:8420:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830931125069696 00000100:00100000:2.0:1746112070.898411:0:8420:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830931125069696 00000100:00100000:0.0:1746112070.898417:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746112070.898429:0:8420:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830931125069824 00000100:00100000:2.0:1746112070.898431:0:8420:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830931125069824 00000100:00100000:3.0:1746112070.898438:0:10391:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 235 00000100:00100000:2.0:1746112070.898442:0:8420:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 236 00000100:00100000:3.0:1746112070.898444:0:10391:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013054ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3305:x1830931125069696:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746112070.898446:0:8420:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095613800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+11:3303:x1830931125069824:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:2.0:1746112070.898534:0:8420:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x1f:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1746112070.898538:0:8420:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x1f:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:2.0:1746112070.898540:0:8420:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x1f:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1746112070.898542:0:8420:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x1f:0x0] updating lvb ctime from disk: 0 -> 0 00002000:00010000:2.0:1746112070.898544:0:8420:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x1f:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:3.0:1746112070.898557:0:10391:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013054ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3305:x1830931125069696:12345-0@lo:2:osp-syn-1-0.0 Request processed in 113us (163us total) trans 4294967336 rc 0/0 00000100:00100000:3.0:1746112070.898562:0:10391:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 235 00000100:00100000:2.0:1746112070.898581:0:8420:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095613800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+12:3303:x1830931125069824:12345-0@lo:2:osp-syn-0-0.0 Request processed in 133us (162us total) trans 4294967355 rc 0/0 00000004:00080000:1.0:1746112070.898584:0:3305:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88013054f800/2, rc 0, transno 4294967336 00000100:00100000:2.0:1746112070.898587:0:8420:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 236 00000100:00100000:1.0:1746112070.898589:0:3305:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88013054f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1830931125069696:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746112070.898599:0:3303:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880095611c00/2, rc 0, transno 4294967355 00000100:00100000:0.0:1746112070.898603:0:3303:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095611c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1830931125069824:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746112070.899140:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746112070.899171:0:9033:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830931118979968 00000100:00100000:0.0:1746112070.899175:0:9033:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830931118979968 00000100:00100000:0.0:1746112070.899195:0:9033:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 975 00000100:00100000:0.0:1746112070.899200:0:9033:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134a6df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f1df1976-268d-4a53-a91b-09bc5fc9fdfb+16:14406:x1830931118979968:12345-192.168.204.23@tcp:101:lfs.0 00010000:00010000:0.0:1746112070.899209:0:9033:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746112070.899217:0:9033:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012eb66a00/0x519b45e1080345e8 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x22:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xac2804473d203623 expref: -99 pid: 9033 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746112070.899244:0:9033:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012eb66a00/0x519b45e1080345e8 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x22:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.23@tcp remote: 0xac2804473d203623 expref: 17 pid: 9033 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746112070.899254:0:9033:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012eb66a00/0x519b45e1080345e8 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x22:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xac2804473d203623 expref: 17 pid: 9033 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746112070.899266:0:9033:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x22:0x0].0x0 (ffff880094f17100) 00010000:00010000:0.0:1746112070.899272:0:9033:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1746112070.899275:0:9033:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012eb66a00, rc 0) 00000100:00100000:0.0:1746112070.899306:0:9033:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134a6df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f1df1976-268d-4a53-a91b-09bc5fc9fdfb+17:14406:x1830931118979968:12345-192.168.204.23@tcp:101:lfs.0 Request processed in 94us (154us total) trans 0 rc 0/0 00000100:00100000:0.0:1746112070.899310:0:9033:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 975 00000100:00100000:3.0:1746112070.900160:0:3298:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746112070.900191:0:9033:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830931118980096 00000100:00100000:0.0:1746112070.900195:0:9033:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830931118980096 00000100:00100000:0.0:1746112070.900217:0:9033:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 976 00000100:00100000:0.0:1746112070.900221:0:9033:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134a6d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f1df1976-268d-4a53-a91b-09bc5fc9fdfb+17:14406:x1830931118980096:12345-192.168.204.23@tcp:101:lfs.0 00010000:00010000:0.0:1746112070.900227:0:9033:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746112070.900232:0:9033:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012eb66400/0x519b45e1080345ef lrc: 2/0,0 mode: --/CR res: [0x200000401:0x22:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xac2804473d20362a expref: -99 pid: 9033 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746112070.900263:0:9033:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012eb67e00/0x519b45e1080345f6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x22:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9033 initiator: MDT0 00010000:00010000:0.0:1746112070.900269:0:9033:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012eb67e00/0x519b45e1080345f6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x22:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9033 initiator: MDT0 00010000:00010000:0.0:1746112070.900275:0:9033:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012eb67e00/0x519b45e1080345f6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x22:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9033 initiator: MDT0 00000004:00200000:0.0:1746112070.900285:0:9033:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000401:0x22:0x0]: returning size 159 00000004:00200000:0.0:1746112070.900288:0:9033:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1746112070.900310:0:9033:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88012eb67e00/0x519b45e1080345f6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x22:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9033 initiator: MDT0 00010000:00010000:0.0:1746112070.900323:0:9033:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012eb66400/0x519b45e1080345ef lrc: 0/0,0 mode: --/CR res: [0x200000401:0x22:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0xac2804473d20362a expref: 19 pid: 9033 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746112070.900330:0:9033:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012eb67e00/0x519b45e1080345f6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x22:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.23@tcp remote: 0xac2804473d20362a expref: 18 pid: 9033 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746112070.900339:0:9033:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x22:0x0].0x0 (ffff880094f17100) 00010000:00010000:0.0:1746112070.900341:0:9033:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1746112070.900342:0:9033:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012eb67e00, rc 0) 00000100:00100000:0.0:1746112070.900367:0:9033:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134a6d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f1df1976-268d-4a53-a91b-09bc5fc9fdfb+18:14406:x1830931118980096:12345-192.168.204.23@tcp:101:lfs.0 Request processed in 145us (207us total) trans 0 rc 0/0 00000100:00100000:0.0:1746112070.900373:0:9033:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 976 00000100:00100000:2.0:1746112070.901211:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746112070.901229:0:8420:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830931118980224 00000100:00100000:0.0:1746112070.901233:0:8420:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830931118980224 00000100:00100000:0.0:1746112070.901257:0:8420:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 237 00000100:00100000:0.0:1746112070.901264:0:8420:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095731180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f1df1976-268d-4a53-a91b-09bc5fc9fdfb+18:1968:x1830931118980224:12345-192.168.204.23@tcp:101:lfs.0 00010000:00010000:0.0:1746112070.901272:0:8420:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746112070.901283:0:8420:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012eb67c00/0x519b45e1080345fd lrc: 2/0,0 mode: --/PR res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xac2804473d203631 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1746112070.901311:0:8420:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x1e:0x0] initial LVB size: 159, mtime: 0x68138e46, atime: 0x0, ctime: 0x68138e46, blocks: 0x1 00010000:00010000:0.0:1746112070.901324:0:8420:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746112070.901325:0:8420:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746112070.901331:0:8420:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012eb67c00/0x519b45e1080345fd lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xac2804473d203631 expref: 19 pid: 8420 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746112070.901343:0:8420:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012eb67c00/0x519b45e1080345fd lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xac2804473d203631 expref: 19 pid: 8420 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746112070.901352:0:8420:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012eb67c00, rc 0) 00000100:00100000:0.0:1746112070.901381:0:8420:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095731180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f1df1976-268d-4a53-a91b-09bc5fc9fdfb+19:1968:x1830931118980224:12345-192.168.204.23@tcp:101:lfs.0 Request processed in 118us (170us total) trans 0 rc 0/0 00000100:00100000:0.0:1746112070.901396:0:8420:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 237 00000100:00100000:3.0:1746112070.903018:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746112070.903033:0:9033:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830931118980480 00000100:00100000:0.0:1746112070.903037:0:9033:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830931118980480 00000100:00100000:0.0:1746112070.903058:0:9033:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 977 00000100:00100000:0.0:1746112070.903063:0:9033:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cfa9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f1df1976-268d-4a53-a91b-09bc5fc9fdfb+18:14406:x1830931118980480:12345-192.168.204.23@tcp:36:lfs.0 00010000:00010000:0.0:1746112070.903084:0:9033:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746112070.903092:0:9033:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012eb67e00/0x519b45e1080345f6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x22:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.23@tcp remote: 0xac2804473d20362a expref: 18 pid: 9033 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746112070.903099:0:9033:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x22:0x0].0x0 (ffff880094f17100) 00010000:00010000:0.0:1746112070.903101:0:9033:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1746112070.903115:0:9033:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88012eb67400/0x519b45e108034604 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x22:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9033 initiator: MDT0 00010000:00010000:0.0:1746112070.903121:0:9033:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012eb67400/0x519b45e108034604 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x22:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9033 initiator: MDT0 00010000:00010000:0.0:1746112070.903125:0:9033:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012eb67400/0x519b45e108034604 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x22:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9033 initiator: MDT0 00000004:00010000:0.0:1746112070.903219:0:9033:0:(mdt_handler.c:4446:mdt_save_lock()) ### save lock request ffff88012cfa9180 reply state ffff88012b982000 transno 4294967671 ns: mdt-lustre-MDT0000_UUID lock: ffff88012eb67400/0x519b45e108034604 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x22:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9033 initiator: MDT0 00000100:00100000:0.0:1746112070.903223:0:9033:0:(service.c:173:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1746112070.903257:0:9033:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cfa9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f1df1976-268d-4a53-a91b-09bc5fc9fdfb+19:14406:x1830931118980480:12345-192.168.204.23@tcp:36:lfs.0 Request processed in 194us (240us total) trans 4294967671 rc 0/0 00000100:00100000:0.0:1746112070.903261:0:9033:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 977 00010000:00010000:0.0:1746112070.903804:0:3289:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88012eb67400/0x519b45e108034604 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x22:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9033 initiator: MDT0 00010000:00010000:0.0:1746112070.903822:0:3289:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012eb67400/0x519b45e108034604 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x22:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9033 initiator: MDT0 00010000:00010000:0.0:1746112070.903828:0:3289:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012eb67400/0x519b45e108034604 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x22:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9033 initiator: MDT0 00010000:00010000:0.0:1746112070.903833:0:3289:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012eb67400 already unused, calling callback (ffffffffa1360690) 00010000:00010000:0.0:1746112070.903836:0:3289:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012eb67400/0x519b45e108034604 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x22:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9033 initiator: MDT0 00010000:00010000:0.0:1746112070.903841:0:3289:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012eb67400/0x519b45e108034604 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x22:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9033 initiator: MDT0 00000100:00100000:3.0:1746112070.903845:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00010000:00010000:0.0:1746112070.903850:0:3289:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x22:0x0].0x0 (ffff880094f17100) 00010000:00010000:0.0:1746112070.903852:0:3289:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746112070.903855:0:3289:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012eb67400/0x519b45e108034604 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x22:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9033 initiator: MDT0 00010000:00010000:0.0:1746112070.903860:0:3289:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012eb67400/0x519b45e108034604 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x22:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9033 initiator: MDT0 00000100:00100000:1.0:1746112070.903900:0:8420:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830931118980608 00000100:00100000:1.0:1746112070.903905:0:8420:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830931118980608 00000100:00100000:1.0:1746112070.903931:0:8420:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 238 00000100:00100000:1.0:1746112070.903937:0:8420:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cfa9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f1df1976-268d-4a53-a91b-09bc5fc9fdfb+19:1965:x1830931118980608:12345-192.168.204.23@tcp:2:lfs.0 00002000:00010000:1.0:1746112070.904021:0:8420:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x1e:0x0] updating lvb size from disk: 159 -> 159 00002000:00010000:1.0:1746112070.904023:0:8420:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x1e:0x0] updating lvb mtime from disk: 1746112070 -> 1746112070 00002000:00010000:1.0:1746112070.904025:0:8420:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x1e:0x0] updating lvb atime from disk: 0 -> 1746112070 00002000:00010000:1.0:1746112070.904026:0:8420:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x1e:0x0] updating lvb ctime from disk: 1746112070 -> 1746112070 00002000:00010000:1.0:1746112070.904027:0:8420:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x1e:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:1.0:1746112070.904053:0:8420:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cfa9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f1df1976-268d-4a53-a91b-09bc5fc9fdfb+20:1965:x1830931118980608:12345-192.168.204.23@tcp:2:lfs.0 Request processed in 116us (209us total) trans 4294967337 rc 0/0 00000100:00100000:1.0:1746112070.904059:0:8420:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 238 00000100:00100000:3.0:1746112070.904715:0:3298:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1746112070.904748:0:7090:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830931118980864 00000100:00100000:2.0:1746112070.904751:0:7090:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830931118980864 00000100:00100000:2.0:1746112070.904773:0:7090:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 232 00000100:00100000:2.0:1746112070.904777:0:7090:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a7a47850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f1df1976-268d-4a53-a91b-09bc5fc9fdfb+18:14406:x1830931118980864:12345-192.168.204.23@tcp:35:lfs.0 00000004:00010000:2.0:1746112070.904799:0:7090:0:(mdt_open.c:2471:mdt_close_resync_done()) ### [0x200000401:0x22:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88012eb67a00/0x519b45e1080345cc lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x22:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.23@tcp remote: 0xac2804473d20361c expref: 18 pid: 9033 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746112070.904815:0:7090:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5dd1600/0x519b45e10803460b lrc: 3/0,1 mode: --/EX res: [0x200000401:0x22:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7090 initiator: MDT0 00010000:00010000:2.0:1746112070.904821:0:7090:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012eb66a00/0x519b45e1080345e8 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x22:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xac2804473d203623 expref: 18 pid: 9033 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746112070.904825:0:7090:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5dd1600/0x519b45e10803460b lrc: 4/0,1 mode: --/EX res: [0x200000401:0x22:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7090 initiator: MDT0 00010000:00010000:2.0:1746112070.904838:0:7090:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88012eb66a00/0x519b45e1080345e8 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x22:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.23@tcp remote: 0xac2804473d203623 expref: 18 pid: 9033 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746112070.904844:0:7090:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88012eb66a00/0x519b45e1080345e8 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x22:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.23@tcp remote: 0xac2804473d203623 expref: 18 pid: 9033 timeout: 218 lvb_type: 0 00000100:00100000:2.0:1746112070.904851:0:7090:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095731c00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:7090:1830931125069952:192.168.204.23@tcp:104: 00000100:00100000:2.0:1746112070.904896:0:7090:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800ac488000 going to sleep for 11 seconds 00000100:00100000:0.0:1746112070.905695:0:7090:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095731c00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:7090:1830931125069952:192.168.204.23@tcp:104: 00010000:00010000:0.0:1746112070.905706:0:7090:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5dd1600/0x519b45e10803460b lrc: 3/0,1 mode: --/EX res: [0x200000401:0x22:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7090 initiator: MDT0 00000100:00100000:2.0:1746112070.905708:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1746112070.905749:0:8436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830931118980992 00000100:00100000:1.0:1746112070.905753:0:8436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830931118980992 00010000:00010000:1.0:1746112070.905765:0:8436:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012eb66a00/0x519b45e1080345e8 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x22:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.23@tcp remote: 0xac2804473d203623 expref: 19 pid: 9033 timeout: 218 lvb_type: 0 00000100:00100000:1.0:1746112070.905794:0:8436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 209 00000100:00100000:1.0:1746112070.905800:0:8436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095731c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f1df1976-268d-4a53-a91b-09bc5fc9fdfb+19:1966:x1830931118980992:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746112070.905808:0:8436:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746112070.905812:0:8436:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88012eb66a00/0x519b45e1080345e8 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x22:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.23@tcp remote: 0xac2804473d203623 expref: 19 pid: 9033 timeout: 218 lvb_type: 0 00010000:00010000:1.0:1746112070.905821:0:8436:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88012eb66a00/0x519b45e1080345e8 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x22:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.23@tcp remote: 0xac2804473d203623 expref: 19 pid: 9033 timeout: 218 lvb_type: 0 00010000:00010000:1.0:1746112070.905832:0:8436:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012eb66a00/0x519b45e1080345e8 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x22:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.23@tcp remote: 0xac2804473d203623 expref: 19 pid: 9033 timeout: 218 lvb_type: 0 00010000:00010000:1.0:1746112070.905840:0:8436:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x22:0x0].0x0 (ffff880094f17100) 00010000:00010000:1.0:1746112070.905844:0:8436:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5dd1600/0x519b45e10803460b lrc: 3/0,1 mode: --/EX res: [0x200000401:0x22:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7090 initiator: MDT0 00010000:00010000:1.0:1746112070.905850:0:8436:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5dd1600/0x519b45e10803460b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x22:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 7090 initiator: MDT0 00010000:00010000:1.0:1746112070.905854:0:8436:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5dd1600/0x519b45e10803460b lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x22:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 7090 initiator: MDT0 00010000:00010000:1.0:1746112070.905870:0:8436:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1746112070.905882:0:7090:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5dd1600/0x519b45e10803460b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x22:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7090 initiator: MDT0 00010000:00010000:0.0:1746112070.905886:0:7090:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5dd1600/0x519b45e10803460b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x22:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7090 initiator: MDT0 00000100:00100000:1.0:1746112070.905893:0:8436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095731c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f1df1976-268d-4a53-a91b-09bc5fc9fdfb+18:1966:x1830931118980992:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 93us (185us total) trans 0 rc 0/0 00000100:00100000:1.0:1746112070.905897:0:8436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 209 00000040:00080000:0.0:1746112070.906162:0:7090:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x6:0x0].13, 88 off9312 00000004:00080000:0.0:1746112070.906171:0:7090:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 118971190067ns, next at 0ns, rc = 0 00000040:00080000:0.0:1746112070.906210:0:7090:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x3:0x0].14, 88 off9352 00000004:00080000:0.0:1746112070.906213:0:7090:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 118971232287ns, next at 112471106980ns, rc = 0 00000001:00080000:0.0:1746112070.910953:0:7138:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967672 is committed 00000004:00080000:0.0:1746112070.910958:0:7138:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 15 committed 00000004:00080000:0.0:1746112070.910962:0:7138:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 13 committed 00000004:00010000:1.0:1746112070.910964:0:7090:0:(mdt_handler.c:4446:mdt_save_lock()) ### save lock request ffff8800a7a47850 reply state ffff880095385800 transno 4294967672 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5dd1600/0x519b45e10803460b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x22:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7090 initiator: MDT0 00000100:00100000:1.0:1746112070.910997:0:7090:0:(service.c:173:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1746112070.911001:0:7090:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x22:0x0].0x0 (ffff880094f17100) 00010000:00010000:1.0:1746112070.911003:0:7090:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1746112070.911007:0:7090:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012eb67a00/0x519b45e1080345cc lrc: 0/0,0 mode: --/PW res: [0x200000401:0x22:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.23@tcp remote: 0xac2804473d20361c expref: 16 pid: 9033 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746112070.911025:0:3303:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1746112070.911035:0:3303:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012cfaa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1830931125070080:0@lo:2:osp-syn-0-0.0 00010000:00080000:1.0:1746112070.911046:0:7090:0:(ldlm_lib.c:3369:target_send_reply()) Schedule reply immediately 00000100:00100000:1.0:1746112070.911052:0:7090:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a7a47850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f1df1976-268d-4a53-a91b-09bc5fc9fdfb+16:14406:x1830931118980864:12345-192.168.204.23@tcp:35:lfs.0 Request processed in 6275us (6339us total) trans 4294967672 rc 0/0 00010000:00010000:2.0:1746112070.911056:0:3290:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5dd1600/0x519b45e10803460b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x22:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7090 initiator: MDT0 00000100:00100000:1.0:1746112070.911057:0:7090:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 232 00010000:00010000:2.0:1746112070.911062:0:3290:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5dd1600/0x519b45e10803460b lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x22:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7090 initiator: MDT0 00000100:00100000:0.0:1746112070.911063:0:3303:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1746112070.911071:0:3290:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5dd1600/0x519b45e10803460b lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x22:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7090 initiator: MDT0 00010000:00010000:2.0:1746112070.911074:0:3290:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a5dd1600 already unused, calling callback (ffffffffa1360690) 00010000:00010000:2.0:1746112070.911076:0:3290:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5dd1600/0x519b45e10803460b lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x22:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7090 initiator: MDT0 00010000:00010000:2.0:1746112070.911080:0:3290:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5dd1600/0x519b45e10803460b lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x22:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7090 initiator: MDT0 00000100:00100000:0.0:1746112070.911082:0:3306:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00010000:00010000:2.0:1746112070.911086:0:3290:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x22:0x0].0x0 (ffff880094f17100) 00010000:00010000:2.0:1746112070.911087:0:3290:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1746112070.911089:0:3290:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5dd1600/0x519b45e10803460b lrc: 2/0,0 mode: --/EX res: [0x200000401:0x22:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7090 initiator: MDT0 00000100:00100000:0.0:1746112070.911089:0:3306:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095611880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3306:1830931125070208:0@lo:2:osp-syn-1-0.0 00010000:00010000:2.0:1746112070.911092:0:3290:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5dd1600/0x519b45e10803460b lrc: 0/0,0 mode: --/EX res: [0x200000401:0x22:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7090 initiator: MDT0 00000100:00100000:0.0:1746112070.911109:0:3306:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746112070.911123:0:10391:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830931125070080 00000100:00100000:0.0:1746112070.911124:0:8420:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830931125070208 00000100:00100000:3.0:1746112070.911127:0:10391:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830931125070080 00000100:00100000:0.0:1746112070.911127:0:8420:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830931125070208 00000100:00100000:3.0:1746112070.911150:0:10391:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 239 00000100:00100000:0.0:1746112070.911154:0:8420:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 240 00000100:00100000:3.0:1746112070.911156:0:10391:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b33b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+12:3303:x1830931125070080:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746112070.911158:0:8420:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b33a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3306:x1830931125070208:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:3.0:1746112070.911239:0:10391:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x1f:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1746112070.911239:0:8420:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x1e:0x0] updating lvb size from disk: 159 -> 159 00002000:00010000:3.0:1746112070.911242:0:10391:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x1f:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:0.0:1746112070.911242:0:8420:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x1e:0x0] updating lvb mtime from disk: 1746112070 -> 1746112070 00002000:00010000:0.0:1746112070.911244:0:8420:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x1e:0x0] updating lvb atime from disk: 1746112070 -> 1746112070 00002000:00010000:0.0:1746112070.911246:0:8420:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x1e:0x0] updating lvb ctime from disk: 1746112070 -> 1746112070 00002000:00010000:3.0:1746112070.911247:0:10391:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x1f:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1746112070.911248:0:8420:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x1e:0x0] updating lvb blocks from disk: 1 -> 1 00002000:00010000:3.0:1746112070.911249:0:10391:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x1f:0x0] updating lvb ctime from disk: 0 -> 0 00002000:00010000:3.0:1746112070.911250:0:10391:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x1f:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:3.0:1746112070.911280:0:10391:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b33b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+13:3303:x1830931125070080:12345-0@lo:2:osp-syn-0-0.0 Request processed in 123us (216us total) trans 4294967356 rc 0/0 00000100:00100000:0.0:1746112070.911280:0:8420:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b33a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+8:3306:x1830931125070208:12345-0@lo:2:osp-syn-1-0.0 Request processed in 120us (169us total) trans 4294967338 rc 0/0 00000100:00100000:3.0:1746112070.911286:0:10391:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 239 00000100:00100000:0.0:1746112070.911288:0:8420:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 240 00000004:00080000:1.0:1746112070.911304:0:3306:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880095611880/2, rc 0, transno 4294967338 00000100:00100000:1.0:1746112070.911308:0:3306:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095611880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3306:1830931125070208:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746112070.911321:0:3303:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012cfaa300/2, rc 0, transno 4294967356 00000100:00100000:1.0:1746112070.911323:0:3303:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012cfaa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1830931125070080:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746112070.911756:0:3298:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746112070.911773:0:9033:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830931118981120 00000100:00100000:0.0:1746112070.911777:0:9033:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830931118981120 00000100:00100000:0.0:1746112070.911799:0:9033:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 978 00000100:00100000:0.0:1746112070.911804:0:9033:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cfa8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f1df1976-268d-4a53-a91b-09bc5fc9fdfb+15:14406:x1830931118981120:12345-192.168.204.23@tcp:101:lfs.0 00010000:00010000:0.0:1746112070.911817:0:9033:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746112070.911824:0:9033:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800aab36400/0x519b45e108034612 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x22:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xac2804473d203638 expref: -99 pid: 9033 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746112070.911850:0:9033:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800aab36400/0x519b45e108034612 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x22:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.23@tcp remote: 0xac2804473d203638 expref: 16 pid: 9033 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746112070.911858:0:9033:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800aab36400/0x519b45e108034612 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x22:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0xac2804473d203638 expref: 16 pid: 9033 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746112070.911867:0:9033:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x22:0x0].0x0 (ffff88009cddbf00) 00010000:00010000:0.0:1746112070.911869:0:9033:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1746112070.911870:0:9033:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800aab36400, rc 0) 00000100:00100000:0.0:1746112070.911895:0:9033:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cfa8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f1df1976-268d-4a53-a91b-09bc5fc9fdfb+16:14406:x1830931118981120:12345-192.168.204.23@tcp:101:lfs.0 Request processed in 91us (140us total) trans 0 rc 0/0 00000100:00100000:0.0:1746112070.911901:0:9033:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 978 00000100:00100000:2.0:1746112070.912775:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1746112070.912818:0:7090:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830931118981376 00000100:00100000:1.0:1746112070.912823:0:7090:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830931118981376 00000100:00100000:1.0:1746112070.912851:0:7090:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 233 00000100:00100000:1.0:1746112070.912856:0:7090:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130d7a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f1df1976-268d-4a53-a91b-09bc5fc9fdfb+16:14406:x1830931118981376:12345-192.168.204.23@tcp:35:lfs.0 00000100:00100000:1.0:1746112070.912974:0:7090:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130d7a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f1df1976-268d-4a53-a91b-09bc5fc9fdfb+17:14406:x1830931118981376:12345-192.168.204.23@tcp:35:lfs.0 Request processed in 118us (200us total) trans 4294967673 rc 0/0 00000100:00100000:1.0:1746112070.912994:0:7090:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 233 00010000:00010000:2.0:1746112071.126094:0:9777:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1746112071.229177:0:18129:0:(debug.c:792:libcfs_debug_mark_buffer()) DEBUG MARKER: sanity-flr test_0j: @@@@@@ FAIL: resync /mnt/lustre/f0j.sanity-flr failed 00000100:00100000:0.0:1746112071.495697:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746112071.495741:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1746112071.495766:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1746112071.495768:0:9033:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830931118981632 00000100:00100000:2.0:1746112071.495782:0:9033:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830931118981632 00000100:00100000:3.0:1746112071.495815:0:7081:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830931118981504 00000100:00100000:0.0:1746112071.495817:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1746112071.495819:0:7081:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830931118981504 00000100:00100000:2.0:1746112071.495822:0:9033:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 45 00000100:00100000:1.0:1746112071.495826:0:8420:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830931118981888 00000100:00100000:2.0:1746112071.495829:0:9033:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b338700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f1df1976-268d-4a53-a91b-09bc5fc9fdfb+17:1967:x1830931118981632:12345-192.168.204.23@tcp:400:kworker.0 00000100:00100000:1.0:1746112071.495832:0:8420:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830931118981888 00000100:00100000:3.0:1746112071.495842:0:7081:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 217 00000100:00100000:3.0:1746112071.495847:0:7081:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a6d2bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cbea3723-17d9-4d6a-89f1-55c1ba4a6020+9:1968:x1830931118981504:12345-192.168.204.23@tcp:400:kworker.0 00000100:00100000:1.0:1746112071.495856:0:8420:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830931118981760 00000100:00100000:1.0:1746112071.495864:0:8420:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830931118981760 00000100:00100000:0.0:1746112071.495864:0:10391:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 35 00000100:00100000:0.0:1746112071.495871:0:10391:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b339f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f1df1976-268d-4a53-a91b-09bc5fc9fdfb+20:1967:x1830931118981888:12345-192.168.204.23@tcp:400:kworker.0 00000100:00100000:3.0:1746112071.495880:0:7081:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a6d2bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cbea3723-17d9-4d6a-89f1-55c1ba4a6020+9:1968:x1830931118981504:12345-192.168.204.23@tcp:400:kworker.0 Request processed in 33us (140us total) trans 0 rc 0/0 00000100:00100000:2.0:1746112071.495880:0:9033:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b338700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f1df1976-268d-4a53-a91b-09bc5fc9fdfb+17:1967:x1830931118981632:12345-192.168.204.23@tcp:400:kworker.0 Request processed in 52us (189us total) trans 0 rc 0/0 00000100:00100000:1.0:1746112071.495884:0:8420:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 36 00000100:00100000:3.0:1746112071.495885:0:7081:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 217 00000100:00100000:2.0:1746112071.495885:0:9033:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 45 00000100:00100000:1.0:1746112071.495891:0:8420:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d30aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f1df1976-268d-4a53-a91b-09bc5fc9fdfb+21:1968:x1830931118981760:12345-192.168.204.23@tcp:400:kworker.0 00000100:00100000:0.0:1746112071.495900:0:10391:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b339f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f1df1976-268d-4a53-a91b-09bc5fc9fdfb+20:1967:x1830931118981888:12345-192.168.204.23@tcp:400:kworker.0 Request processed in 29us (133us total) trans 0 rc 0/0 00000100:00100000:0.0:1746112071.495907:0:10391:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 35 00000100:00100000:1.0:1746112071.495921:0:8420:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d30aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f1df1976-268d-4a53-a91b-09bc5fc9fdfb+21:1968:x1830931118981760:12345-192.168.204.23@tcp:400:kworker.0 Request processed in 30us (104us total) trans 0 rc 0/0 00000100:00100000:1.0:1746112071.495928:0:8420:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 36 Debug log: 1064 lines, 1064 kept, 0 dropped, 0 bad.