00000100:00100000:0.0F:1746129223.653316:0:3298:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009468f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7ea7f7eb-2f74-477e-bfed-16dc08365411:3298:1830949051532800:0@lo:400:kworker.0 00000100:00100000:0.0:1746129223.653371:0:3298:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746129223.653401:0:3298:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009468ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3298:1830949051533312:0@lo:400:kworker.0 00000100:00100000:0.0:1746129223.653416:0:3298:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746129223.653433:0:3298:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1746129223.653437:0:3298:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009468d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3298:1830949051532928:0@lo:400:kworker.0 00000100:00100000:0.0:1746129223.653449:0:3298:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746129223.653458:0:3298:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009468ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3298:1830949051533440:0@lo:400:kworker.0 00000100:00100000:0.0:1746129223.653474:0:3298:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746129223.653496:0:7121:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051533312 00000100:00100000:0.0:1746129223.653501:0:7121:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051533312 00000100:00100000:0.0:1746129223.653527:0:7121:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051532928 00000100:00100000:0.0:1746129223.653529:0:7121:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051532928 00000100:00100000:0.0:1746129223.653539:0:7121:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1746129223.653544:0:7121:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009468f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3298:x1830949051533312:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1746129223.653571:0:7121:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009468f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3298:x1830949051533312:12345-0@lo:400:kworker.0 Request processed in 27us (154us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129223.653576:0:7121:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1746129223.653586:0:7121:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1746129223.653589:0:7121:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009468d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3298:x1830949051532928:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1746129223.653602:0:7121:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009468d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3298:x1830949051532928:12345-0@lo:400:kworker.0 Request processed in 12us (152us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129223.653605:0:7121:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1746129223.653615:0:8435:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051533440 00000100:00100000:0.0:1746129223.653617:0:8435:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051533440 00000100:00100000:0.0:1746129223.653629:0:8435:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1746129223.653632:0:8435:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ba38000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+10:3298:x1830949051533440:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1746129223.653654:0:8435:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ba38000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+10:3298:x1830949051533440:12345-0@lo:400:kworker.0 Request processed in 22us (179us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129223.653658:0:8435:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00080000:0.0:1746129223.653667:0:7118:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1746129223.653670:0:7118:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1746129223.653688:0:3298:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009468d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3298:1830949051532928:0@lo:400:kworker.0 00000100:00100000:0.0:1746129223.653695:0:3298:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009468ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3298:1830949051533440:0@lo:400:kworker.0 00000100:00100000:0.0:1746129223.653701:0:3298:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009468ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3298:1830949051533312:0@lo:400:kworker.0 00000100:00100000:0.0:1746129223.653724:0:7116:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051532800 00000100:00100000:0.0:1746129223.653725:0:7116:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051532800 00000100:00100000:0.0:1746129223.653739:0:7116:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 233 00000100:00100000:0.0:1746129223.653742:0:7116:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b4e79c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7ea7f7eb-2f74-477e-bfed-16dc08365411+18:3298:x1830949051532800:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1746129223.653759:0:7116:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b4e79c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7ea7f7eb-2f74-477e-bfed-16dc08365411+18:3298:x1830949051532800:12345-0@lo:400:kworker.0 Request processed in 17us (388us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129223.653763:0:7116:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 233 00000100:00100000:0.0:1746129223.653782:0:3298:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009468f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7ea7f7eb-2f74-477e-bfed-16dc08365411:3298:1830949051532800:0@lo:400:kworker.0 00000100:00100000:0.0:1746129223.653797:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009468d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3296:1830949051533056:0@lo:400:kworker.0 00000100:00100000:0.0:1746129223.653810:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746129223.653820:0:3296:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1746129223.653823:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009468e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3296:1830949051533184:0@lo:400:kworker.0 00000100:00100000:0.0:1746129223.653834:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746129223.653860:0:10930:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051533184 00000100:00100000:0.0:1746129223.653863:0:10930:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051533184 00000100:00100000:0.0:1746129223.653876:0:10930:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1746129223.653879:0:10930:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ba38380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3296:x1830949051533184:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1746129223.653903:0:10930:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ba38380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3296:x1830949051533184:12345-0@lo:400:kworker.0 Request processed in 23us (68us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129223.653907:0:10930:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1746129223.653916:0:7123:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051533056 00000100:00100000:0.0:1746129223.653918:0:7123:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051533056 00000100:00100000:0.0:1746129223.653928:0:7123:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1746129223.653932:0:7123:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ba3ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3296:x1830949051533056:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1746129223.653947:0:7123:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ba3ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3296:x1830949051533056:12345-0@lo:400:kworker.0 Request processed in 15us (136us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129223.653950:0:7123:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00080000:0.0:1746129223.653957:0:7118:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1746129223.653959:0:7118:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1746129223.653966:0:3296:0:(client.c:2927:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967346 gen 2 00000004:00080000:0.0:1746129223.653970:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880095242a00, transno 4294967341 00000004:00080000:0.0:1746129223.653975:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880095240e00, transno 4294967342 00000004:00080000:0.0:1746129223.653977:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880094404380, transno 4294967343 00000004:00080000:0.0:1746129223.653979:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880094405f80, transno 4294967344 00000004:00080000:0.0:1746129223.653981:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009468fb80, transno 4294967345 00000004:00080000:0.0:1746129223.653983:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009468c380, transno 4294967346 00000100:00100000:0.0:1746129223.653986:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009468e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3296:1830949051533184:0@lo:400:kworker.0 00000100:00100000:0.0:1746129223.653991:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009468d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3296:1830949051533056:0@lo:400:kworker.0 00000004:00080000:0.0:1746129223.654128:0:8612:0:(osp_sync.c:1188:osp_sync_process_committed()) lustre-OST0000-osc-MDT0000: 0 changes, 0 in progress, 0 in flight, 6 done 00000100:00100000:2.0F:1746129223.685182:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ba38a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3296:1830949051533568:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1746129223.685251:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0F:1746129223.685355:0:8439:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051533568 00000100:00100000:3.0:1746129223.685366:0:8439:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051533568 00000100:00100000:3.0:1746129223.685411:0:8439:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1746129223.685418:0:8439:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b18ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+10:3296:x1830949051533568:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1746129223.685446:0:8439:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 47513600 pending 1703936 free 3858759680 avail 3856662528 00000100:00100000:3.0:1746129223.685487:0:8439:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b18ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+10:3296:x1830949051533568:12345-0@lo:13:osp-pre-1-0.0 Request processed in 70us (240us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129223.685493:0:8439:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1746129223.685522:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ba38a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3296:1830949051533568:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1746129223.753156:0:7111:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1746129224.755129:0:7110:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1746129225.143591:0:9890:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 4294967339 is committed 00000001:00080000:0.0:1746129225.143603:0:9890:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 4294967337 is committed 00000100:00100000:0.0:1746129225.573615:0:3296:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1746129225.573712:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b18b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3296:1830949051533696:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1746129225.573776:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746129225.575699:0:8438:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051533696 00000100:00100000:2.0:1746129225.575708:0:8438:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051533696 00000100:00100000:2.0:1746129225.575776:0:8438:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1746129225.575783:0:8438:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ba38a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3296:x1830949051533696:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1746129225.575815:0:8438:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 45809664 pending 0 free 3858759680 avail 3856662528 00000100:00100000:2.0:1746129225.575887:0:8438:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ba38a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3296:x1830949051533696:12345-0@lo:13:osp-pre-0-0.0 Request processed in 105us (2111us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129225.575893:0:8438:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00080000:0.0:1746129225.575941:0:7118:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0F:1746129225.576003:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b18b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3296:1830949051533696:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1746129225.756951:0:7111:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1746129226.759016:0:7110:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1746129226.886822:0:7171:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967660 is committed 00000100:00100000:0.0:1746129227.268742:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129227.268782:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129227.268831:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129227.268836:0:7115:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949046480640 00000100:00100000:2.0:1746129227.268844:0:7115:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949046480640 00000100:00100000:0.0:1746129227.268868:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129227.268883:0:7122:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949046480768 00000100:00100000:0.0:1746129227.268886:0:7122:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949046480768 00000100:00100000:0.0:1746129227.268913:0:7122:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 77 00000100:00100000:0.0:1746129227.268919:0:7122:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ba39880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f39d518f-facf-4547-b099-7a2592d93d98+15:1963:x1830949046480768:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:2.0:1746129227.268925:0:7115:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 234 00000100:00100000:2.0:1746129227.268932:0:7115:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b4e79850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfc67ec1-0948-4daf-9ffe-d16dc1c7751c+9:1964:x1830949046480640:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:0.0:1746129227.268970:0:7122:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ba39880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f39d518f-facf-4547-b099-7a2592d93d98+15:1963:x1830949046480768:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 52us (140us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129227.268976:0:7122:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 77 00000100:00100000:2.0:1746129227.268978:0:7115:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b4e79850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dfc67ec1-0948-4daf-9ffe-d16dc1c7751c+9:1964:x1830949046480640:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 46us (242us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129227.268984:0:7115:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 234 00000100:00100000:0.0:1746129227.268990:0:10930:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949046480896 00000100:00100000:0.0:1746129227.268992:0:10930:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949046480896 00000100:00100000:1.0:1746129227.268997:0:8435:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949046481024 00000100:00100000:1.0:1746129227.269001:0:8435:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949046481024 00000100:00100000:0.0:1746129227.269014:0:10930:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 49 00000100:00100000:0.0:1746129227.269018:0:10930:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ba39180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f39d518f-facf-4547-b099-7a2592d93d98+17:1964:x1830949046480896:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:1.0:1746129227.269033:0:8435:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 50 00000100:00100000:1.0:1746129227.269038:0:8435:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ba39c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f39d518f-facf-4547-b099-7a2592d93d98+16:1963:x1830949046481024:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:0.0:1746129227.269039:0:10930:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ba39180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f39d518f-facf-4547-b099-7a2592d93d98+17:1964:x1830949046480896:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 21us (257us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129227.269044:0:10930:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 49 00000100:00080000:0.0:1746129227.269054:0:7118:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1746129227.269056:0:7118:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1746129227.269058:0:7118:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1746129227.269062:0:8435:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ba39c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f39d518f-facf-4547-b099-7a2592d93d98+16:1963:x1830949046481024:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 24us (193us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129227.269068:0:8435:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 50 00000001:02000400:3.0:1746129227.571264:0:18237:0:(debug.c:792:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-flr test 0j: test lfs mirror read/write commands ========================================================== 15:53:47 (1746129227) 00000100:00100000:2.0:1746129227.604914:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129227.604984:0:12160:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949046481152 00000100:00100000:1.0:1746129227.604990:0:12160:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949046481152 00000100:00100000:1.0:1746129227.605024:0:12160:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 965 00000100:00100000:1.0:1746129227.605031:0:12160:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b18b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f39d518f-facf-4547-b099-7a2592d93d98+15:14438:x1830949046481152:12345-192.168.204.31@tcp:101:lfs.0 00010000:00010000:1.0:1746129227.605045:0:12160:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129227.605061:0:12160:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009bba3000/0x48868a4e43904ea3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf337d38 expref: -99 pid: 12160 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129227.605116:0:12160:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009bba2c00/0x48868a4e43904eaa lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12160 initiator: MDT0 00010000:00010000:1.0:1746129227.605126:0:12160:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009bba2c00/0x48868a4e43904eaa lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12160 initiator: MDT0 00010000:00010000:1.0:1746129227.605137:0:12160:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009bba2c00/0x48868a4e43904eaa lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12160 initiator: MDT0 00010000:00010000:1.0:1746129227.605147:0:12160:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009bba2400/0x48868a4e43904eb1 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xbccb0c83 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12160 initiator: MDT0 00010000:00010000:1.0:1746129227.605152:0:12160:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009bba2400/0x48868a4e43904eb1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xbccb0c83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12160 initiator: MDT0 00010000:00010000:1.0:1746129227.605166:0:12160:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009bba2400/0x48868a4e43904eb1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xbccb0c83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12160 initiator: MDT0 00010000:00010000:1.0:1746129227.605275:0:12160:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009bba2c00/0x48868a4e43904eaa lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12160 initiator: MDT0 00010000:00010000:1.0:1746129227.605282:0:12160:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009bba2c00/0x48868a4e43904eaa lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 12160 initiator: MDT0 00010000:00010000:1.0:1746129227.605287:0:12160:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009bba2c00/0x48868a4e43904eaa lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12160 initiator: MDT0 00010000:00010000:1.0:1746129227.605292:0:12160:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009bba2c00 already unused, calling callback (ffffffffa1371690) 00010000:00010000:1.0:1746129227.605296:0:12160:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009bba2c00/0x48868a4e43904eaa lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12160 initiator: MDT0 00010000:00010000:1.0:1746129227.605301:0:12160:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009bba2c00/0x48868a4e43904eaa lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 12160 initiator: MDT0 00010000:00010000:1.0:1746129227.605311:0:12160:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009360d400) 00010000:00010000:1.0:1746129227.605313:0:12160:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746129227.605316:0:12160:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009bba2c00/0x48868a4e43904eaa lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12160 initiator: MDT0 00010000:00010000:1.0:1746129227.605321:0:12160:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009bba2c00/0x48868a4e43904eaa lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12160 initiator: MDT0 00010000:00010000:1.0:1746129227.605328:0:12160:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009bba2400/0x48868a4e43904eb1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xbccb0c83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12160 initiator: MDT0 00010000:00010000:1.0:1746129227.605333:0:12160:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009bba2400/0x48868a4e43904eb1 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xbccb0c83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12160 initiator: MDT0 00010000:00010000:1.0:1746129227.605337:0:12160:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009bba2400/0x48868a4e43904eb1 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xbccb0c83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12160 initiator: MDT0 00010000:00010000:1.0:1746129227.605345:0:12160:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009bba2400 already unused, calling callback (ffffffffa1371690) 00010000:00010000:1.0:1746129227.605347:0:12160:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009bba2400/0x48868a4e43904eb1 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xbccb0c83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12160 initiator: MDT0 00010000:00010000:1.0:1746129227.605351:0:12160:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009bba2400/0x48868a4e43904eb1 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xbccb0c83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12160 initiator: MDT0 00010000:00010000:1.0:1746129227.605358:0:12160:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xbccb0c83 (ffff880094409100) 00010000:00010000:1.0:1746129227.605360:0:12160:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746129227.605362:0:12160:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009bba2400/0x48868a4e43904eb1 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xbccb0c83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12160 initiator: MDT0 00010000:00010000:1.0:1746129227.605366:0:12160:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009bba2400/0x48868a4e43904eb1 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xbccb0c83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12160 initiator: MDT0 00010000:00010000:1.0:1746129227.605400:0:12160:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009bba3000/0x48868a4e43904ea3 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf337d38 expref: 16 pid: 12160 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129227.605407:0:12160:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009bba3000/0x48868a4e43904ea3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf337d38 expref: 16 pid: 12160 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129227.605414:0:12160:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009bba3000, rc 0) 00000100:00100000:1.0:1746129227.605447:0:12160:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b18b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f39d518f-facf-4547-b099-7a2592d93d98+15:14438:x1830949046481152:12345-192.168.204.31@tcp:101:lfs.0 Request processed in 417us (538us total) trans 0 rc 301/301 00000100:00100000:1.0:1746129227.605453:0:12160:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 965 00000100:00100000:0.0:1746129227.611583:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129227.611613:0:7122:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949046481408 00000100:00100000:0.0:1746129227.611625:0:7122:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949046481408 00000100:00100000:0.0:1746129227.611663:0:7122:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 966 00000100:00100000:0.0:1746129227.611670:0:7122:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ba39f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f39d518f-facf-4547-b099-7a2592d93d98+15:14438:x1830949046481408:12345-192.168.204.31@tcp:101:lfs.0 00010000:00010000:0.0:1746129227.611684:0:7122:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129227.611687:0:7122:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1746129227.611707:0:7122:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880095100c00/0x48868a4e43904c2d lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf337c74 expref: 15 pid: 7121 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129227.611720:0:7122:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009360d400) 00010000:00010000:0.0:1746129227.611729:0:7122:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1746129227.611738:0:7122:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880094da3800/0x48868a4e43904eb8 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf337d3f expref: -99 pid: 7122 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129227.611870:0:7122:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880094da2400/0x48868a4e43904ebf lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7122 initiator: MDT0 00010000:00010000:0.0:1746129227.611880:0:7122:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880094da2400/0x48868a4e43904ebf lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7122 initiator: MDT0 00010000:00010000:0.0:1746129227.611887:0:7122:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880094da2400/0x48868a4e43904ebf lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7122 initiator: MDT0 00010000:00010000:0.0:1746129227.611896:0:7122:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880094da3a00/0x48868a4e43904ec6 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xbccb0c83 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7122 initiator: MDT0 00010000:00010000:0.0:1746129227.611902:0:7122:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880094da3a00/0x48868a4e43904ec6 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xbccb0c83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7122 initiator: MDT0 00010000:00010000:0.0:1746129227.611906:0:7122:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880094da3a00/0x48868a4e43904ec6 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xbccb0c83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7122 initiator: MDT0 00010000:00010000:0.0:1746129227.612359:0:7122:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009391ee00/0x48868a4e43904ecd lrc: 3/1,0 mode: --/PR res: [0x200000401:0x22:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7122 initiator: MDT0 00010000:00010000:0.0:1746129227.612371:0:7122:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009391ee00/0x48868a4e43904ecd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x22:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7122 initiator: MDT0 00010000:00010000:0.0:1746129227.612378:0:7122:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009391ee00/0x48868a4e43904ecd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x22:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7122 initiator: MDT0 00000004:00200000:0.0:1746129227.612385:0:7122:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000401:0x22:0x0]: returning size 0 00010000:00010000:0.0:1746129227.612401:0:7122:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880094da2400/0x48868a4e43904ebf lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7122 initiator: MDT0 00010000:00010000:0.0:1746129227.612406:0:7122:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880094da2400/0x48868a4e43904ebf lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7122 initiator: MDT0 00010000:00010000:0.0:1746129227.612410:0:7122:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880094da2400/0x48868a4e43904ebf lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7122 initiator: MDT0 00010000:00010000:0.0:1746129227.612415:0:7122:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880094da2400 already unused, calling callback (ffffffffa1371690) 00010000:00010000:0.0:1746129227.612418:0:7122:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880094da2400/0x48868a4e43904ebf lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7122 initiator: MDT0 00010000:00010000:0.0:1746129227.612423:0:7122:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880094da2400/0x48868a4e43904ebf lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7122 initiator: MDT0 00010000:00010000:0.0:1746129227.612429:0:7122:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff880093907300) 00010000:00010000:0.0:1746129227.612431:0:7122:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746129227.612434:0:7122:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880094da2400/0x48868a4e43904ebf lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7122 initiator: MDT0 00010000:00010000:0.0:1746129227.612438:0:7122:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880094da2400/0x48868a4e43904ebf lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7122 initiator: MDT0 00000004:00010000:0.0:1746129227.612446:0:7122:0:(mdt_handler.c:4446:mdt_save_lock()) ### save lock request ffff88012ba39f80 reply state ffff880094a82000 transno 4294967661 ns: mdt-lustre-MDT0000_UUID lock: ffff880094da3a00/0x48868a4e43904ec6 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xbccb0c83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7122 initiator: MDT0 00000100:00100000:0.0:1746129227.612459:0:7122:0:(service.c:173:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1746129227.612477:0:7122:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880094da3800/0x48868a4e43904eb8 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf337d3f expref: 17 pid: 7122 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129227.612488:0:7122:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009391ee00/0x48868a4e43904ecd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x22:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf337d3f expref: 16 pid: 7122 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129227.612493:0:7122:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x22:0x0].0x0 (ffff880093907d00) 00010000:00010000:0.0:1746129227.612495:0:7122:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1746129227.612497:0:7122:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009391ee00, rc 0) 00000100:00100000:0.0:1746129227.614838:0:7122:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ba39f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f39d518f-facf-4547-b099-7a2592d93d98+17:14438:x1830949046481408:12345-192.168.204.31@tcp:101:lfs.0 Request processed in 3161us (3254us total) trans 4294967661 rc 0/0 00000100:00100000:0.0:1746129227.615451:0:7122:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 966 00010000:00010000:3.0:1746129227.617482:0:3282:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff880094da3a00/0x48868a4e43904ec6 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xbccb0c83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7122 initiator: MDT0 00010000:00010000:3.0:1746129227.617493:0:3282:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880094da3a00/0x48868a4e43904ec6 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xbccb0c83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7122 initiator: MDT0 00010000:00010000:3.0:1746129227.617498:0:3282:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880094da3a00/0x48868a4e43904ec6 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xbccb0c83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7122 initiator: MDT0 00010000:00010000:3.0:1746129227.617503:0:3282:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880094da3a00 already unused, calling callback (ffffffffa1371690) 00010000:00010000:3.0:1746129227.617507:0:3282:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880094da3a00/0x48868a4e43904ec6 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xbccb0c83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7122 initiator: MDT0 00010000:00010000:3.0:1746129227.617512:0:3282:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880094da3a00/0x48868a4e43904ec6 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xbccb0c83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7122 initiator: MDT0 00010000:00010000:3.0:1746129227.617528:0:3282:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xbccb0c83 (ffff880093907100) 00010000:00010000:3.0:1746129227.617531:0:3282:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746129227.617534:0:3282:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880094da3a00/0x48868a4e43904ec6 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xbccb0c83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7122 initiator: MDT0 00010000:00010000:3.0:1746129227.617548:0:3282:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880094da3a00/0x48868a4e43904ec6 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xbccb0c83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7122 initiator: MDT0 00000100:00100000:3.0:1746129227.618472:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129227.618527:0:7122:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949046481664 00000100:00100000:0.0:1746129227.618534:0:7122:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949046481664 00000100:00100000:0.0:1746129227.618570:0:7122:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 967 00000100:00100000:0.0:1746129227.618577:0:7122:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135713100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f39d518f-facf-4547-b099-7a2592d93d98+16:14438:x1830949046481664:12345-192.168.204.31@tcp:101:lfs.0 00010000:00010000:0.0:1746129227.618597:0:7122:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129227.618611:0:7122:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009391fa00/0x48868a4e43904edb lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf337d46 expref: -99 pid: 7122 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129227.618686:0:7122:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88009391f600/0x48868a4e43904ee2 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x22:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7122 initiator: MDT0 00010000:00010000:0.0:1746129227.618697:0:7122:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009391ee00/0x48868a4e43904ecd lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x22:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf337d3f expref: 17 pid: 7122 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129227.618704:0:7122:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009391f600/0x48868a4e43904ee2 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x22:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7122 initiator: MDT0 00010000:00010000:0.0:1746129227.618734:0:7122:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009391ee00/0x48868a4e43904ecd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x22:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf337d3f expref: 17 pid: 7122 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129227.618744:0:7122:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009391ee00/0x48868a4e43904ecd lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x22:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf337d3f expref: 17 pid: 7122 timeout: 273 lvb_type: 0 00000100:00100000:0.0:1746129227.618753:0:7122:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ba3a300 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:7122:1830949051533824:192.168.204.31@tcp:104: 00000100:00100000:0.0:1746129227.618814:0:7122:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800931a8000 going to sleep for 11 seconds 00000100:00100000:0.0:1746129227.629225:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129227.630204:0:7122:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ba3a300 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:7122:1830949051533824:192.168.204.31@tcp:104: 00010000:00010000:0.0:1746129227.630222:0:7122:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009391f600/0x48868a4e43904ee2 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x22:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7122 initiator: MDT0 00000100:00100000:2.0:1746129227.630446:0:7108:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949046481792 00000100:00100000:2.0:1746129227.630452:0:7108:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949046481792 00010000:00010000:2.0:1746129227.630479:0:7108:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009391ee00/0x48868a4e43904ecd lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x22:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf337d3f expref: 18 pid: 7122 timeout: 273 lvb_type: 0 00000100:00100000:2.0:1746129227.630561:0:7108:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 200 00000100:00100000:2.0:1746129227.630568:0:7108:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ba3a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f39d518f-facf-4547-b099-7a2592d93d98+18:1962:x1830949046481792:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746129227.630580:0:7108:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746129227.630590:0:7108:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009391ee00/0x48868a4e43904ecd lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x22:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf337d3f expref: 18 pid: 7122 timeout: 273 lvb_type: 0 00010000:00010000:2.0:1746129227.630599:0:7108:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009391ee00/0x48868a4e43904ecd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x22:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf337d3f expref: 18 pid: 7122 timeout: 273 lvb_type: 0 00010000:00010000:2.0:1746129227.630616:0:7108:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009391ee00/0x48868a4e43904ecd lrc: 0/0,0 mode: --/PR res: [0x200000401:0x22:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf337d3f expref: 18 pid: 7122 timeout: 273 lvb_type: 0 00010000:00010000:2.0:1746129227.630626:0:7108:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x22:0x0].0x0 (ffff880093907d00) 00010000:00010000:2.0:1746129227.630630:0:7108:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88009391f600/0x48868a4e43904ee2 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x22:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7122 initiator: MDT0 00010000:00010000:2.0:1746129227.630637:0:7108:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009391f600/0x48868a4e43904ee2 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x22:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 7122 initiator: MDT0 00010000:00010000:2.0:1746129227.630642:0:7108:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009391f600/0x48868a4e43904ee2 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x22:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 7122 initiator: MDT0 00010000:00010000:2.0:1746129227.630658:0:7108:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1746129227.630707:0:7122:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009391f600/0x48868a4e43904ee2 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x22:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7122 initiator: MDT0 00010000:00010000:0.0:1746129227.630712:0:7122:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009391f600/0x48868a4e43904ee2 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x22:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7122 initiator: MDT0 00000004:00200000:0.0:1746129227.630727:0:7122:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000401:0x22:0x0]: returning size 0 00000004:00080000:0.0:1746129227.630980:0:7122:0:(osp_object.c:1637:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x1e:0x0], index 0: 0 00000004:00080000:0.0:1746129227.630989:0:7122:0:(osp_object.c:1637:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x1f:0x0], index 1: 0 00010000:00010000:0.0:1746129227.631108:0:7122:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88009391f600/0x48868a4e43904ee2 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x22:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7122 initiator: MDT0 00010000:00010000:0.0:1746129227.631115:0:7122:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009391f600/0x48868a4e43904ee2 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x22:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7122 initiator: MDT0 00010000:00010000:0.0:1746129227.631120:0:7122:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009391f600/0x48868a4e43904ee2 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x22:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7122 initiator: MDT0 00010000:00010000:0.0:1746129227.631130:0:7122:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009391f600 already unused, calling callback (ffffffffa1371690) 00010000:00010000:0.0:1746129227.631133:0:7122:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009391f600/0x48868a4e43904ee2 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x22:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7122 initiator: MDT0 00010000:00010000:0.0:1746129227.631139:0:7122:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009391f600/0x48868a4e43904ee2 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x22:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7122 initiator: MDT0 00010000:00010000:0.0:1746129227.631146:0:7122:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x22:0x0].0x0 (ffff880093907d00) 00010000:00010000:0.0:1746129227.631148:0:7122:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1746129227.631151:0:7122:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009391f600/0x48868a4e43904ee2 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x22:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7122 initiator: MDT0 00010000:00010000:0.0:1746129227.631155:0:7122:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009391f600/0x48868a4e43904ee2 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x22:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7122 initiator: MDT0 00010000:00010000:0.0:1746129227.631190:0:7122:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009391fa00/0x48868a4e43904edb lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf337d46 expref: 18 pid: 7122 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129227.631196:0:7122:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009391fa00/0x48868a4e43904edb lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf337d46 expref: 18 pid: 7122 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129227.631204:0:7122:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009391fa00, rc 0) 00000100:00100000:2.0:1746129227.631399:0:7108:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ba3a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f39d518f-facf-4547-b099-7a2592d93d98+17:1962:x1830949046481792:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 829us (2176us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129227.631405:0:7108:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 200 00000100:00100000:0.0:1746129227.631509:0:7122:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135713100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f39d518f-facf-4547-b099-7a2592d93d98+16:14438:x1830949046481664:12345-192.168.204.31@tcp:101:lfs.0 Request processed in 12932us (13042us total) trans 4294967662 rc 301/301 00000100:00100000:0.0:1746129227.631515:0:7122:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 967 00000100:00100000:3.0:1746129227.633724:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129227.634308:0:7124:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949046482048 00000100:00100000:0.0:1746129227.634315:0:7124:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949046482048 00000100:00100000:0.0:1746129227.634345:0:7124:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 230 00000100:00100000:0.0:1746129227.634351:0:7124:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135711180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f39d518f-facf-4547-b099-7a2592d93d98+16:14438:x1830949046482048:12345-192.168.204.31@tcp:35:lfs.0 00000100:00100000:0.0:1746129227.634559:0:7124:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135711180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f39d518f-facf-4547-b099-7a2592d93d98+17:14438:x1830949046482048:12345-192.168.204.31@tcp:35:lfs.0 Request processed in 207us (840us total) trans 4294967663 rc 0/0 00000100:00100000:0.0:1746129227.634564:0:7124:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 230 00000100:00100000:0.0:1746129227.636584:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129227.636641:0:7124:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949046482304 00000100:00100000:2.0:1746129227.636647:0:7124:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949046482304 00000100:00100000:2.0:1746129227.636683:0:7124:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 231 00000100:00100000:2.0:1746129227.636689:0:7124:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ba3a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f39d518f-facf-4547-b099-7a2592d93d98+17:14438:x1830949046482304:12345-192.168.204.31@tcp:35:lfs.0 00000100:00100000:2.0:1746129227.636811:0:7124:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ba3a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f39d518f-facf-4547-b099-7a2592d93d98+18:14438:x1830949046482304:12345-192.168.204.31@tcp:35:lfs.0 Request processed in 122us (231us total) trans 4294967664 rc 0/0 00000100:00100000:2.0:1746129227.636817:0:7124:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 231 00000100:00100000:0.0:1746129227.649903:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129227.649948:0:7122:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949046482432 00000100:00100000:1.0:1746129227.649955:0:7122:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949046482432 00000100:00100000:1.0:1746129227.650000:0:7122:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 968 00000100:00100000:1.0:1746129227.650007:0:7122:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ba3aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f39d518f-facf-4547-b099-7a2592d93d98+18:14439:x1830949046482432:12345-192.168.204.31@tcp:101:cp.0 00010000:00010000:1.0:1746129227.650032:0:7122:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129227.650045:0:7122:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880130a0de00/0x48868a4e43904ef0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf337d4d expref: -99 pid: 7122 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129227.650107:0:7122:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880130a0d600/0x48868a4e43904ef7 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7122 initiator: MDT0 00010000:00010000:1.0:1746129227.650118:0:7122:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880130a0d600/0x48868a4e43904ef7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7122 initiator: MDT0 00010000:00010000:1.0:1746129227.650127:0:7122:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880130a0d600/0x48868a4e43904ef7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7122 initiator: MDT0 00000004:00200000:1.0:1746129227.650172:0:7122:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 11776 00000004:00200000:1.0:1746129227.650175:0:7122:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 6 stripe count 1 MDT count 1 00000004:00010000:1.0:1746129227.650189:0:7122:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff880130a0d600/0x48868a4e43904ef7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7122 initiator: MDT0 00010000:00010000:1.0:1746129227.650206:0:7122:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880130a0de00/0x48868a4e43904ef0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf337d4d expref: 20 pid: 7122 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129227.650218:0:7122:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880130a0d600/0x48868a4e43904ef7 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf337d4d expref: 19 pid: 7122 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129227.650223:0:7122:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff880094409100) 00010000:00010000:1.0:1746129227.650225:0:7122:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1746129227.650228:0:7122:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880130a0d600, rc 0) 00000100:00100000:1.0:1746129227.650279:0:7122:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ba3aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f39d518f-facf-4547-b099-7a2592d93d98+19:14439:x1830949046482432:12345-192.168.204.31@tcp:101:cp.0 Request processed in 272us (382us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129227.650285:0:7122:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 968 00000100:00100000:0.0:1746129227.653180:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129227.653255:0:7122:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949046482560 00000100:00100000:1.0:1746129227.653266:0:7122:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949046482560 00000100:00100000:1.0:1746129227.653297:0:7122:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 969 00000100:00100000:1.0:1746129227.653304:0:7122:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ba3b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f39d518f-facf-4547-b099-7a2592d93d98+19:14439:x1830949046482560:12345-192.168.204.31@tcp:101:cp.0 00010000:00010000:1.0:1746129227.653317:0:7122:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129227.653329:0:7122:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880130a0c000/0x48868a4e43904efe lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf337d54 expref: -99 pid: 7122 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129227.653774:0:7122:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880130a0da00/0x48868a4e43904f05 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7122 initiator: MDT0 00010000:00010000:1.0:1746129227.653785:0:7122:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880130a0da00/0x48868a4e43904f05 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7122 initiator: MDT0 00010000:00010000:1.0:1746129227.653793:0:7122:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880130a0da00/0x48868a4e43904f05 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7122 initiator: MDT0 00010000:00010000:1.0:1746129227.653802:0:7122:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880130a0d200/0x48868a4e43904f0c lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xbccb0c83 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7122 initiator: MDT0 00010000:00010000:1.0:1746129227.653807:0:7122:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880130a0d200/0x48868a4e43904f0c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xbccb0c83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7122 initiator: MDT0 00010000:00010000:1.0:1746129227.653811:0:7122:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880130a0d200/0x48868a4e43904f0c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xbccb0c83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7122 initiator: MDT0 00010000:00010000:1.0:1746129227.653917:0:7122:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009bba3000/0x48868a4e43904f13 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x22:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7122 initiator: MDT0 00010000:00010000:1.0:1746129227.653923:0:7122:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009bba3000/0x48868a4e43904f13 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x22:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7122 initiator: MDT0 00010000:00010000:1.0:1746129227.653928:0:7122:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009bba3000/0x48868a4e43904f13 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x22:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7122 initiator: MDT0 00000004:00200000:1.0:1746129227.653957:0:7122:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000401:0x22:0x0]: returning size 0 00000004:00200000:1.0:1746129227.653961:0:7122:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1746129227.653971:0:7122:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88009bba3000/0x48868a4e43904f13 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x22:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7122 initiator: MDT0 00010000:00010000:1.0:1746129227.653978:0:7122:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009bba3000/0x48868a4e43904f13 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x22:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7122 initiator: MDT0 00010000:00010000:1.0:1746129227.653983:0:7122:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880130a0da00/0x48868a4e43904f05 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7122 initiator: MDT0 00010000:00010000:1.0:1746129227.653987:0:7122:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880130a0da00/0x48868a4e43904f05 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7122 initiator: MDT0 00010000:00010000:1.0:1746129227.653992:0:7122:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880130a0da00/0x48868a4e43904f05 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7122 initiator: MDT0 00010000:00010000:1.0:1746129227.653995:0:7122:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880130a0da00 already unused, calling callback (ffffffffa1371690) 00010000:00010000:1.0:1746129227.653998:0:7122:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880130a0da00/0x48868a4e43904f05 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7122 initiator: MDT0 00010000:00010000:1.0:1746129227.654002:0:7122:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880130a0da00/0x48868a4e43904f05 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7122 initiator: MDT0 00010000:00010000:1.0:1746129227.654010:0:7122:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff880094409100) 00010000:00010000:1.0:1746129227.654012:0:7122:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746129227.654015:0:7122:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880130a0da00/0x48868a4e43904f05 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7122 initiator: MDT0 00010000:00010000:1.0:1746129227.654018:0:7122:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880130a0da00/0x48868a4e43904f05 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7122 initiator: MDT0 00010000:00010000:1.0:1746129227.654025:0:7122:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880130a0d200/0x48868a4e43904f0c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xbccb0c83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7122 initiator: MDT0 00010000:00010000:1.0:1746129227.654033:0:7122:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880130a0d200/0x48868a4e43904f0c lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xbccb0c83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7122 initiator: MDT0 00010000:00010000:1.0:1746129227.654036:0:7122:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880130a0d200/0x48868a4e43904f0c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xbccb0c83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7122 initiator: MDT0 00010000:00010000:1.0:1746129227.654039:0:7122:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880130a0d200 already unused, calling callback (ffffffffa1371690) 00010000:00010000:1.0:1746129227.654041:0:7122:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880130a0d200/0x48868a4e43904f0c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xbccb0c83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7122 initiator: MDT0 00010000:00010000:1.0:1746129227.654045:0:7122:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880130a0d200/0x48868a4e43904f0c lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xbccb0c83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7122 initiator: MDT0 00010000:00010000:1.0:1746129227.654050:0:7122:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xbccb0c83 (ffff880094409600) 00010000:00010000:1.0:1746129227.654052:0:7122:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746129227.654053:0:7122:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880130a0d200/0x48868a4e43904f0c lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xbccb0c83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7122 initiator: MDT0 00010000:00010000:1.0:1746129227.654058:0:7122:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880130a0d200/0x48868a4e43904f0c lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xbccb0c83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7122 initiator: MDT0 00010000:00010000:1.0:1746129227.654092:0:7122:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880130a0c000/0x48868a4e43904efe lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf337d54 expref: 21 pid: 7122 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129227.654101:0:7122:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009bba3000/0x48868a4e43904f13 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x22:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf337d54 expref: 20 pid: 7122 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129227.654106:0:7122:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x22:0x0].0x0 (ffff880094409000) 00010000:00010000:1.0:1746129227.654108:0:7122:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1746129227.654110:0:7122:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009bba3000, rc 0) 00000100:00100000:1.0:1746129227.654150:0:7122:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ba3b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f39d518f-facf-4547-b099-7a2592d93d98+20:14439:x1830949046482560:12345-192.168.204.31@tcp:101:cp.0 Request processed in 846us (976us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129227.654159:0:7122:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 969 00000100:00100000:0.0:1746129227.656673:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129227.656727:0:8435:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949046482688 00000100:00100000:1.0:1746129227.656734:0:8435:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949046482688 00000100:00100000:1.0:1746129227.656773:0:8435:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 226 00000100:00100000:1.0:1746129227.656780:0:8435:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ba39500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f39d518f-facf-4547-b099-7a2592d93d98+17:1962:x1830949046482688:12345-192.168.204.31@tcp:101:cp.0 00010000:00010000:1.0:1746129227.656791:0:8435:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129227.656804:0:8435:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009bba2c00/0x48868a4e43904f1a lrc: 2/0,0 mode: --/PR res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf337d5b expref: -99 pid: 8435 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1746129227.656820:0:8435:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x1e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1746129227.656834:0:8435:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129227.656836:0:8435:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129227.656841:0:8435:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009bba2c00/0x48868a4e43904f1a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf337d5b expref: 18 pid: 8435 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129227.656868:0:8435:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009bba2c00/0x48868a4e43904f1a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf337d5b expref: 18 pid: 8435 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129227.656876:0:8435:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009bba2c00, rc 0) 00000100:00100000:1.0:1746129227.656907:0:8435:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ba39500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f39d518f-facf-4547-b099-7a2592d93d98+18:1962:x1830949046482688:12345-192.168.204.31@tcp:101:cp.0 Request processed in 128us (239us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129227.656912:0:8435:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 226 00000100:00100000:0.0:1746129227.659710:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129227.659759:0:7122:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949046482944 00000100:00100000:1.0:1746129227.659765:0:7122:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949046482944 00000100:00100000:1.0:1746129227.659793:0:7122:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 970 00000100:00100000:1.0:1746129227.659799:0:7122:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ba3bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f39d518f-facf-4547-b099-7a2592d93d98+20:14439:x1830949046482944:12345-192.168.204.31@tcp:101:cp.0 00010000:00010000:1.0:1746129227.659819:0:7122:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129227.659832:0:7122:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009bba2e00/0x48868a4e43904f21 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf337d62 expref: -99 pid: 7122 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129227.659921:0:7122:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009bba2200/0x48868a4e43904f28 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x22:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7122 initiator: MDT0 00010000:00010000:1.0:1746129227.659931:0:7122:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009bba3000/0x48868a4e43904f13 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x22:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf337d54 expref: 21 pid: 7122 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129227.659937:0:7122:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009bba2200/0x48868a4e43904f28 lrc: 4/0,1 mode: --/CW res: [0x200000401:0x22:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7122 initiator: MDT0 00010000:00010000:1.0:1746129227.659961:0:7122:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009bba3000/0x48868a4e43904f13 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x22:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf337d54 expref: 21 pid: 7122 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129227.660641:0:7122:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009bba3000/0x48868a4e43904f13 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x22:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf337d54 expref: 21 pid: 7122 timeout: 273 lvb_type: 0 00000100:00100000:1.0:1746129227.660653:0:7122:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093154000 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:7122:1830949051533952:192.168.204.31@tcp:104: 00000100:00100000:1.0:1746129227.660744:0:7122:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c3c1000 going to sleep for 11 seconds 00000100:00100000:0.0:1746129227.663019:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129227.663082:0:7108:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949046483072 00000100:00100000:3.0:1746129227.663089:0:7108:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949046483072 00000100:00100000:1.0:1746129227.663115:0:7122:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093154000 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:7122:1830949051533952:192.168.204.31@tcp:104: 00010000:00010000:3.0:1746129227.663116:0:7108:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009bba3000/0x48868a4e43904f13 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x22:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf337d54 expref: 22 pid: 7122 timeout: 273 lvb_type: 0 00010000:00010000:1.0:1746129227.663132:0:7122:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009bba2200/0x48868a4e43904f28 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x22:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7122 initiator: MDT0 00000100:00100000:3.0:1746129227.663140:0:7108:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 201 00000100:00100000:3.0:1746129227.663146:0:7108:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ba3b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f39d518f-facf-4547-b099-7a2592d93d98+22:1961:x1830949046483072:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746129227.663155:0:7108:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746129227.663160:0:7108:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009bba3000/0x48868a4e43904f13 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x22:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf337d54 expref: 22 pid: 7122 timeout: 273 lvb_type: 0 00010000:00010000:3.0:1746129227.663169:0:7108:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009bba3000/0x48868a4e43904f13 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x22:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf337d54 expref: 22 pid: 7122 timeout: 273 lvb_type: 0 00010000:00010000:3.0:1746129227.663187:0:7108:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009bba3000/0x48868a4e43904f13 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x22:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf337d54 expref: 22 pid: 7122 timeout: 273 lvb_type: 0 00010000:00010000:3.0:1746129227.663198:0:7108:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x22:0x0].0x0 (ffff880094409000) 00010000:00010000:3.0:1746129227.663201:0:7108:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009bba2200/0x48868a4e43904f28 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x22:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7122 initiator: MDT0 00010000:00010000:3.0:1746129227.663208:0:7108:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009bba2200/0x48868a4e43904f28 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x22:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 7122 initiator: MDT0 00010000:00010000:3.0:1746129227.663224:0:7108:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009bba2200/0x48868a4e43904f28 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x22:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 7122 initiator: MDT0 00010000:00010000:3.0:1746129227.663252:0:7108:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746129227.663287:0:7108:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ba3b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f39d518f-facf-4547-b099-7a2592d93d98+21:1961:x1830949046483072:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 141us (273us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129227.663293:0:7108:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 201 00010000:00010000:1.0:1746129227.663296:0:7122:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009bba2200/0x48868a4e43904f28 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x22:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7122 initiator: MDT0 00010000:00010000:1.0:1746129227.663302:0:7122:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009bba2200/0x48868a4e43904f28 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x22:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7122 initiator: MDT0 00000004:00200000:1.0:1746129227.663323:0:7122:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000401:0x22:0x0]: returning size 0 00010000:00010000:1.0:1746129227.663605:0:7122:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009bba2e00/0x48868a4e43904f21 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf337d62 expref: 22 pid: 7122 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129227.663811:0:7122:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009bba2200/0x48868a4e43904f28 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x22:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf337d62 expref: 21 pid: 7122 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129227.663817:0:7122:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x22:0x0].0x0 (ffff880094409000) 00010000:00010000:1.0:1746129227.663819:0:7122:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1746129227.663821:0:7122:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009bba2200, rc 0) 00000100:00100000:1.0:1746129227.663843:0:7122:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ba3bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f39d518f-facf-4547-b099-7a2592d93d98+21:14439:x1830949046482944:12345-192.168.204.31@tcp:101:cp.0 Request processed in 4044us (4139us total) trans 4294967665 rc 0/0 00000100:00100000:1.0:1746129227.663866:0:7122:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 970 00000100:00100000:0.0:1746129227.667234:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129227.667532:0:7122:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949046483328 00000100:00100000:1.0:1746129227.667539:0:7122:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949046483328 00000100:00100000:1.0:1746129227.667581:0:7122:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 971 00000100:00100000:1.0:1746129227.667587:0:7122:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ba3b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f39d518f-facf-4547-b099-7a2592d93d98+21:14439:x1830949046483328:12345-192.168.204.31@tcp:36:cp.0 00010000:00010000:1.0:1746129227.667789:0:7122:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880095329200/0x48868a4e43904f36 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x22:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7122 initiator: MDT0 00010000:00010000:1.0:1746129227.667802:0:7122:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880095329200/0x48868a4e43904f36 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x22:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7122 initiator: MDT0 00010000:00010000:1.0:1746129227.667811:0:7122:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880095329200/0x48868a4e43904f36 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x22:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7122 initiator: MDT0 00000001:00080000:1.0:1746129227.667864:0:7122:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 4294967666 00000004:00010000:1.0:1746129227.667883:0:7122:0:(mdt_handler.c:4446:mdt_save_lock()) ### save lock request ffff88012ba3b100 reply state ffff88009b5d4000 transno 4294967667 ns: mdt-lustre-MDT0000_UUID lock: ffff880095329200/0x48868a4e43904f36 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x22:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7122 initiator: MDT0 00000100:00100000:1.0:1746129227.667895:0:7122:0:(service.c:173:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1746129227.668643:0:7122:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ba3b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f39d518f-facf-4547-b099-7a2592d93d98+24:14439:x1830949046483328:12345-192.168.204.31@tcp:36:cp.0 Request processed in 1054us (1413us total) trans 4294967667 rc 0/0 00000100:00100000:1.0:1746129227.668653:0:7122:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 971 00000020:00080000:1.0:1746129227.668657:0:7122:0:(tgt_main.c:782:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1746129227.671244:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00010000:00010000:3.0:1746129227.671773:0:3283:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff880095329200/0x48868a4e43904f36 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x22:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7122 initiator: MDT0 00010000:00010000:3.0:1746129227.671782:0:3283:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880095329200/0x48868a4e43904f36 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x22:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7122 initiator: MDT0 00010000:00010000:3.0:1746129227.671788:0:3283:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880095329200/0x48868a4e43904f36 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x22:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7122 initiator: MDT0 00010000:00010000:3.0:1746129227.671792:0:3283:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880095329200 already unused, calling callback (ffffffffa1371690) 00010000:00010000:3.0:1746129227.671796:0:3283:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880095329200/0x48868a4e43904f36 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x22:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7122 initiator: MDT0 00010000:00010000:3.0:1746129227.671801:0:3283:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880095329200/0x48868a4e43904f36 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x22:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7122 initiator: MDT0 00010000:00010000:3.0:1746129227.671814:0:3283:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x22:0x0].0x0 (ffff880094409000) 00010000:00010000:3.0:1746129227.671817:0:3283:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746129227.671820:0:3283:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880095329200/0x48868a4e43904f36 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x22:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7122 initiator: MDT0 00010000:00010000:3.0:1746129227.671829:0:3283:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880095329200/0x48868a4e43904f36 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x22:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7122 initiator: MDT0 00000100:00100000:0.0:1746129227.671882:0:7122:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949046483456 00000100:00100000:0.0:1746129227.671890:0:7122:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949046483456 00000100:00100000:0.0:1746129227.671933:0:7122:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 972 00000100:00100000:0.0:1746129227.671940:0:7122:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b18b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f39d518f-facf-4547-b099-7a2592d93d98+23:14439:x1830949046483456:12345-192.168.204.31@tcp:101:cp.0 00010000:00010000:0.0:1746129227.671955:0:7122:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129227.671966:0:7122:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009391fc00/0x48868a4e43904f3d lrc: 2/0,0 mode: --/CR res: [0x200000401:0x22:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf337d69 expref: -99 pid: 7122 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129227.672005:0:7122:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009391fc00/0x48868a4e43904f3d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x22:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf337d69 expref: 24 pid: 7122 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129227.672014:0:7122:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009391fc00/0x48868a4e43904f3d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x22:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf337d69 expref: 24 pid: 7122 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129227.672026:0:7122:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x22:0x0].0x0 (ffff880094409000) 00010000:00010000:0.0:1746129227.672028:0:7122:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1746129227.672030:0:7122:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009391fc00, rc 0) 00000100:00100000:0.0:1746129227.672361:0:7122:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b18b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f39d518f-facf-4547-b099-7a2592d93d98+24:14439:x1830949046483456:12345-192.168.204.31@tcp:101:cp.0 Request processed in 420us (1123us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129227.672367:0:7122:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 972 00000100:00100000:1.0:1746129227.675179:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129227.675202:0:7122:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949046483712 00000100:00100000:1.0:1746129227.675208:0:7122:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949046483712 00000100:00100000:1.0:1746129227.675236:0:7122:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 973 00000100:00100000:1.0:1746129227.675242:0:7122:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093154000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f39d518f-facf-4547-b099-7a2592d93d98+24:14439:x1830949046483712:12345-192.168.204.31@tcp:101:cp.0 00010000:00010000:1.0:1746129227.675254:0:7122:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129227.675257:0:7122:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1746129227.675275:0:7122:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009391fc00/0x48868a4e43904f3d lrc: 0/0,0 mode: --/CR res: [0x200000401:0x22:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf337d69 expref: 24 pid: 7122 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129227.675286:0:7122:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x22:0x0].0x0 (ffff880094409000) 00010000:00010000:1.0:1746129227.675289:0:7122:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746129227.675296:0:7122:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880095329a00/0x48868a4e43904f44 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x22:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf337d70 expref: -99 pid: 7122 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129227.675328:0:7122:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff880095329400/0x48868a4e43904f4b lrc: 3/0,1 mode: --/EX res: [0x200000401:0x22:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7122 initiator: MDT0 00010000:00010000:1.0:1746129227.675336:0:7122:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880095329400/0x48868a4e43904f4b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x22:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7122 initiator: MDT0 00010000:00010000:1.0:1746129227.675343:0:7122:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880095329400/0x48868a4e43904f4b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x22:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7122 initiator: MDT0 00000040:00080000:1.0:1746129227.675657:0:7122:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x3:0x0].11, 88 off9136 00000004:00080000:1.0:1746129227.675664:0:7122:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 173733816040ns, next at 0ns, rc = 0 00000040:00080000:1.0:1746129227.675702:0:7122:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x6:0x0].12, 88 off9176 00000004:00080000:1.0:1746129227.675707:0:7122:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 173733858948ns, next at 155720060341ns, rc = 0 00000001:00080000:0.0:1746129227.710408:0:7171:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967663 is committed 00000001:00080000:0.0:1746129227.710425:0:7171:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967668 is committed 00000004:00080000:0.0:1746129227.710429:0:7171:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 14 committed 00000004:00080000:0.0:1746129227.710435:0:7171:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 11 committed 00010000:00010000:1.0:1746129227.710495:0:7122:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880095329400/0x48868a4e43904f4b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x22:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf337d70 expref: 18 pid: 7122 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129227.710506:0:7122:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x22:0x0].0x0 (ffff880094409000) 00010000:00010000:1.0:1746129227.710509:0:7122:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:1.0:1746129227.710523:0:7122:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880095329a00/0x48868a4e43904f44 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x22:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf337d70 expref: 18 pid: 7122 timeout: 0 lvb_type: 3 00010000:00010000:1.0:1746129227.710535:0:7122:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880095329400/0x48868a4e43904f4b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x22:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf337d70 expref: 17 pid: 7122 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746129227.710548:0:3298:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ba38e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3298:1830949051534080:0@lo:2:osp-syn-0-0.0 00010000:00010000:1.0:1746129227.710559:0:7122:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x22:0x0].0x0 (ffff880094409000) 00010000:00010000:1.0:1746129227.710561:0:7122:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:1.0:1746129227.710563:0:7122:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095329400, rc 0) 00000100:00100000:1.0:1746129227.710607:0:7122:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093154000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f39d518f-facf-4547-b099-7a2592d93d98+17:14439:x1830949046483712:12345-192.168.204.31@tcp:101:cp.0 Request processed in 35363us (35430us total) trans 4294967668 rc 0/0 00000100:00100000:1.0:1746129227.710615:0:7122:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 973 00000100:00100000:0.0:1746129227.710683:0:3298:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746129227.710953:0:3298:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1746129227.710959:0:3298:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135710700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3298:1830949051534208:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746129227.710977:0:3298:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746129227.711189:0:8435:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051534080 00000100:00100000:1.0:1746129227.711195:0:8435:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051534080 00000100:00100000:0.0:1746129227.711199:0:8436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051534208 00000100:00100000:0.0:1746129227.711203:0:8436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051534208 00000100:00100000:1.0:1746129227.711228:0:8435:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 227 00000100:00100000:1.0:1746129227.711233:0:8435:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095242a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3298:x1830949051534080:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1746129227.711429:0:8435:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x1e:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1746129227.711432:0:8435:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x1e:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:1.0:1746129227.711439:0:8435:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x1e:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1746129227.711440:0:8435:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x1e:0x0] updating lvb ctime from disk: 0 -> 0 00002000:00010000:1.0:1746129227.711442:0:8435:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x1e:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:1.0:1746129227.711466:0:8435:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095242a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3298:x1830949051534080:12345-0@lo:2:osp-syn-0-0.0 Request processed in 233us (783us total) trans 4294967347 rc 0/0 00000100:00100000:1.0:1746129227.711472:0:8435:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 227 00000100:00100000:1.0:1746129227.711482:0:8435:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 228 00000100:00100000:1.0:1746129227.711486:0:8435:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095240e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3298:x1830949051534208:12345-0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746129227.711541:0:3298:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012ba38e00/2, rc 0, transno 4294967347 00000100:00100000:0.0:1746129227.711546:0:3298:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ba38e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3298:1830949051534080:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746129227.714094:0:8435:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095240e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3298:x1830949051534208:12345-0@lo:2:osp-syn-1-0.0 Request processed in 2602us (3110us total) trans 4294967340 rc 0/0 00000100:00100000:1.0:1746129227.714102:0:8435:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 228 00000100:00080000:2.0:1746129227.714542:0:7118:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1746129227.714547:0:7118:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1746129227.720166:0:3298:0:(client.c:2927:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967339 gen 2 00000004:00080000:2.0:1746129227.720176:0:3298:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880135712a00, transno 4294967332 00000004:00080000:2.0:1746129227.720194:0:3298:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012b189c00, transno 4294967335 00000004:00080000:2.0:1746129227.720196:0:3298:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012b189500, transno 4294967336 00000004:00080000:2.0:1746129227.720198:0:3298:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012b188700, transno 4294967338 00000004:00080000:2.0:1746129227.720199:0:3298:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012b189880, transno 4294967339 00000100:00100000:2.0:1746129227.720205:0:3298:0:(client.c:2971:ptlrpc_free_committed()) @@@ stopping search req@ffff880135710700 x1830949051534208/t4294967340(4294967340) o2->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 440/432 e 0 to 0 dl 1746129243 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-1-0.0' uid:0 gid:0 00000004:00080000:2.0:1746129227.720215:0:3298:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880135710700/2, rc 0, transno 4294967340 00000100:00100000:2.0:1746129227.720218:0:3298:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135710700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3298:1830949051534208:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1746129227.721470:0:10588:0:(osp_sync.c:1188:osp_sync_process_committed()) lustre-OST0001-osc-MDT0000: 0 changes, 1 in progress, 0 in flight, 5 done 00000100:00100000:1.0:1746129227.724426:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129227.724562:0:8435:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949046483840 00000100:00100000:0.0:1746129227.724569:0:8435:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949046483840 00000100:00100000:0.0:1746129227.724663:0:8435:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 229 00000100:00100000:0.0:1746129227.724670:0:8435:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093154e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f39d518f-facf-4547-b099-7a2592d93d98+18:14439:x1830949046483840:12345-192.168.204.31@tcp:101:cp.0 00010000:00010000:0.0:1746129227.724684:0:8435:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129227.724698:0:8435:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009bc6dc00/0x48868a4e43904f52 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf337d77 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129227.724721:0:8435:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009bba2c00/0x48868a4e43904f1a lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x1e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf337d5b expref: 19 pid: 8435 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129227.724739:0:8435:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129227.724740:0:8435:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129227.724744:0:8435:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009bc6dc00/0x48868a4e43904f52 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf337d77 expref: 19 pid: 8435 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129227.724767:0:8435:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009bba2c00/0x48868a4e43904f1a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf337d5b expref: 19 pid: 8435 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129227.724777:0:8435:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009bba2c00/0x48868a4e43904f1a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x1e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf337d5b expref: 19 pid: 8435 timeout: 273 lvb_type: 1 00000100:00100000:0.0:1746129227.724787:0:8435:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009468fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8435:1830949051534336:192.168.204.31@tcp:104: 00000100:00100000:0.0:1746129227.724866:0:8435:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800931a8b40 going to sleep for 11 seconds 00000100:00100000:0.0:1746129227.732360:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129227.732546:0:7109:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949046483968 00000100:00100000:3.0:1746129227.732553:0:7109:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949046483968 00010000:00010000:3.0:1746129227.732579:0:7109:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009bba2c00/0x48868a4e43904f1a lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x1e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf337d5b expref: 20 pid: 8435 timeout: 273 lvb_type: 1 00000100:00100000:3.0:1746129227.732612:0:7109:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 202 00000100:00100000:3.0:1746129227.732618:0:7109:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013680cc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f39d518f-facf-4547-b099-7a2592d93d98+20:1961:x1830949046483968:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746129227.732628:0:7109:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746129227.732632:0:7109:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009bba2c00/0x48868a4e43904f1a lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x1e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf337d5b expref: 20 pid: 8435 timeout: 273 lvb_type: 1 00010000:00010000:3.0:1746129227.732643:0:7109:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009bba2c00/0x48868a4e43904f1a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x1e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf337d5b expref: 20 pid: 8435 timeout: 273 lvb_type: 1 00010000:00010000:3.0:1746129227.732661:0:7109:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129227.732663:0:7109:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129227.732668:0:7109:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009bc6dc00/0x48868a4e43904f52 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50080080000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf337d77 expref: 20 pid: 8435 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129227.732675:0:7109:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009bc6dc00/0x48868a4e43904f52 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50080080000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf337d77 expref: 20 pid: 8435 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129227.732701:0:7109:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009bc6dc00/0x48868a4e43904f52 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf337d77 expref: 20 pid: 8435 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746129227.732712:0:7109:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135712a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7109:1830949051534464:192.168.204.31@tcp:105: 00000100:00100000:3.0:1746129227.732778:0:7109:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800acc7ef00 going to sleep for 11 seconds 00010000:00010000:2.0:1746129227.733230:0:8435:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009bba2c00/0x48868a4e43904f1a lrc: 0/0,0 mode: --/PR res: [0x240000400:0x1e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf337d5b expref: 20 pid: 8435 timeout: 273 lvb_type: 1 00000100:00100000:2.0:1746129227.733247:0:8435:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009468fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8435:1830949051534336:192.168.204.31@tcp:104: 00010000:00010000:2.0:1746129227.733264:0:8435:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009bc6dc00/0x48868a4e43904f52 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf337d77 expref: 19 pid: 8435 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129227.733273:0:8435:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009bc6dc00, rc 0) 00000100:00100000:2.0:1746129227.733306:0:8435:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093154e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f39d518f-facf-4547-b099-7a2592d93d98+19:14439:x1830949046483840:12345-192.168.204.31@tcp:101:cp.0 Request processed in 8636us (8886us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129227.733313:0:8435:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 229 00000100:00100000:0.0:1746129227.736221:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129227.736277:0:8441:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949046484096 00000100:00100000:2.0:1746129227.736282:0:8441:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949046484096 00000100:00100000:3.0:1746129227.736283:0:7109:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135712a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7109:1830949051534464:192.168.204.31@tcp:105: 00010000:00010000:3.0:1746129227.736299:0:7109:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00002000:00010000:2.0:1746129227.736307:0:8441:0:(ofd_dev.c:2706:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/30 (0->18446744073709551615) 00002000:00100000:2.0:1746129227.736315:0:8441:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009468c380 with x1830949046484096 ext(0->18446744073709551615) 00002000:00010000:2.0:1746129227.736323:0:8441:0:(ofd_dev.c:2711:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009468c380. 00000100:00100000:2.0:1746129227.736339:0:8441:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 25 00000100:00100000:2.0:1746129227.736349:0:8441:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009468c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:f39d518f-facf-4547-b099-7a2592d93d98+19:1961:x1830949046484096:12345-192.168.204.31@tcp:10:cp.0 00002000:00010000:2.0:1746129227.736535:0:8441:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x1e:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1746129227.736538:0:8441:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x1e:0x0] updating lvb mtime from disk: 0 -> 1746129228 00002000:00010000:2.0:1746129227.736540:0:8441:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x1e:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1746129227.736542:0:8441:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x1e:0x0] updating lvb ctime from disk: 0 -> 1746129228 00002000:00010000:2.0:1746129227.736544:0:8441:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x1e:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:2.0:1746129227.736563:0:8441:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009468c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:f39d518f-facf-4547-b099-7a2592d93d98+20:1961:x1830949046484096:12345-192.168.204.31@tcp:10:cp.0 Request processed in 214us (348us total) trans 4294967348 rc 0/0 00000100:00100000:3.0:1746129227.736566:0:7109:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013680cc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f39d518f-facf-4547-b099-7a2592d93d98+20:1961:x1830949046483968:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 3946us (4213us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129227.736569:0:8441:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 25 00002000:00010000:2.0:1746129227.736572:0:8441:0:(ofd_dev.c:2706:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/30 (0->18446744073709551615) 00000100:00100000:3.0:1746129227.736574:0:7109:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 202 00002000:00100000:2.0:1746129227.736574:0:8441:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009468c380 with x1830949046484096 ext(0->18446744073709551615) 00002000:00010000:2.0:1746129227.736577:0:8441:0:(ofd_dev.c:2711:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009468c380. 00000100:00100000:0.0:1746129227.738300:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129227.738528:0:7122:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949046484224 00000100:00100000:1.0:1746129227.738534:0:7122:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949046484224 00000100:00100000:2.0:1746129227.739200:0:12160:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 974 00000100:00100000:2.0:1746129227.739209:0:12160:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009468d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f39d518f-facf-4547-b099-7a2592d93d98+17:14439:x1830949046484224:12345-192.168.204.31@tcp:101:cp.0 00010000:00010000:2.0:1746129227.739226:0:12160:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129227.739239:0:12160:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880094bd2600/0x48868a4e43904f59 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x22:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf337d7e expref: -99 pid: 12160 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129227.739294:0:12160:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880094bd3800/0x48868a4e43904f60 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x22:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 12160 initiator: MDT0 00010000:00010000:2.0:1746129227.739304:0:12160:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009bba2200/0x48868a4e43904f28 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x22:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf337d62 expref: 18 pid: 7122 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129227.739320:0:12160:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880094bd3800/0x48868a4e43904f60 lrc: 4/1,0 mode: --/PR res: [0x200000401:0x22:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12160 initiator: MDT0 00010000:00010000:2.0:1746129227.739344:0:12160:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009bba2200/0x48868a4e43904f28 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x22:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf337d62 expref: 18 pid: 7122 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129227.739353:0:12160:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009bba2200/0x48868a4e43904f28 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x22:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf337d62 expref: 18 pid: 7122 timeout: 273 lvb_type: 0 00000100:00100000:2.0:1746129227.739363:0:12160:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b189c00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:12160:1830949051534592:192.168.204.31@tcp:104: 00000100:00100000:2.0:1746129227.740073:0:12160:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800aa452a80 going to sleep for 11 seconds 00000100:00100000:1.0:1746129227.742359:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129227.742407:0:7109:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949046484352 00000100:00100000:2.0:1746129227.742413:0:7109:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949046484352 00010000:00010000:2.0:1746129227.742435:0:7109:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009bba2200/0x48868a4e43904f28 lrc: 5/0,0 mode: CW/CW res: [0x200000401:0x22:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf337d62 expref: 19 pid: 7122 timeout: 273 lvb_type: 0 00000100:00100000:3.0:1746129227.742524:0:12160:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b189c00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:12160:1830949051534592:192.168.204.31@tcp:104: 00010000:00010000:3.0:1746129227.742539:0:12160:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880094bd3800/0x48868a4e43904f60 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x22:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12160 initiator: MDT0 00000100:00100000:2.0:1746129227.743069:0:7109:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 203 00000100:00100000:2.0:1746129227.743077:0:7109:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093154a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f39d518f-facf-4547-b099-7a2592d93d98+19:1962:x1830949046484352:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746129227.743087:0:7109:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746129227.743093:0:7109:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009bba2200/0x48868a4e43904f28 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x22:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf337d62 expref: 19 pid: 7122 timeout: 273 lvb_type: 0 00010000:00010000:2.0:1746129227.743102:0:7109:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009bba2200/0x48868a4e43904f28 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x22:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf337d62 expref: 19 pid: 7122 timeout: 273 lvb_type: 0 00010000:00010000:2.0:1746129227.743119:0:7109:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009bba2200/0x48868a4e43904f28 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x22:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf337d62 expref: 19 pid: 7122 timeout: 273 lvb_type: 0 00010000:00010000:2.0:1746129227.743154:0:7109:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x22:0x0].0x0 (ffff880094409000) 00010000:00010000:2.0:1746129227.743158:0:7109:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880094bd3800/0x48868a4e43904f60 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x22:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12160 initiator: MDT0 00010000:00010000:2.0:1746129227.743165:0:7109:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880094bd3800/0x48868a4e43904f60 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x22:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 12160 initiator: MDT0 00010000:00010000:2.0:1746129227.743171:0:7109:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880094bd3800/0x48868a4e43904f60 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x22:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 12160 initiator: MDT0 00010000:00010000:2.0:1746129227.743186:0:7109:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746129227.743217:0:7109:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093154a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f39d518f-facf-4547-b099-7a2592d93d98+18:1962:x1830949046484352:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 141us (863us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129227.743222:0:7109:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 203 00010000:00010000:2.0:1746129227.743245:0:12160:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880094bd3800/0x48868a4e43904f60 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x22:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12160 initiator: MDT0 00010000:00010000:2.0:1746129227.743250:0:12160:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880094bd3800/0x48868a4e43904f60 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x22:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12160 initiator: MDT0 00000004:00200000:2.0:1746129227.743278:0:12160:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000401:0x22:0x0]: returning size 2 00000004:00200000:2.0:1746129227.743282:0:12160:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1746129227.743293:0:12160:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff880094bd3800/0x48868a4e43904f60 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x22:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12160 initiator: MDT0 00010000:00010000:2.0:1746129227.743317:0:12160:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880094bd2600/0x48868a4e43904f59 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x22:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf337d7e expref: 18 pid: 12160 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129227.743326:0:12160:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880094bd3800/0x48868a4e43904f60 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x22:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf337d7e expref: 17 pid: 12160 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129227.743339:0:12160:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x22:0x0].0x0 (ffff880094409000) 00010000:00010000:2.0:1746129227.743342:0:12160:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1746129227.743344:0:12160:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094bd3800, rc 0) 00000100:00100000:2.0:1746129227.743361:0:12160:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009468d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f39d518f-facf-4547-b099-7a2592d93d98+17:14439:x1830949046484224:12345-192.168.204.31@tcp:101:cp.0 Request processed in 4154us (5065us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129227.743366:0:12160:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 974 00000100:00100000:0.0:1746129227.746952:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129227.747033:0:15051:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949046484608 00000100:00100000:3.0:1746129227.747040:0:15051:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949046484608 00000100:00100000:3.0:1746129227.747093:0:15051:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 232 00000100:00100000:3.0:1746129227.747099:0:15051:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009468e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:f39d518f-facf-4547-b099-7a2592d93d98+17:14439:x1830949046484608:12345-192.168.204.31@tcp:35:cp.0 00000100:00100000:3.0:1746129227.747421:0:15051:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009468e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:f39d518f-facf-4547-b099-7a2592d93d98+18:14439:x1830949046484608:12345-192.168.204.31@tcp:35:cp.0 Request processed in 321us (474us total) trans 4294967669 rc 0/0 00000100:00100000:3.0:1746129227.747427:0:15051:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 232 00000100:00100000:1.0:1746129227.760146:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129227.760201:0:12160:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949046484736 00000100:00100000:2.0:1746129227.760213:0:12160:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949046484736 00000100:00100000:2.0:1746129227.760262:0:12160:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 975 00000100:00100000:2.0:1746129227.760269:0:12160:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093156a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f39d518f-facf-4547-b099-7a2592d93d98+18:14440:x1830949046484736:12345-192.168.204.31@tcp:101:lfs.0 00010000:00010000:2.0:1746129227.760287:0:12160:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129227.760301:0:12160:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009bba2200/0x48868a4e43904f67 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf337d85 expref: -99 pid: 12160 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129227.760346:0:12160:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009bba3000/0x48868a4e43904f6e lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12160 initiator: MDT0 00010000:00010000:2.0:1746129227.760355:0:12160:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009bba3000/0x48868a4e43904f6e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12160 initiator: MDT0 00010000:00010000:2.0:1746129227.760362:0:12160:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009bba3000/0x48868a4e43904f6e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12160 initiator: MDT0 00010000:00010000:2.0:1746129227.760373:0:12160:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009b9b1000/0x48868a4e43904f75 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xbccb0c83 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12160 initiator: MDT0 00010000:00010000:2.0:1746129227.760378:0:12160:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009b9b1000/0x48868a4e43904f75 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xbccb0c83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12160 initiator: MDT0 00010000:00010000:2.0:1746129227.760383:0:12160:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009b9b1000/0x48868a4e43904f75 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xbccb0c83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12160 initiator: MDT0 00010000:00010000:2.0:1746129227.760472:0:12160:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009b9b0e00/0x48868a4e43904f7c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x22:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12160 initiator: MDT0 00010000:00010000:2.0:1746129227.760479:0:12160:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009b9b0e00/0x48868a4e43904f7c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x22:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12160 initiator: MDT0 00010000:00010000:2.0:1746129227.760484:0:12160:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009b9b0e00/0x48868a4e43904f7c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x22:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12160 initiator: MDT0 00000004:00200000:2.0:1746129227.760506:0:12160:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000401:0x22:0x0]: returning size 159 00000004:00200000:2.0:1746129227.760510:0:12160:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1746129227.760520:0:12160:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88009b9b0e00/0x48868a4e43904f7c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x22:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12160 initiator: MDT0 00010000:00010000:2.0:1746129227.760527:0:12160:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009b9b0e00/0x48868a4e43904f7c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x22:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12160 initiator: MDT0 00010000:00010000:2.0:1746129227.760533:0:12160:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009bba3000/0x48868a4e43904f6e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12160 initiator: MDT0 00010000:00010000:2.0:1746129227.760538:0:12160:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009bba3000/0x48868a4e43904f6e lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 12160 initiator: MDT0 00010000:00010000:2.0:1746129227.760543:0:12160:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009bba3000/0x48868a4e43904f6e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12160 initiator: MDT0 00010000:00010000:2.0:1746129227.760547:0:12160:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009bba3000 already unused, calling callback (ffffffffa1371690) 00010000:00010000:2.0:1746129227.760551:0:12160:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009bba3000/0x48868a4e43904f6e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12160 initiator: MDT0 00010000:00010000:2.0:1746129227.760556:0:12160:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009bba3000/0x48868a4e43904f6e lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 12160 initiator: MDT0 00010000:00010000:2.0:1746129227.760565:0:12160:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff880094409100) 00010000:00010000:2.0:1746129227.760572:0:12160:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746129227.760576:0:12160:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009bba3000/0x48868a4e43904f6e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12160 initiator: MDT0 00010000:00010000:2.0:1746129227.760580:0:12160:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009bba3000/0x48868a4e43904f6e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12160 initiator: MDT0 00010000:00010000:2.0:1746129227.760606:0:12160:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009b9b1000/0x48868a4e43904f75 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xbccb0c83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12160 initiator: MDT0 00010000:00010000:2.0:1746129227.760610:0:12160:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009b9b1000/0x48868a4e43904f75 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xbccb0c83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12160 initiator: MDT0 00010000:00010000:2.0:1746129227.760615:0:12160:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009b9b1000/0x48868a4e43904f75 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xbccb0c83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12160 initiator: MDT0 00010000:00010000:2.0:1746129227.760618:0:12160:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009b9b1000 already unused, calling callback (ffffffffa1371690) 00010000:00010000:2.0:1746129227.760620:0:12160:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009b9b1000/0x48868a4e43904f75 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xbccb0c83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12160 initiator: MDT0 00010000:00010000:2.0:1746129227.760624:0:12160:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009b9b1000/0x48868a4e43904f75 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xbccb0c83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12160 initiator: MDT0 00010000:00010000:2.0:1746129227.760631:0:12160:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xbccb0c83 (ffff880093a1de00) 00010000:00010000:2.0:1746129227.760632:0:12160:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746129227.760634:0:12160:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009b9b1000/0x48868a4e43904f75 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xbccb0c83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12160 initiator: MDT0 00010000:00010000:2.0:1746129227.760638:0:12160:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009b9b1000/0x48868a4e43904f75 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xbccb0c83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12160 initiator: MDT0 00010000:00010000:2.0:1746129227.760660:0:12160:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009bba2200/0x48868a4e43904f67 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf337d85 expref: 20 pid: 12160 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129227.760678:0:12160:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009b9b0e00/0x48868a4e43904f7c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x22:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf337d85 expref: 19 pid: 12160 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129227.760683:0:12160:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x22:0x0].0x0 (ffff880094409000) 00010000:00010000:2.0:1746129227.760685:0:12160:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1746129227.760687:0:12160:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009b9b0e00, rc 0) 00000100:00100000:2.0:1746129227.760731:0:12160:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093156a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f39d518f-facf-4547-b099-7a2592d93d98+19:14440:x1830949046484736:12345-192.168.204.31@tcp:101:lfs.0 Request processed in 462us (592us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129227.760737:0:12160:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 975 00010000:00010000:3.0:1746129227.761037:0:7111:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1746129227.768890:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129227.769031:0:7108:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949046484864 00000100:00100000:2.0:1746129227.769038:0:7108:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949046484864 00000100:00100000:2.0:1746129227.769090:0:7108:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 8 00000100:00100000:2.0:1746129227.769095:0:7108:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009468f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f39d518f-facf-4547-b099-7a2592d93d98+19:1961:x1830949046484864:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746129227.769108:0:7108:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746129227.769153:0:7108:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009b9b0e00/0x48868a4e43904f7c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x22:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf337d85 expref: 19 pid: 12160 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129227.769178:0:7108:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x22:0x0].0x0 (ffff880094409000) 00010000:00010000:2.0:1746129227.769182:0:7108:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746129227.769289:0:7108:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009468f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f39d518f-facf-4547-b099-7a2592d93d98+18:1961:x1830949046484864:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 192us (441us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129227.769294:0:7108:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 8 00000100:00100000:0.0:1746129227.769387:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129227.769672:0:12160:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949046485120 00000100:00100000:3.0:1746129227.769677:0:12160:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949046485120 00000100:00100000:3.0:1746129227.769710:0:12160:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 976 00000100:00100000:3.0:1746129227.769716:0:12160:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009468ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f39d518f-facf-4547-b099-7a2592d93d98+18:14440:x1830949046485120:12345-192.168.204.31@tcp:101:lfs.0 00010000:00010000:3.0:1746129227.769728:0:12160:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129227.769738:0:12160:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880094bd2600/0x48868a4e43904f83 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf337d8c expref: -99 pid: 12160 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129227.769808:0:12160:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbc7e00/0x48868a4e43904f8a lrc: 3/0,1 mode: --/CW res: [0x200000401:0x22:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12160 initiator: MDT0 00010000:00010000:3.0:1746129227.769828:0:12160:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880094bd3800/0x48868a4e43904f60 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x22:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf337d7e expref: 19 pid: 12160 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129227.769834:0:12160:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbc7e00/0x48868a4e43904f8a lrc: 4/0,1 mode: --/CW res: [0x200000401:0x22:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12160 initiator: MDT0 00010000:00010000:3.0:1746129227.770576:0:12160:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880094bd3800/0x48868a4e43904f60 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x22:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf337d7e expref: 19 pid: 12160 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129227.770589:0:12160:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880094bd3800/0x48868a4e43904f60 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x22:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf337d7e expref: 19 pid: 12160 timeout: 273 lvb_type: 0 00000100:00100000:3.0:1746129227.770600:0:12160:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135712a00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:12160:1830949051534720:192.168.204.31@tcp:104: 00000100:00100000:3.0:1746129227.770732:0:12160:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800acc7e480 going to sleep for 11 seconds 00000100:00100000:3.0:1746129227.772193:0:12160:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135712a00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:12160:1830949051534720:192.168.204.31@tcp:104: 00010000:00010000:3.0:1746129227.772208:0:12160:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbc7e00/0x48868a4e43904f8a lrc: 3/0,1 mode: --/CW res: [0x200000401:0x22:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12160 initiator: MDT0 00000100:00100000:0.0:1746129227.772728:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129227.772956:0:7108:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949046485248 00000100:00100000:2.0:1746129227.772961:0:7108:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949046485248 00010000:00010000:2.0:1746129227.772983:0:7108:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880094bd3800/0x48868a4e43904f60 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x22:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf337d7e expref: 20 pid: 12160 timeout: 273 lvb_type: 0 00000100:00100000:2.0:1746129227.773014:0:7108:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 204 00000100:00100000:2.0:1746129227.773021:0:7108:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009468ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f39d518f-facf-4547-b099-7a2592d93d98+20:1961:x1830949046485248:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746129227.773032:0:7108:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746129227.773036:0:7108:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880094bd3800/0x48868a4e43904f60 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x22:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf337d7e expref: 20 pid: 12160 timeout: 273 lvb_type: 0 00010000:00010000:2.0:1746129227.773045:0:7108:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880094bd3800/0x48868a4e43904f60 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x22:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf337d7e expref: 20 pid: 12160 timeout: 273 lvb_type: 0 00010000:00010000:2.0:1746129227.773069:0:7108:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880094bd3800/0x48868a4e43904f60 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x22:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf337d7e expref: 20 pid: 12160 timeout: 273 lvb_type: 0 00010000:00010000:2.0:1746129227.773090:0:7108:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x22:0x0].0x0 (ffff880094409000) 00010000:00010000:2.0:1746129227.773094:0:7108:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbc7e00/0x48868a4e43904f8a lrc: 3/0,1 mode: --/CW res: [0x200000401:0x22:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12160 initiator: MDT0 00010000:00010000:2.0:1746129227.773100:0:7108:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbc7e00/0x48868a4e43904f8a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x22:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 12160 initiator: MDT0 00010000:00010000:2.0:1746129227.773105:0:7108:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbc7e00/0x48868a4e43904f8a lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x22:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 12160 initiator: MDT0 00010000:00010000:2.0:1746129227.773118:0:7108:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746129227.773158:0:7108:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009468ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f39d518f-facf-4547-b099-7a2592d93d98+19:1961:x1830949046485248:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 136us (430us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129227.773163:0:7108:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 204 00010000:00010000:2.0:1746129227.773185:0:12160:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbc7e00/0x48868a4e43904f8a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x22:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12160 initiator: MDT0 00010000:00010000:2.0:1746129227.773199:0:12160:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbc7e00/0x48868a4e43904f8a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x22:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12160 initiator: MDT0 00000004:00200000:2.0:1746129227.773213:0:12160:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000401:0x22:0x0]: returning size 159 00010000:00010000:2.0:1746129227.773311:0:12160:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880094bd2600/0x48868a4e43904f83 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf337d8c expref: 20 pid: 12160 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129227.773322:0:12160:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbc7e00/0x48868a4e43904f8a lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x22:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf337d8c expref: 19 pid: 12160 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129227.773328:0:12160:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x22:0x0].0x0 (ffff880094409000) 00010000:00010000:2.0:1746129227.773330:0:12160:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1746129227.773332:0:12160:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012dbc7e00, rc 0) 00000100:00100000:2.0:1746129227.773350:0:12160:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009468ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f39d518f-facf-4547-b099-7a2592d93d98+19:14440:x1830949046485120:12345-192.168.204.31@tcp:101:lfs.0 Request processed in 3634us (3963us total) trans 4294967670 rc 0/0 00000100:00100000:2.0:1746129227.773356:0:12160:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 976 00000100:00100000:0.0:1746129227.775053:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129227.775145:0:12160:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949046485376 00000100:00100000:2.0:1746129227.775150:0:12160:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949046485376 00000100:00100000:2.0:1746129227.775185:0:12160:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 977 00000100:00100000:2.0:1746129227.775190:0:12160:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009468d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f39d518f-facf-4547-b099-7a2592d93d98+19:14440:x1830949046485376:12345-192.168.204.31@tcp:101:lfs.0 00010000:00010000:2.0:1746129227.775205:0:12160:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129227.775215:0:12160:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009b9b0c00/0x48868a4e43904f98 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x22:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf337d93 expref: -99 pid: 12160 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129227.775264:0:12160:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009b9b1200/0x48868a4e43904f9f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x22:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 12160 initiator: MDT0 00010000:00010000:2.0:1746129227.775272:0:12160:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbc7e00/0x48868a4e43904f8a lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x22:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf337d8c expref: 20 pid: 12160 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129227.775283:0:12160:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009b9b1200/0x48868a4e43904f9f lrc: 4/1,0 mode: --/PR res: [0x200000401:0x22:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12160 initiator: MDT0 00010000:00010000:2.0:1746129227.775302:0:12160:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbc7e00/0x48868a4e43904f8a lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x22:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf337d8c expref: 20 pid: 12160 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129227.775310:0:12160:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbc7e00/0x48868a4e43904f8a lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x22:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf337d8c expref: 20 pid: 12160 timeout: 273 lvb_type: 0 00000100:00100000:2.0:1746129227.775319:0:12160:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b189500 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:12160:1830949051534848:192.168.204.31@tcp:104: 00000100:00100000:2.0:1746129227.775379:0:12160:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800aa452f00 going to sleep for 11 seconds 00000100:00100000:0.0:1746129227.777885:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129227.778077:0:12160:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b189500 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:12160:1830949051534848:192.168.204.31@tcp:104: 00010000:00010000:2.0:1746129227.778095:0:12160:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009b9b1200/0x48868a4e43904f9f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x22:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12160 initiator: MDT0 00000100:00100000:1.0:1746129227.778156:0:7109:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949046485504 00000100:00100000:1.0:1746129227.778162:0:7109:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949046485504 00010000:00010000:1.0:1746129227.778188:0:7109:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbc7e00/0x48868a4e43904f8a lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x22:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf337d8c expref: 21 pid: 12160 timeout: 273 lvb_type: 0 00000100:00100000:1.0:1746129227.778207:0:7109:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 205 00000100:00100000:1.0:1746129227.778213:0:7109:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009468ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f39d518f-facf-4547-b099-7a2592d93d98+21:1961:x1830949046485504:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746129227.778222:0:7109:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746129227.778226:0:7109:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbc7e00/0x48868a4e43904f8a lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x22:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf337d8c expref: 21 pid: 12160 timeout: 273 lvb_type: 0 00010000:00010000:1.0:1746129227.778234:0:7109:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbc7e00/0x48868a4e43904f8a lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x22:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf337d8c expref: 21 pid: 12160 timeout: 273 lvb_type: 0 00010000:00010000:1.0:1746129227.778259:0:7109:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbc7e00/0x48868a4e43904f8a lrc: 0/0,0 mode: --/CW res: [0x200000401:0x22:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf337d8c expref: 21 pid: 12160 timeout: 273 lvb_type: 0 00010000:00010000:1.0:1746129227.778284:0:7109:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x22:0x0].0x0 (ffff880094409000) 00010000:00010000:1.0:1746129227.778287:0:7109:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009b9b1200/0x48868a4e43904f9f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x22:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12160 initiator: MDT0 00010000:00010000:1.0:1746129227.778294:0:7109:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009b9b1200/0x48868a4e43904f9f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x22:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 12160 initiator: MDT0 00010000:00010000:1.0:1746129227.778298:0:7109:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009b9b1200/0x48868a4e43904f9f lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x22:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 12160 initiator: MDT0 00010000:00010000:1.0:1746129227.778311:0:7109:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746129227.778369:0:12160:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009b9b1200/0x48868a4e43904f9f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x22:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12160 initiator: MDT0 00010000:00010000:2.0:1746129227.778375:0:12160:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009b9b1200/0x48868a4e43904f9f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x22:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12160 initiator: MDT0 00000004:00200000:2.0:1746129227.778404:0:12160:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000401:0x22:0x0]: returning size 159 00000004:00200000:2.0:1746129227.778407:0:12160:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1746129227.778418:0:12160:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88009b9b1200/0x48868a4e43904f9f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x22:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12160 initiator: MDT0 00010000:00010000:2.0:1746129227.778442:0:12160:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009b9b0c00/0x48868a4e43904f98 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x22:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf337d93 expref: 21 pid: 12160 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129227.778460:0:12160:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009b9b1200/0x48868a4e43904f9f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x22:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf337d93 expref: 20 pid: 12160 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129227.778466:0:12160:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x22:0x0].0x0 (ffff880094409000) 00010000:00010000:2.0:1746129227.778468:0:12160:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1746129227.778470:0:12160:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009b9b1200, rc 0) 00000100:00100000:1.0:1746129227.778675:0:7109:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009468ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f39d518f-facf-4547-b099-7a2592d93d98+20:1961:x1830949046485504:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 461us (795us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129227.778681:0:7109:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 205 00000100:00100000:2.0:1746129227.778740:0:12160:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009468d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f39d518f-facf-4547-b099-7a2592d93d98+19:14440:x1830949046485376:12345-192.168.204.31@tcp:101:lfs.0 Request processed in 3549us (3691us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129227.778746:0:12160:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 977 00000100:00100000:0.0:1746129227.780965:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129227.781016:0:12160:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949046485760 00000100:00100000:2.0:1746129227.781023:0:12160:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949046485760 00000100:00100000:2.0:1746129227.781073:0:12160:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 978 00000100:00100000:2.0:1746129227.781080:0:12160:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009468fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f39d518f-facf-4547-b099-7a2592d93d98+19:14440:x1830949046485760:12345-192.168.204.31@tcp:101:lfs.0 00010000:00010000:2.0:1746129227.781094:0:12160:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129227.781107:0:12160:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009b9b1800/0x48868a4e43904fa6 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x22:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf337d9a expref: -99 pid: 12160 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129227.781175:0:12160:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009b9b1000/0x48868a4e43904fad lrc: 3/0,1 mode: --/PW res: [0x200000401:0x22:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 12160 initiator: MDT0 00010000:00010000:2.0:1746129227.781184:0:12160:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009b9b1000/0x48868a4e43904fad lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x22:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12160 initiator: MDT0 00010000:00010000:2.0:1746129227.781191:0:12160:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009b9b1000/0x48868a4e43904fad lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x22:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12160 initiator: MDT0 00000004:00200000:2.0:1746129227.781200:0:12160:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000401:0x22:0x0]: returning size 159 00010000:00010000:2.0:1746129227.781279:0:12160:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009b9b1800/0x48868a4e43904fa6 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x22:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf337d9a expref: 22 pid: 12160 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129227.781297:0:12160:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009b9b1000/0x48868a4e43904fad lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x22:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf337d9a expref: 21 pid: 12160 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129227.781304:0:12160:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x22:0x0].0x0 (ffff880094409000) 00010000:00010000:2.0:1746129227.781306:0:12160:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1746129227.781309:0:12160:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009b9b1000, rc 0) 00000100:00100000:2.0:1746129227.781358:0:12160:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009468fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f39d518f-facf-4547-b099-7a2592d93d98+21:14440:x1830949046485760:12345-192.168.204.31@tcp:101:lfs.0 Request processed in 278us (398us total) trans 4294967671 rc 0/0 00000100:00100000:2.0:1746129227.781363:0:12160:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 978 00000100:00100000:0.0:1746129227.782780:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129227.782836:0:8435:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949046485888 00000100:00100000:2.0:1746129227.782841:0:8435:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949046485888 00000100:00100000:2.0:1746129227.782903:0:8435:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 230 00000100:00100000:2.0:1746129227.782909:0:8435:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b1bc1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f39d518f-facf-4547-b099-7a2592d93d98+19:1964:x1830949046485888:12345-192.168.204.31@tcp:1:lfs.0 00010000:00010000:2.0:1746129227.782934:0:8435:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88012bae2800/0x48868a4e43904fbb lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129227.782948:0:8435:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009bc6dc00/0x48868a4e43904f52 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf337d77 expref: 19 pid: 8435 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129227.782954:0:8435:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746129227.782955:0:8435:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746129227.782957:0:8435:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012bae2800/0x48868a4e43904fbb lrc: 4/0,1 mode: --/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129227.782981:0:8435:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009bc6dc00/0x48868a4e43904f52 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf337d77 expref: 19 pid: 8435 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129227.783003:0:8435:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009bc6dc00/0x48868a4e43904f52 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf337d77 expref: 19 pid: 8435 timeout: 273 lvb_type: 0 00000100:00100000:2.0:1746129227.783014:0:8435:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b189500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8435:1830949051534976:192.168.204.31@tcp:104: 00000100:00100000:2.0:1746129227.783100:0:8435:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800aa452f00 going to sleep for 11 seconds 00000100:00100000:0.0:1746129227.785441:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129227.785645:0:8435:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b189500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8435:1830949051534976:192.168.204.31@tcp:104: 00010000:00010000:2.0:1746129227.785662:0:8435:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88012bae2800/0x48868a4e43904fbb lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746129227.785678:0:8441:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949046486016 00000100:00100000:3.0:1746129227.785682:0:8441:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949046486016 00002000:00100000:3.0:1746129227.785712:0:8441:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x1e:0x0] (0->158) req@ffff8800b1bc3100 x1830949046486016/t0(0) o4->f39d518f-facf-4547-b099-7a2592d93d98@192.168.204.31@tcp:723/0 lens 648/0 e 0 to 0 dl 1746129238 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 00002000:00100000:3.0:1746129227.785720:0:8441:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800b1bc3100 with x1830949046486016 ext(0->158) 00010000:00010000:3.0:1746129227.785727:0:8441:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009bc6dc00/0x48868a4e43904f52 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf337d77 expref: 20 pid: 8435 timeout: 273 lvb_type: 0 00010000:00010000:3.0:1746129227.785737:0:8441:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009bc6dc00/0x48868a4e43904f52 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf337d77 expref: 20 pid: 8435 timeout: 273 lvb_type: 0 00002000:00010000:3.0:1746129227.785751:0:8441:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800b1bc3100 00000100:00100000:3.0:1746129227.785782:0:8441:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 2 00000100:00100000:3.0:1746129227.785788:0:8441:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b1bc3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:f39d518f-facf-4547-b099-7a2592d93d98+20:1962:x1830949046486016:12345-192.168.204.31@tcp:4:cp.0 00000100:00100000:3.0:1746129227.786154:0:8441:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b1bc3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:f39d518f-facf-4547-b099-7a2592d93d98+22:1962:x1830949046486016:12345-192.168.204.31@tcp:4:cp.0 Request processed in 364us (715us total) trans 4294967349 rc 0/0 00000100:00100000:3.0:1746129227.786161:0:8441:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 2 00002000:00100000:3.0:1746129227.786166:0:8441:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x1e:0x0] (0->158) req@ffff8800b1bc3100 x1830949046486016/t4294967349(0) o4->f39d518f-facf-4547-b099-7a2592d93d98@192.168.204.31@tcp:723/0 lens 648/448 e 0 to 0 dl 1746129238 ref 1 fl Complete:H/200/0 rc 0/0 job:'cp.0' uid:0 gid:0 00002000:00100000:3.0:1746129227.786173:0:8441:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800b1bc3100 with x1830949046486016 ext(0->158) 00010000:00010000:3.0:1746129227.786177:0:8441:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009bc6dc00/0x48868a4e43904f52 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf337d77 expref: 22 pid: 8435 timeout: 273 lvb_type: 0 00010000:00010000:3.0:1746129227.786231:0:8441:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009bc6dc00/0x48868a4e43904f52 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf337d77 expref: 22 pid: 8435 timeout: 273 lvb_type: 0 00002000:00010000:3.0:1746129227.786237:0:8441:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800b1bc3100 00000100:00100000:0.0:1746129227.787710:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129227.787794:0:7109:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949046486144 00000100:00100000:1.0:1746129227.787799:0:7109:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949046486144 00010000:00010000:1.0:1746129227.787821:0:7109:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009bc6dc00/0x48868a4e43904f52 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf337d77 expref: 22 pid: 8435 timeout: 273 lvb_type: 0 00000100:00100000:1.0:1746129227.787998:0:7109:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 206 00000100:00100000:1.0:1746129227.788006:0:7109:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b1bc3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f39d518f-facf-4547-b099-7a2592d93d98+22:1963:x1830949046486144:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746129227.788016:0:7109:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:1.0:1746129227.788028:0:7109:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x1e:0x0] updating lvb size from disk: 0 -> 159 00010000:00010000:1.0:1746129227.788033:0:7109:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009bc6dc00/0x48868a4e43904f52 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf337d77 expref: 22 pid: 8435 timeout: 273 lvb_type: 0 00010000:00010000:1.0:1746129227.788051:0:7109:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009bc6dc00/0x48868a4e43904f52 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf337d77 expref: 22 pid: 8435 timeout: 273 lvb_type: 0 00010000:00010000:1.0:1746129227.788077:0:7109:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009bc6dc00/0x48868a4e43904f52 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf337d77 expref: 22 pid: 8435 timeout: 273 lvb_type: 0 00010000:00010000:1.0:1746129227.788103:0:7109:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129227.788105:0:7109:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129227.788109:0:7109:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012bae2800/0x48868a4e43904fbb lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129227.788120:0:7109:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012bae2800/0x48868a4e43904fbb lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129227.788137:0:7109:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746129227.788193:0:8435:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88012bae2800/0x48868a4e43904fbb lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129227.788203:0:8435:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012bae2800/0x48868a4e43904fbb lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129227.788218:0:8435:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88012bae2800/0x48868a4e43904fbb lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129227.788225:0:8435:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88012bae2800/0x48868a4e43904fbb lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129227.788231:0:8435:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88012bae2800/0x48868a4e43904fbb lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746129227.788231:0:7109:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b1bc3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f39d518f-facf-4547-b099-7a2592d93d98+21:1963:x1830949046486144:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 226us (525us total) trans 0 rc 0/0 00010000:00010000:2.0:1746129227.788237:0:8435:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012bae2800 already unused, calling callback (ffffffffa08a1d70) 00000100:00100000:1.0:1746129227.788238:0:7109:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 206 00010000:00010000:2.0:1746129227.788245:0:8435:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88012bae2800/0x48868a4e43904fbb lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129227.788252:0:8435:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88012bae2800/0x48868a4e43904fbb lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129227.788261:0:8435:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88012bae2800/0x48868a4e43904fbb lrc: 2/0,0 mode: --/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129227.788267:0:8435:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012bae2800/0x48868a4e43904fbb lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746129227.788300:0:8435:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b1bc1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f39d518f-facf-4547-b099-7a2592d93d98+20:1964:x1830949046485888:12345-192.168.204.31@tcp:1:lfs.0 Request processed in 5392us (5524us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129227.788307:0:8435:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 230 00000100:00100000:1.0:1746129227.789940:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129227.790283:0:7122:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949046486400 00000100:00100000:2.0:1746129227.790289:0:7122:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949046486400 00000100:00100000:2.0:1746129227.790329:0:7122:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 979 00000100:00100000:2.0:1746129227.790335:0:7122:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093156d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f39d518f-facf-4547-b099-7a2592d93d98+21:14440:x1830949046486400:12345-192.168.204.31@tcp:36:lfs.0 00010000:00010000:2.0:1746129227.790373:0:7122:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:2.0:1746129227.790392:0:7122:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009b9b1200/0x48868a4e43904f9f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x22:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf337d93 expref: 21 pid: 12160 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129227.790405:0:7122:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880095329400/0x48868a4e43904f4b lrc: 0/0,0 mode: --/CR res: [0x200000401:0x22:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf337d70 expref: 20 pid: 7122 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129227.790412:0:7122:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x22:0x0].0x0 (ffff880094409000) 00010000:00010000:2.0:1746129227.790415:0:7122:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746129227.790442:0:7122:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88009bba3000/0x48868a4e43904fc2 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x22:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7122 initiator: MDT0 00010000:00010000:2.0:1746129227.790450:0:7122:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009bba3000/0x48868a4e43904fc2 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x22:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7122 initiator: MDT0 00010000:00010000:2.0:1746129227.790456:0:7122:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009bba3000/0x48868a4e43904fc2 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x22:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7122 initiator: MDT0 00000040:00080000:2.0:1746129227.790783:0:7122:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x3:0x0].12, 88 off9224 00000004:00080000:2.0:1746129227.790789:0:7122:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 173848940278ns, next at 0ns, rc = 0 00000040:00080000:2.0:1746129227.790825:0:7122:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x6:0x0].13, 88 off9264 00000004:00080000:2.0:1746129227.790828:0:7122:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 173848980305ns, next at 155720060341ns, rc = 0 00000001:00080000:0.0:1746129227.812938:0:7171:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967672 is committed 00000004:00080000:0.0:1746129227.812945:0:7171:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 15 committed 00000004:00080000:0.0:1746129227.812951:0:7171:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 12 committed 00000004:00010000:2.0:1746129227.813027:0:7122:0:(mdt_handler.c:4446:mdt_save_lock()) ### save lock request ffff880093156d80 reply state ffff88009b5e6400 transno 4294967672 ns: mdt-lustre-MDT0000_UUID lock: ffff88009bba3000/0x48868a4e43904fc2 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x22:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7122 initiator: MDT0 00000100:00100000:2.0:1746129227.813038:0:7122:0:(service.c:173:ptlrpc_save_lock()) nlocks 0 00010000:00080000:2.0:1746129227.813123:0:7122:0:(ldlm_lib.c:3369:target_send_reply()) Schedule reply immediately 00000100:00100000:2.0:1746129227.813137:0:7122:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093156d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f39d518f-facf-4547-b099-7a2592d93d98+17:14440:x1830949046486400:12345-192.168.204.31@tcp:36:lfs.0 Request processed in 22798us (23198us total) trans 4294967672 rc 0/0 00000100:00100000:2.0:1746129227.813144:0:7122:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 979 00000100:00100000:1.0:1746129227.813239:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095115500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3296:1830949051535104:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746129227.813278:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1746129227.813370:0:3282:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88009bba3000/0x48868a4e43904fc2 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x22:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7122 initiator: MDT0 00010000:00010000:3.0:1746129227.813377:0:3282:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009bba3000/0x48868a4e43904fc2 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x22:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7122 initiator: MDT0 00010000:00010000:3.0:1746129227.813383:0:3282:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009bba3000/0x48868a4e43904fc2 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x22:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7122 initiator: MDT0 00010000:00010000:3.0:1746129227.813388:0:3282:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009bba3000 already unused, calling callback (ffffffffa1371690) 00010000:00010000:3.0:1746129227.813398:0:3282:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009bba3000/0x48868a4e43904fc2 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x22:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7122 initiator: MDT0 00010000:00010000:3.0:1746129227.813403:0:3282:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009bba3000/0x48868a4e43904fc2 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x22:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7122 initiator: MDT0 00010000:00010000:3.0:1746129227.813416:0:3282:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x22:0x0].0x0 (ffff880094409000) 00010000:00010000:3.0:1746129227.813418:0:3282:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1746129227.813421:0:3282:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009bba3000/0x48868a4e43904fc2 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x22:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7122 initiator: MDT0 00010000:00010000:3.0:1746129227.813425:0:3282:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009bba3000/0x48868a4e43904fc2 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x22:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7122 initiator: MDT0 00000100:00100000:2.0:1746129227.813480:0:8435:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051535104 00000100:00100000:2.0:1746129227.813486:0:8435:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051535104 00000100:00100000:2.0:1746129227.813507:0:8435:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 231 00000100:00100000:2.0:1746129227.813511:0:8435:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095114000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3296:x1830949051535104:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746129227.813567:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135712a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3297:1830949051535232:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746129227.813592:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746129227.813616:0:10930:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051535232 00000100:00100000:3.0:1746129227.813619:0:10930:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051535232 00000100:00100000:3.0:1746129227.813636:0:10930:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 232 00000100:00100000:3.0:1746129227.813641:0:10930:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095116d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3297:x1830949051535232:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746129227.813775:0:10930:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095116d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3297:x1830949051535232:12345-0@lo:2:osp-syn-1-0.0 Request processed in 134us (182us total) trans 4294967341 rc 0/0 00000100:00100000:3.0:1746129227.813780:0:10930:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 232 00000004:00080000:1.0:1746129227.813874:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880135712a00/2, rc 0, transno 4294967341 00000100:00100000:1.0:1746129227.813880:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135712a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3297:1830949051535232:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746129227.814018:0:8435:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095114000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3296:x1830949051535104:12345-0@lo:2:osp-syn-0-0.0 Request processed in 506us (739us total) trans 4294967350 rc 0/0 00000100:00100000:2.0:1746129227.814025:0:8435:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 231 00000004:00080000:1.0:1746129227.814201:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880095115500/2, rc 0, transno 4294967350 00000100:00100000:1.0:1746129227.814206:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095115500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3296:1830949051535104:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746129227.818178:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129227.818248:0:7122:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949046486528 00000100:00100000:2.0:1746129227.818255:0:7122:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949046486528 00000100:00100000:2.0:1746129227.818288:0:7122:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 980 00000100:00100000:2.0:1746129227.818301:0:7122:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b1bc0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f39d518f-facf-4547-b099-7a2592d93d98+16:14440:x1830949046486528:12345-192.168.204.31@tcp:101:lfs.0 00010000:00010000:2.0:1746129227.818319:0:7122:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129227.818332:0:7122:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c3ce600/0x48868a4e43904fc9 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x22:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf337da1 expref: -99 pid: 7122 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129227.818374:0:7122:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009c3ce600/0x48868a4e43904fc9 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x22:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf337da1 expref: 17 pid: 7122 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129227.818385:0:7122:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c3ce600/0x48868a4e43904fc9 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x22:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf337da1 expref: 17 pid: 7122 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129227.818398:0:7122:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x22:0x0].0x0 (ffff880094409000) 00010000:00010000:2.0:1746129227.818401:0:7122:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1746129227.818403:0:7122:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009c3ce600, rc 0) 00000100:00100000:2.0:1746129227.818448:0:7122:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b1bc0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f39d518f-facf-4547-b099-7a2592d93d98+17:14440:x1830949046486528:12345-192.168.204.31@tcp:101:lfs.0 Request processed in 147us (276us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129227.818454:0:7122:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 980 00000100:00100000:0.0:1746129227.821788:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129227.822286:0:7122:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949046486656 00000100:00100000:2.0:1746129227.822293:0:7122:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949046486656 00000100:00100000:2.0:1746129227.822332:0:7122:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 981 00000100:00100000:2.0:1746129227.822339:0:7122:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b1bc0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f39d518f-facf-4547-b099-7a2592d93d98+17:14440:x1830949046486656:12345-192.168.204.31@tcp:101:lfs.0 00010000:00010000:2.0:1746129227.822353:0:7122:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129227.822367:0:7122:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c3ce800/0x48868a4e43904fd0 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x22:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf337da8 expref: -99 pid: 7122 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129227.822422:0:7122:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c3cee00/0x48868a4e43904fd7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x22:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7122 initiator: MDT0 00010000:00010000:2.0:1746129227.822431:0:7122:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009c3cee00/0x48868a4e43904fd7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x22:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7122 initiator: MDT0 00010000:00010000:2.0:1746129227.822447:0:7122:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c3cee00/0x48868a4e43904fd7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x22:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7122 initiator: MDT0 00000004:00200000:2.0:1746129227.822466:0:7122:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000401:0x22:0x0]: returning size 159 00000004:00200000:2.0:1746129227.822469:0:7122:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1746129227.822478:0:7122:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88009c3cee00/0x48868a4e43904fd7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x22:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7122 initiator: MDT0 00010000:00010000:2.0:1746129227.822496:0:7122:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c3ce800/0x48868a4e43904fd0 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x22:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf337da8 expref: 19 pid: 7122 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129227.822508:0:7122:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c3cee00/0x48868a4e43904fd7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x22:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf337da8 expref: 18 pid: 7122 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129227.822515:0:7122:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x22:0x0].0x0 (ffff880094409000) 00010000:00010000:2.0:1746129227.822517:0:7122:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1746129227.822519:0:7122:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009c3cee00, rc 0) 00000100:00100000:2.0:1746129227.822564:0:7122:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b1bc0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f39d518f-facf-4547-b099-7a2592d93d98+18:14440:x1830949046486656:12345-192.168.204.31@tcp:101:lfs.0 Request processed in 225us (782us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129227.822570:0:7122:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 981 00000100:00100000:1.0:1746129227.826771:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129227.826815:0:8435:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949046486784 00000100:00100000:3.0:1746129227.826822:0:8435:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949046486784 00000100:00100000:3.0:1746129227.826874:0:8435:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 233 00000100:00100000:3.0:1746129227.826881:0:8435:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095114a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f39d518f-facf-4547-b099-7a2592d93d98+20:1962:x1830949046486784:12345-192.168.204.31@tcp:101:lfs.0 00010000:00010000:3.0:1746129227.826895:0:8435:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129227.826909:0:8435:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800952b8200/0x48868a4e43904fde lrc: 2/0,0 mode: --/PR res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf337daf expref: -99 pid: 8435 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1746129227.826927:0:8435:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x1e:0x0] initial LVB size: 159, mtime: 0x6813d14c, atime: 0x0, ctime: 0x6813d14c, blocks: 0x1 00010000:00010000:3.0:1746129227.826947:0:8435:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129227.826949:0:8435:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129227.826955:0:8435:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800952b8200/0x48868a4e43904fde lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf337daf expref: 21 pid: 8435 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129227.826968:0:8435:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800952b8200/0x48868a4e43904fde lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf337daf expref: 21 pid: 8435 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129227.826976:0:8435:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800952b8200, rc 0) 00000100:00100000:3.0:1746129227.827022:0:8435:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095114a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f39d518f-facf-4547-b099-7a2592d93d98+21:1962:x1830949046486784:12345-192.168.204.31@tcp:101:lfs.0 Request processed in 141us (257us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129227.827028:0:8435:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 233 00000100:00100000:1.0:1746129227.839207:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129227.839283:0:12160:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949046487040 00000100:00100000:0.0:1746129227.839291:0:12160:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949046487040 00000100:00100000:0.0:1746129227.839332:0:12160:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 982 00000100:00100000:0.0:1746129227.839339:0:12160:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095114e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f39d518f-facf-4547-b099-7a2592d93d98+18:14440:x1830949046487040:12345-192.168.204.31@tcp:36:lfs.0 00010000:00010000:0.0:1746129227.839376:0:12160:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746129227.839395:0:12160:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c3cee00/0x48868a4e43904fd7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x22:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf337da8 expref: 18 pid: 7122 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129227.839416:0:12160:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x22:0x0].0x0 (ffff880094409000) 00010000:00010000:0.0:1746129227.839419:0:12160:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1746129227.839447:0:12160:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88012bae3e00/0x48868a4e43904fe5 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x22:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12160 initiator: MDT0 00010000:00010000:0.0:1746129227.839457:0:12160:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012bae3e00/0x48868a4e43904fe5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x22:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12160 initiator: MDT0 00010000:00010000:0.0:1746129227.839464:0:12160:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012bae3e00/0x48868a4e43904fe5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x22:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12160 initiator: MDT0 00000004:00010000:0.0:1746129227.840443:0:12160:0:(mdt_handler.c:4446:mdt_save_lock()) ### save lock request ffff880095114e00 reply state ffff88009b5d6000 transno 4294967673 ns: mdt-lustre-MDT0000_UUID lock: ffff88012bae3e00/0x48868a4e43904fe5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x22:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12160 initiator: MDT0 00000100:00100000:0.0:1746129227.840450:0:12160:0:(service.c:173:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1746129227.840510:0:12160:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095114e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f39d518f-facf-4547-b099-7a2592d93d98+19:14440:x1830949046487040:12345-192.168.204.31@tcp:36:lfs.0 Request processed in 1170us (1308us total) trans 4294967673 rc 0/0 00000100:00100000:0.0:1746129227.840515:0:12160:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 982 00010000:00010000:3.0:1746129227.848780:0:3282:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88012bae3e00/0x48868a4e43904fe5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x22:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12160 initiator: MDT0 00010000:00010000:3.0:1746129227.848790:0:3282:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012bae3e00/0x48868a4e43904fe5 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x22:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 12160 initiator: MDT0 00010000:00010000:3.0:1746129227.848796:0:3282:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012bae3e00/0x48868a4e43904fe5 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x22:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12160 initiator: MDT0 00010000:00010000:3.0:1746129227.848801:0:3282:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012bae3e00 already unused, calling callback (ffffffffa1371690) 00000100:00100000:1.0:1746129227.848803:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00010000:00010000:3.0:1746129227.848805:0:3282:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012bae3e00/0x48868a4e43904fe5 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x22:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12160 initiator: MDT0 00010000:00010000:3.0:1746129227.848811:0:3282:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012bae3e00/0x48868a4e43904fe5 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x22:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 12160 initiator: MDT0 00010000:00010000:3.0:1746129227.848824:0:3282:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x22:0x0].0x0 (ffff880094409000) 00010000:00010000:3.0:1746129227.848827:0:3282:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746129227.848830:0:3282:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012bae3e00/0x48868a4e43904fe5 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x22:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12160 initiator: MDT0 00010000:00010000:3.0:1746129227.848841:0:3282:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012bae3e00/0x48868a4e43904fe5 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x22:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12160 initiator: MDT0 00000100:00100000:2.0:1746129227.848897:0:10930:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949046487168 00000100:00100000:2.0:1746129227.849208:0:10930:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949046487168 00000100:00100000:2.0:1746129227.849251:0:10930:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 234 00000100:00100000:2.0:1746129227.849258:0:10930:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095115c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f39d518f-facf-4547-b099-7a2592d93d98+21:1962:x1830949046487168:12345-192.168.204.31@tcp:2:lfs.0 00002000:00010000:2.0:1746129227.849582:0:10930:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x1e:0x0] updating lvb size from disk: 159 -> 159 00002000:00010000:2.0:1746129227.849585:0:10930:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x1e:0x0] updating lvb mtime from disk: 1746129228 -> 1746129228 00002000:00010000:2.0:1746129227.849587:0:10930:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x1e:0x0] updating lvb atime from disk: 0 -> 1746129228 00002000:00010000:2.0:1746129227.849589:0:10930:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x1e:0x0] updating lvb ctime from disk: 1746129228 -> 1746129228 00002000:00010000:2.0:1746129227.849595:0:10930:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x1e:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:2.0:1746129227.849639:0:10930:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095115c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f39d518f-facf-4547-b099-7a2592d93d98+22:1962:x1830949046487168:12345-192.168.204.31@tcp:2:lfs.0 Request processed in 380us (837us total) trans 4294967351 rc 0/0 00000100:00100000:2.0:1746129227.849645:0:10930:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 234 00000100:00100000:1.0:1746129227.856293:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129227.856319:0:7124:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949046487424 00000100:00100000:1.0:1746129227.856326:0:7124:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949046487424 00000100:00100000:1.0:1746129227.856371:0:7124:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 233 00000100:00100000:1.0:1746129227.856378:0:7124:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800acd05c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f39d518f-facf-4547-b099-7a2592d93d98+18:14440:x1830949046487424:12345-192.168.204.31@tcp:35:lfs.0 00000004:00010000:1.0:1746129227.856421:0:7124:0:(mdt_open.c:2471:mdt_close_resync_done()) ### [0x200000401:0x22:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009b9b1000/0x48868a4e43904fad lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x22:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf337d9a expref: 18 pid: 12160 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129227.856459:0:7124:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88012c840200/0x48868a4e43904fec lrc: 3/0,1 mode: --/EX res: [0x200000401:0x22:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7124 initiator: MDT0 00010000:00010000:1.0:1746129227.856468:0:7124:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c3ce600/0x48868a4e43904fc9 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x22:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf337da1 expref: 18 pid: 7122 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129227.856473:0:7124:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012c840200/0x48868a4e43904fec lrc: 4/0,1 mode: --/EX res: [0x200000401:0x22:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7124 initiator: MDT0 00010000:00010000:1.0:1746129227.856497:0:7124:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009c3ce600/0x48868a4e43904fc9 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x22:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf337da1 expref: 18 pid: 7122 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129227.856691:0:7124:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c3ce600/0x48868a4e43904fc9 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x22:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf337da1 expref: 18 pid: 7122 timeout: 273 lvb_type: 0 00000100:00100000:1.0:1746129227.856703:0:7124:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095115180 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:7124:1830949051535360:192.168.204.31@tcp:104: 00000100:00100000:1.0:1746129227.856764:0:7124:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a840e900 going to sleep for 11 seconds 00000100:00100000:2.0:1746129227.859014:0:7124:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095115180 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:7124:1830949051535360:192.168.204.31@tcp:104: 00010000:00010000:2.0:1746129227.859108:0:7124:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88012c840200/0x48868a4e43904fec lrc: 3/0,1 mode: --/EX res: [0x200000401:0x22:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7124 initiator: MDT0 00000100:00100000:1.0:1746129227.860575:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129227.860875:0:7109:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949046487552 00000100:00100000:0.0:1746129227.860881:0:7109:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949046487552 00010000:00010000:0.0:1746129227.860907:0:7109:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009c3ce600/0x48868a4e43904fc9 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x22:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf337da1 expref: 19 pid: 7122 timeout: 273 lvb_type: 0 00000100:00100000:0.0:1746129227.860939:0:7109:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 207 00000100:00100000:0.0:1746129227.860946:0:7109:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095117480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f39d518f-facf-4547-b099-7a2592d93d98+19:1962:x1830949046487552:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746129227.860955:0:7109:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746129227.860959:0:7109:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009c3ce600/0x48868a4e43904fc9 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x22:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf337da1 expref: 19 pid: 7122 timeout: 273 lvb_type: 0 00010000:00010000:0.0:1746129227.860968:0:7109:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009c3ce600/0x48868a4e43904fc9 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x22:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf337da1 expref: 19 pid: 7122 timeout: 273 lvb_type: 0 00010000:00010000:0.0:1746129227.860984:0:7109:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c3ce600/0x48868a4e43904fc9 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x22:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf337da1 expref: 19 pid: 7122 timeout: 273 lvb_type: 0 00010000:00010000:0.0:1746129227.860995:0:7109:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x22:0x0].0x0 (ffff880094409000) 00010000:00010000:0.0:1746129227.860999:0:7109:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88012c840200/0x48868a4e43904fec lrc: 3/0,1 mode: --/EX res: [0x200000401:0x22:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7124 initiator: MDT0 00010000:00010000:0.0:1746129227.861006:0:7109:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012c840200/0x48868a4e43904fec lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x22:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 7124 initiator: MDT0 00010000:00010000:0.0:1746129227.861011:0:7109:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012c840200/0x48868a4e43904fec lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x22:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 7124 initiator: MDT0 00010000:00010000:0.0:1746129227.861918:0:7109:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746129227.861953:0:7109:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095117480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f39d518f-facf-4547-b099-7a2592d93d98+18:1962:x1830949046487552:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 1007us (1380us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129227.861970:0:7109:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 207 00010000:00010000:0.0:1746129227.861989:0:7124:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88012c840200/0x48868a4e43904fec lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x22:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7124 initiator: MDT0 00010000:00010000:0.0:1746129227.861995:0:7124:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012c840200/0x48868a4e43904fec lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x22:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7124 initiator: MDT0 00000040:00080000:0.0:1746129227.862413:0:7124:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x3:0x0].13, 88 off9312 00000004:00080000:0.0:1746129227.862418:0:7124:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 173920569704ns, next at 0ns, rc = 0 00000040:00080000:0.0:1746129227.863528:0:7124:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x6:0x0].14, 88 off9352 00000004:00080000:0.0:1746129227.863534:0:7124:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 173921686052ns, next at 155720060341ns, rc = 0 00000001:00080000:1.0:1746129227.868362:0:8512:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 4294967347 is committed 00000001:00080000:1.0:1746129227.868371:0:8512:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 4294967350 is committed 00000001:00080000:1.0:1746129227.868376:0:8512:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 4294967348 is committed 00000001:00080000:1.0:1746129227.868379:0:8512:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 4294967349 is committed 00000001:00080000:0.0:1746129227.891480:0:7171:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967674 is committed 00000004:00080000:0.0:1746129227.891487:0:7171:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 16 committed 00000004:00080000:0.0:1746129227.891493:0:7171:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 13 committed 00000004:00010000:1.0:1746129227.891501:0:7124:0:(mdt_handler.c:4446:mdt_save_lock()) ### save lock request ffff8800acd05c50 reply state ffff88009b5e4800 transno 4294967674 ns: mdt-lustre-MDT0000_UUID lock: ffff88012c840200/0x48868a4e43904fec lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x22:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7124 initiator: MDT0 00000100:00100000:1.0:1746129227.891510:0:7124:0:(service.c:173:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1746129227.891519:0:7124:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x22:0x0].0x0 (ffff880094409000) 00010000:00010000:1.0:1746129227.891521:0:7124:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1746129227.891528:0:7124:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009b9b1000/0x48868a4e43904fad lrc: 0/0,0 mode: --/PW res: [0x200000401:0x22:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf337d9a expref: 16 pid: 12160 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746129227.891569:0:3298:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b189500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3298:1830949051535488:0@lo:2:osp-syn-0-0.0 00010000:00080000:1.0:1746129227.891605:0:7124:0:(ldlm_lib.c:3369:target_send_reply()) Schedule reply immediately 00000100:00100000:2.0:1746129227.891610:0:3298:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746129227.891614:0:7124:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800acd05c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f39d518f-facf-4547-b099-7a2592d93d98+16:14440:x1830949046487424:12345-192.168.204.31@tcp:35:lfs.0 Request processed in 35237us (35327us total) trans 4294967674 rc 0/0 00000100:00100000:1.0:1746129227.891622:0:7124:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 233 00000100:00100000:2.0:1746129227.891633:0:3298:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1746129227.891638:0:3298:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135712d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3298:1830949051535616:0@lo:2:osp-syn-1-0.0 00010000:00010000:3.0:1746129227.891650:0:3283:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88012c840200/0x48868a4e43904fec lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x22:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7124 initiator: MDT0 00000100:00100000:2.0:1746129227.891652:0:3298:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1746129227.891657:0:3283:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012c840200/0x48868a4e43904fec lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x22:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7124 initiator: MDT0 00010000:00010000:3.0:1746129227.891663:0:3283:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012c840200/0x48868a4e43904fec lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x22:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7124 initiator: MDT0 00010000:00010000:3.0:1746129227.891668:0:3283:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012c840200 already unused, calling callback (ffffffffa1371690) 00010000:00010000:3.0:1746129227.891672:0:3283:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012c840200/0x48868a4e43904fec lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x22:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7124 initiator: MDT0 00010000:00010000:3.0:1746129227.891677:0:3283:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012c840200/0x48868a4e43904fec lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x22:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7124 initiator: MDT0 00000100:00100000:2.0:1746129227.891677:0:8435:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051535488 00000100:00100000:2.0:1746129227.891683:0:8435:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051535488 00010000:00010000:3.0:1746129227.891688:0:3283:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x22:0x0].0x0 (ffff880094409000) 00010000:00010000:3.0:1746129227.891690:0:3283:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1746129227.891693:0:3283:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012c840200/0x48868a4e43904fec lrc: 2/0,0 mode: --/EX res: [0x200000401:0x22:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7124 initiator: MDT0 00010000:00010000:3.0:1746129227.891697:0:3283:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012c840200/0x48868a4e43904fec lrc: 0/0,0 mode: --/EX res: [0x200000401:0x22:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7124 initiator: MDT0 00000100:00100000:2.0:1746129227.891703:0:8435:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051535616 00000100:00100000:2.0:1746129227.891704:0:8435:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051535616 00000100:00100000:2.0:1746129227.891716:0:8435:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 235 00000100:00100000:2.0:1746129227.891721:0:8435:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b188700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3298:x1830949051535488:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746129227.891757:0:8437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 236 00000100:00100000:0.0:1746129227.891764:0:8437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b189880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3298:x1830949051535616:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:2.0:1746129227.891896:0:8435:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x1e:0x0] updating lvb size from disk: 159 -> 159 00002000:00010000:2.0:1746129227.891899:0:8435:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x1e:0x0] updating lvb mtime from disk: 1746129228 -> 1746129228 00002000:00010000:2.0:1746129227.891901:0:8435:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x1e:0x0] updating lvb atime from disk: 1746129228 -> 1746129228 00002000:00010000:2.0:1746129227.891903:0:8435:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x1e:0x0] updating lvb ctime from disk: 1746129228 -> 1746129228 00002000:00010000:2.0:1746129227.891904:0:8435:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x1e:0x0] updating lvb blocks from disk: 11 -> 11 00000100:00100000:2.0:1746129227.891924:0:8435:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b188700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3298:x1830949051535488:12345-0@lo:2:osp-syn-0-0.0 Request processed in 204us (314us total) trans 4294967352 rc 0/0 00000100:00100000:2.0:1746129227.891930:0:8435:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 235 00000100:00100000:2.0:1746129227.891962:0:3298:0:(client.c:2927:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967350 gen 2 00000004:00080000:2.0:1746129227.891966:0:3298:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012ba38e00, transno 4294967347 00000100:00100000:0.0:1746129227.891968:0:8437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b189880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+8:3298:x1830949051535616:12345-0@lo:2:osp-syn-1-0.0 Request processed in 205us (315us total) trans 4294967342 rc 0/0 00000100:00100000:0.0:1746129227.891974:0:8437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 236 00000004:00080000:2.0:1746129227.892015:0:3298:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880095115500, transno 4294967350 00000100:00100000:2.0:1746129227.892022:0:3298:0:(client.c:2971:ptlrpc_free_committed()) @@@ stopping search req@ffff88012b189500 x1830949051535488/t4294967352(4294967352) o2->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 440/432 e 0 to 0 dl 1746129243 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 00000004:00080000:2.0:1746129227.892030:0:3298:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012b189500/2, rc 0, transno 4294967352 00000100:00100000:2.0:1746129227.892034:0:3298:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b189500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3298:1830949051535488:0@lo:2:osp-syn-0-0.0 00000004:00080000:2.0:1746129227.892047:0:3298:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880135712d80/2, rc 0, transno 4294967342 00000100:00100000:2.0:1746129227.892049:0:3298:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135712d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3298:1830949051535616:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746129227.897328:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129227.897372:0:12160:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949046487680 00000100:00100000:0.0:1746129227.897380:0:12160:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949046487680 00000100:00100000:0.0:1746129227.897416:0:12160:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 983 00000100:00100000:0.0:1746129227.897422:0:12160:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095115880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f39d518f-facf-4547-b099-7a2592d93d98+15:14440:x1830949046487680:12345-192.168.204.31@tcp:101:lfs.0 00010000:00010000:0.0:1746129227.897440:0:12160:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129227.897455:0:12160:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012b7e6800/0x48868a4e43904ff3 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x22:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf337db6 expref: -99 pid: 12160 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129227.897496:0:12160:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012b7e6800/0x48868a4e43904ff3 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x22:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf337db6 expref: 16 pid: 12160 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129227.897516:0:12160:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012b7e6800/0x48868a4e43904ff3 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x22:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf337db6 expref: 16 pid: 12160 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129227.897529:0:12160:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x22:0x0].0x0 (ffff880093907a00) 00010000:00010000:0.0:1746129227.897532:0:12160:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1746129227.897534:0:12160:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012b7e6800, rc 0) 00000100:00100000:0.0:1746129227.897570:0:12160:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095115880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f39d518f-facf-4547-b099-7a2592d93d98+16:14440:x1830949046487680:12345-192.168.204.31@tcp:101:lfs.0 Request processed in 148us (248us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129227.897576:0:12160:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 983 00000100:00100000:1.0:1746129227.899583:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129227.899637:0:7124:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949046487936 00000100:00100000:2.0:1746129227.899643:0:7124:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949046487936 00000100:00100000:2.0:1746129227.899681:0:7124:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 234 00000100:00100000:2.0:1746129227.899687:0:7124:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095114380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f39d518f-facf-4547-b099-7a2592d93d98+16:14440:x1830949046487936:12345-192.168.204.31@tcp:35:lfs.0 00000100:00100000:2.0:1746129227.899971:0:7124:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095114380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f39d518f-facf-4547-b099-7a2592d93d98+17:14440:x1830949046487936:12345-192.168.204.31@tcp:35:lfs.0 Request processed in 283us (393us total) trans 4294967675 rc 0/0 00000100:00100000:2.0:1746129227.899977:0:7124:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 234 00000100:00100000:0.0:1746129228.661995:0:3299:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800b1bc1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3299:1830949051536128:0@lo:400:kworker.0 00000100:00100000:0.0:1746129228.662058:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746129228.662102:0:3299:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1746129228.662107:0:3299:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800b1bc1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3299:1830949051536000:0@lo:400:kworker.0 00000100:00100000:0.0:1746129228.662126:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746129228.662158:0:8437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051536128 00000100:00100000:0.0:1746129228.662164:0:8437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051536128 00000100:00100000:0.0:1746129228.662192:0:8437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1746129228.662197:0:8437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b027800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3299:x1830949051536128:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1746129228.662231:0:8437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b027800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3299:x1830949051536128:12345-0@lo:400:kworker.0 Request processed in 34us (186us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129228.662237:0:8437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1746129228.662264:0:3299:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800b1bc1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3299:1830949051536128:0@lo:400:kworker.0 00000100:00100000:2.0:1746129228.662354:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800b1bc0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7ea7f7eb-2f74-477e-bfed-16dc08365411:3296:1830949051535744:0@lo:400:kworker.0 00000100:00100000:2.0:1746129228.662378:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746129228.662393:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800b1bc1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3296:1830949051536256:0@lo:400:kworker.0 00000100:00100000:2.0:1746129228.662407:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746129228.662419:0:3296:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1746129228.662423:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800b1bc1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3296:1830949051535872:0@lo:400:kworker.0 00000100:00100000:2.0:1746129228.662436:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746129228.662444:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800b1bc3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3296:1830949051536384:0@lo:400:kworker.0 00000100:00100000:2.0:1746129228.662457:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746129228.662481:0:7122:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051536000 00000100:00100000:2.0:1746129228.662484:0:7122:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051536000 00000100:00100000:2.0:1746129228.662506:0:7122:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051536256 00000100:00100000:2.0:1746129228.662508:0:7122:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051536256 00000100:00100000:2.0:1746129228.662517:0:7122:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051535872 00000100:00100000:2.0:1746129228.662519:0:7122:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051535872 00000100:00100000:2.0:1746129228.662529:0:7122:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:2.0:1746129228.662533:0:7122:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b025180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3299:x1830949051536000:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1746129228.662566:0:7122:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b025180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3299:x1830949051536000:12345-0@lo:400:kworker.0 Request processed in 32us (439us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129228.662571:0:7122:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:2.0:1746129228.662580:0:7122:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:2.0:1746129228.662583:0:7122:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b189c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3296:x1830949051536256:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1746129228.662603:0:7122:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b189c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3296:x1830949051536256:12345-0@lo:400:kworker.0 Request processed in 19us (195us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129228.662607:0:7122:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:2.0:1746129228.662614:0:7122:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:2.0:1746129228.662617:0:7122:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b8e4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3296:x1830949051535872:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1746129228.662634:0:7122:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b8e4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3296:x1830949051535872:12345-0@lo:400:kworker.0 Request processed in 16us (197us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129228.662638:0:7122:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00080000:2.0:1746129228.662649:0:7118:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1746129228.662663:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800b1bc1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3296:1830949051535872:0@lo:400:kworker.0 00000100:00100000:2.0:1746129228.662670:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800b1bc1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3296:1830949051536256:0@lo:400:kworker.0 00000100:00100000:3.0:1746129228.662820:0:7116:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051535744 00000100:00100000:3.0:1746129228.662823:0:7116:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051535744 00000100:00100000:3.0:1746129228.662843:0:7116:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 235 00000100:00100000:3.0:1746129228.662863:0:7116:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b4e79450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7ea7f7eb-2f74-477e-bfed-16dc08365411+18:3296:x1830949051535744:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1746129228.662890:0:7116:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b4e79450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7ea7f7eb-2f74-477e-bfed-16dc08365411+18:3296:x1830949051535744:12345-0@lo:400:kworker.0 Request processed in 28us (512us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129228.662900:0:7116:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 235 00000100:00100000:2.0:1746129228.662960:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800b1bc0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7ea7f7eb-2f74-477e-bfed-16dc08365411:3296:1830949051535744:0@lo:400:kworker.0 00000100:00100000:0.0:1746129228.663009:0:8436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051536384 00000100:00100000:0.0:1746129228.663013:0:8436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051536384 00000100:00100000:0.0:1746129228.663029:0:8436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1746129228.663040:0:8436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b8e6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+8:3296:x1830949051536384:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1746129228.663078:0:8436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b8e6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+8:3296:x1830949051536384:12345-0@lo:400:kworker.0 Request processed in 39us (620us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129228.663083:0:8436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1746129228.663102:0:3299:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800b1bc1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3299:1830949051536000:0@lo:400:kworker.0 00000100:00100000:3.0:1746129228.663152:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800b1bc3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3296:1830949051536384:0@lo:400:kworker.0 00000100:00100000:1.0:1746129228.692997:0:3299:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1746129228.693012:0:3299:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b024a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3299:1830949051536512:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1746129228.693069:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746129228.693151:0:8439:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949051536512 00000100:00100000:3.0:1746129228.693157:0:8439:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949051536512 00000100:00100000:3.0:1746129228.693192:0:8439:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1746129228.693199:0:8439:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095115f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+8:3299:x1830949051536512:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1746129228.693226:0:8439:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 45809664 pending 0 free 3858759680 avail 3856662528 00000100:00100000:3.0:1746129228.693257:0:8439:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095115f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+8:3299:x1830949051536512:12345-0@lo:13:osp-pre-1-0.0 Request processed in 59us (188us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129228.693262:0:8439:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1746129228.693280:0:3299:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b024a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3299:1830949051536512:0@lo:13:osp-pre-1-0.0 00000001:02000400:3.0:1746129228.695020:0:18361:0:(debug.c:792:libcfs_debug_mark_buffer()) DEBUG MARKER: sanity-flr test_0j: @@@@@@ FAIL: resync /mnt/lustre/f0j.sanity-flr failed 00010000:00010000:3.0:1746129228.766025:0:7110:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) Debug log: 1180 lines, 1180 kept, 0 dropped, 0 bad.