00010000:00010000:2.0F:1715208111.838464:0:18958:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0F:1715208111.982073:0:3208:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.38@tcp (source: 12345-192.168.202.38@tcp) 00000100:00100000:3.0F:1715208111.982185:0:6997:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798523503951168 00000100:00100000:3.0:1715208111.982202:0:6997:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798523503951168 00000100:00100000:3.0:1715208111.982254:0:6997:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.38@tcp, seq: 408 00000100:00100000:3.0:1715208111.982261:0:6997:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008df95880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cbae74da-7571-45ad-b971-0e0378bbd4e4+44:20567:x1798523503951168:12345-192.168.202.38@tcp:60:lhsmtool_posix.0 00000100:00100000:3.0:1715208111.982371:0:6997:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008df95880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cbae74da-7571-45ad-b971-0e0378bbd4e4+44:20567:x1798523503951168:12345-192.168.202.38@tcp:60:lhsmtool_posix.0 Request processed in 110us (306us total) trans 0 rc 0/0 00000100:00100000:3.0:1715208111.982378:0:6997:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.38@tcp, seq: 408 00000100:00100000:0.0:1715208111.983666:0:3209:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.38@tcp (source: 12345-192.168.202.38@tcp) 00000100:00100000:2.0:1715208111.983756:0:13448:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798523503951296 00000100:00100000:2.0:1715208111.983767:0:13448:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798523503951296 00000100:00100000:2.0:1715208111.983821:0:13448:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.38@tcp, seq: 87 00000100:00100000:2.0:1715208111.983832:0:13448:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012bdda050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:cbae74da-7571-45ad-b971-0e0378bbd4e4+44:20567:x1798523503951296:12345-192.168.202.38@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1715208111.984143:0:13448:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012bdda050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:cbae74da-7571-45ad-b971-0e0378bbd4e4+45:20567:x1798523503951296:12345-192.168.202.38@tcp:35:lhsmtool_posix.0 Request processed in 309us (481us total) trans 4294967504 rc 0/0 00000100:00100000:2.0:1715208111.984157:0:13448:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.38@tcp, seq: 87 00000001:00080000:2.0:1715208112.155093:0:7244:0:(tgt_lastrcvd.c:969:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967504 is committed 00000100:00100000:0.0:1715208112.286435:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.38@tcp (source: 12345-192.168.202.38@tcp) 00000100:00100000:0.0:1715208112.286523:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.38@tcp (source: 12345-192.168.202.38@tcp) 00000100:00100000:3.0:1715208112.286559:0:9149:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798523503951424 00000100:00100000:3.0:1715208112.286572:0:9149:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798523503951424 00000100:00080000:0.0:1715208112.286601:0:6994:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 older than 1715208082 00000100:00100000:3.0:1715208112.286623:0:9149:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.38@tcp, seq: 1079 00000100:00100000:3.0:1715208112.286631:0:9149:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008df95c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:cbae74da-7571-45ad-b971-0e0378bbd4e4+12:1956:x1798523503951424:12345-192.168.202.38@tcp:400:kworker.0 00000100:00100000:2.0:1715208112.286642:0:6992:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798523503951360 00000100:00100000:2.0:1715208112.286651:0:6992:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798523503951360 00000100:00080000:0.0:1715208112.286707:0:6994:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd MGS older than 1715208082 00000100:00100000:2.0:1715208112.286710:0:6992:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.38@tcp, seq: 1349 00000100:00100000:2.0:1715208112.286717:0:6992:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cb15050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ff645b43-0d7b-4a37-b9cc-6ac8f8d65c0d+12:1957:x1798523503951360:12345-192.168.202.38@tcp:400:kworker.0 00000100:00100000:3.0:1715208112.286722:0:9149:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008df95c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:cbae74da-7571-45ad-b971-0e0378bbd4e4+12:1956:x1798523503951424:12345-192.168.202.38@tcp:400:kworker.0 Request processed in 91us (297us total) trans 0 rc 0/0 00000100:00100000:3.0:1715208112.286731:0:9149:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.38@tcp, seq: 1079 00000100:00100000:2.0:1715208112.286758:0:6992:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cb15050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ff645b43-0d7b-4a37-b9cc-6ac8f8d65c0d+12:1957:x1798523503951360:12345-192.168.202.38@tcp:400:kworker.0 Request processed in 40us (235us total) trans 0 rc 0/0 00000100:00100000:2.0:1715208112.286765:0:6992:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.38@tcp, seq: 1349 00010000:00010000:2.0:1715208112.840461:0:6987:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0F:1715208113.842404:0:8591:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1715208114.844422:0:6986:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1715208115.084448:0:3217:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008df95f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3217:1798523508215232:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1715208115.084540:0:3217:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1715208115.084568:0:8579:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798523508215232 00000100:00100000:3.0:1715208115.084579:0:8579:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798523508215232 00000100:00080000:0.0:1715208115.084632:0:6994:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 older than 1715208085 00000100:00100000:3.0:1715208115.084640:0:8579:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 965 00000100:00100000:3.0:1715208115.084646:0:8579:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880130ce7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3217:x1798523508215232:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1715208115.084685:0:8579:0:(ofd_obd.c:743:ofd_statfs()) blocks cached 0 granted 54460416 pending 0 free 3851419648 avail 3849322496 00000100:00100000:3.0:1715208115.084742:0:8579:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880130ce7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3217:x1798523508215232:12345-0@lo:13:osp-pre-0-0.0 Request processed in 96us (202us total) trans 0 rc 0/0 00000100:00100000:3.0:1715208115.084750:0:8579:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 965 00000100:00100000:2.0:1715208115.084787:0:3217:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008df95f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3217:1798523508215232:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1715208115.292471:0:3218:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800902a3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:47336e3e-5c2f-4892-9b72-90c87ec36b26:3218:1798523508215296:0@lo:400:kworker.0 00000100:00100000:2.0:1715208115.292489:0:3217:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800902a0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3217:1798523508215488:0@lo:400:kworker.0 00000100:00100000:2.0:1715208115.292542:0:3217:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1715208115.292548:0:3218:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1715208115.292575:0:3217:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1715208115.292581:0:3217:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800902a2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3217:1798523508215552:0@lo:400:kworker.0 00000100:00100000:3.0:1715208115.292589:0:3215:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008db10700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3215:1798523508215360:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1715208115.292598:0:3217:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1715208115.292622:0:3215:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1715208115.292653:0:3215:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800902a1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3215:1798523508215616:0@lo:400:kworker.0 00000100:00100000:2.0:1715208115.292665:0:6997:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798523508215488 00000100:00100000:2.0:1715208115.292675:0:6997:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798523508215488 00000100:00100000:3.0:1715208115.292678:0:3215:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1715208115.292688:0:8623:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798523508215552 00000100:00100000:0.0:1715208115.292694:0:8623:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798523508215552 00000100:00100000:3.0:1715208115.292695:0:3215:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1715208115.292703:0:3215:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800902a2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3215:1798523508215424:0@lo:400:kworker.0 00000100:00100000:3.0:1715208115.292726:0:3215:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1715208115.292729:0:6997:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2045 00000100:00100000:2.0:1715208115.292737:0:6997:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800902a1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3217:x1798523508215488:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1715208115.292755:0:8623:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798523508215424 00000100:00100000:0.0:1715208115.292759:0:8623:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798523508215424 00000100:00100000:1.0:1715208115.292775:0:6998:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2046 00000100:00100000:1.0:1715208115.292784:0:6998:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800902a0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3217:x1798523508215552:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1715208115.292785:0:8579:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798523508215360 00000100:00100000:3.0:1715208115.292792:0:8579:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798523508215360 00000100:00100000:2.0:1715208115.292800:0:6997:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800902a1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3217:x1798523508215488:12345-0@lo:400:kworker.0 Request processed in 62us (256us total) trans 0 rc 0/0 00000100:00100000:0.0:1715208115.292800:0:8623:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2047 00000100:00100000:0.0:1715208115.292807:0:8623:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008db13800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3215:x1798523508215424:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1715208115.292810:0:6997:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2045 00000100:00100000:3.0:1715208115.292827:0:8579:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 966 00000100:00100000:1.0:1715208115.292833:0:6998:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800902a0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3217:x1798523508215552:12345-0@lo:400:kworker.0 Request processed in 51us (234us total) trans 0 rc 0/0 00000100:00100000:3.0:1715208115.292835:0:8579:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008db12680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3215:x1798523508215360:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1715208115.292840:0:6998:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2046 00000100:00100000:2.0:1715208115.292843:0:6992:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798523508215296 00000100:00100000:2.0:1715208115.292850:0:6992:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798523508215296 00000100:00100000:0.0:1715208115.292862:0:8623:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008db13800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3215:x1798523508215424:12345-0@lo:400:kworker.0 Request processed in 54us (134us total) trans 0 rc 0/0 00002000:00000024:3.0:1715208115.292870:0:8579:0:(ofd_obd.c:743:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3857711104 avail 3855613952 00000100:00100000:0.0:1715208115.292872:0:8623:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2047 00000100:00100000:2.0:1715208115.292895:0:6992:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1350 00000100:00080000:0.0:1715208115.292896:0:6994:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd MGS older than 1715208085 00000100:00100000:2.0:1715208115.292901:0:6992:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cb14c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:47336e3e-5c2f-4892-9b72-90c87ec36b26+18:3218:x1798523508215296:12345-0@lo:400:kworker.0 00000100:00080000:0.0:1715208115.292901:0:6994:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 older than 1715208085 00000100:00080000:0.0:1715208115.292905:0:6994:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 older than 1715208085 00000100:00100000:3.0:1715208115.292913:0:8579:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008db12680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3215:x1798523508215360:12345-0@lo:13:osp-pre-1-0.0 Request processed in 78us (291us total) trans 0 rc 0/0 00000100:00100000:3.0:1715208115.292924:0:8579:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 966 00000100:00100000:2.0:1715208115.292947:0:6992:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cb14c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:47336e3e-5c2f-4892-9b72-90c87ec36b26+18:3218:x1798523508215296:12345-0@lo:400:kworker.0 Request processed in 44us (399us total) trans 0 rc 0/0 00000100:00100000:3.0:1715208115.292953:0:9149:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798523508215616 00000100:00100000:2.0:1715208115.292957:0:6992:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1350 00000100:00100000:3.0:1715208115.292958:0:9149:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798523508215616 00000100:00100000:3.0:1715208115.292985:0:9149:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1080 00000100:00100000:3.0:1715208115.292992:0:9149:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008db12a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3215:x1798523508215616:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1715208115.293007:0:3218:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff8800902a3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:47336e3e-5c2f-4892-9b72-90c87ec36b26:3218:1798523508215296:0@lo:400:kworker.0 00000100:00100000:3.0:1715208115.293035:0:9149:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008db12a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3215:x1798523508215616:12345-0@lo:400:kworker.0 Request processed in 42us (355us total) trans 0 rc 0/0 00000100:00100000:2.0:1715208115.293044:0:3217:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff8800902a2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3217:1798523508215552:0@lo:400:kworker.0 00000100:00100000:3.0:1715208115.293045:0:9149:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1080 00000100:00100000:2.0:1715208115.293057:0:3217:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff8800902a0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3217:1798523508215488:0@lo:400:kworker.0 00000100:00100000:3.0:1715208115.293083:0:3215:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff8800902a2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3215:1798523508215424:0@lo:400:kworker.0 00000100:00100000:3.0:1715208115.293105:0:3215:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008db10700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3215:1798523508215360:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1715208115.293117:0:3215:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff8800902a1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3215:1798523508215616:0@lo:400:kworker.0 00010000:00010000:2.0:1715208115.846500:0:10149:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1715208116.839967:0:28664:0:(debug.c:705:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-hsm test 25b: Restore lost file (HS_LOST flag) after release ========================================================== 18:41:56 (1715208116) 00010000:00010000:2.0:1715208116.848480:0:18958:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1715208116.952012:0:3209:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.38@tcp (source: 12345-192.168.202.38@tcp) 00000100:00100000:2.0:1715208116.952140:0:11480:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798523503951616 00000100:00100000:2.0:1715208116.952154:0:11480:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798523503951616 00000100:00080000:0.0:1715208116.952220:0:6994:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 older than 1715208086 00000100:00100000:2.0:1715208116.952232:0:11480:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.38@tcp, seq: 409 00000100:00100000:2.0:1715208116.952242:0:11480:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008df95180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:cbae74da-7571-45ad-b971-0e0378bbd4e4+43:21508:x1798523503951616:12345-192.168.202.38@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1715208116.952304:0:11480:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1715208116.952325:0:11480:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008d846f40/0x8c55e4ad37f6705a lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbbeffb005ec3e870 expref: -99 pid: 11480 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715208116.952502:0:11480:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008d846d00/0x8c55e4ad37f67061 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11480 initiator: MDT0 00010000:00010000:2.0:1715208116.952517:0:11480:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008d846d00/0x8c55e4ad37f67061 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11480 initiator: MDT0 00010000:00010000:2.0:1715208116.952530:0:11480:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008d846d00/0x8c55e4ad37f67061 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11480 initiator: MDT0 00010000:00010000:2.0:1715208116.952545:0:11480:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008d8461c0/0x8c55e4ad37f67068 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x646966 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11480 initiator: MDT0 00010000:00010000:2.0:1715208116.952552:0:11480:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008d8461c0/0x8c55e4ad37f67068 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x646966 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11480 initiator: MDT0 00010000:00010000:2.0:1715208116.952562:0:11480:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008d8461c0/0x8c55e4ad37f67068 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x646966 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11480 initiator: MDT0 00000004:00200000:2.0:1715208116.952685:0:11480:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 10752 00010000:00010000:2.0:1715208116.952855:0:11480:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008d846d00/0x8c55e4ad37f67061 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11480 initiator: MDT0 00010000:00010000:2.0:1715208116.952864:0:11480:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008d846d00/0x8c55e4ad37f67061 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 11480 initiator: MDT0 00010000:00010000:2.0:1715208116.952872:0:11480:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008d846d00/0x8c55e4ad37f67061 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11480 initiator: MDT0 00010000:00010000:2.0:1715208116.952877:0:11480:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88008d846d00 already unused, calling callback (ffffffffa13a3730) 00010000:00010000:2.0:1715208116.952881:0:11480:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008d846d00/0x8c55e4ad37f67061 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11480 initiator: MDT0 00010000:00010000:2.0:1715208116.952889:0:11480:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008d846d00/0x8c55e4ad37f67061 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 11480 initiator: MDT0 00010000:00010000:2.0:1715208116.952910:0:11480:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff88008e524300) 00010000:00010000:2.0:1715208116.952914:0:11480:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1715208116.952918:0:11480:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008d846d00/0x8c55e4ad37f67061 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11480 initiator: MDT0 00010000:00010000:2.0:1715208116.952924:0:11480:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008d846d00/0x8c55e4ad37f67061 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11480 initiator: MDT0 00010000:00010000:2.0:1715208116.952957:0:11480:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008d8461c0/0x8c55e4ad37f67068 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x646966 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11480 initiator: MDT0 00010000:00010000:2.0:1715208116.952963:0:11480:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008d8461c0/0x8c55e4ad37f67068 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x646966 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11480 initiator: MDT0 00010000:00010000:2.0:1715208116.952969:0:11480:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008d8461c0/0x8c55e4ad37f67068 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x646966 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11480 initiator: MDT0 00010000:00010000:2.0:1715208116.952974:0:11480:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88008d8461c0 already unused, calling callback (ffffffffa13a3730) 00010000:00010000:2.0:1715208116.952977:0:11480:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008d8461c0/0x8c55e4ad37f67068 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x646966 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11480 initiator: MDT0 00010000:00010000:2.0:1715208116.952982:0:11480:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008d8461c0/0x8c55e4ad37f67068 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x646966 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11480 initiator: MDT0 00010000:00010000:2.0:1715208116.952989:0:11480:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x646966 (ffff880135722200) 00010000:00010000:2.0:1715208116.952991:0:11480:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1715208116.952993:0:11480:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008d8461c0/0x8c55e4ad37f67068 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x646966 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11480 initiator: MDT0 00010000:00010000:2.0:1715208116.952999:0:11480:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008d8461c0/0x8c55e4ad37f67068 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x646966 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11480 initiator: MDT0 00010000:00010000:2.0:1715208116.953038:0:11480:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008d846f40/0x8c55e4ad37f6705a lrc: 1/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.38@tcp remote: 0xbbeffb005ec3e870 expref: 45 pid: 11480 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715208116.953054:0:11480:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008d846f40/0x8c55e4ad37f6705a lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.38@tcp remote: 0xbbeffb005ec3e870 expref: 45 pid: 11480 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715208116.953063:0:11480:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008d846f40, rc 0) 00000100:00100000:2.0:1715208116.953127:0:11480:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008df95180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:cbae74da-7571-45ad-b971-0e0378bbd4e4+44:21508:x1798523503951616:12345-192.168.202.38@tcp:101:lhsmtool_posix.0 Request processed in 885us (1125us total) trans 4294967505 rc 301/301 00000100:00100000:2.0:1715208116.953137:0:11480:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.38@tcp, seq: 409 00000100:00100000:0.0:1715208116.955313:0:3208:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.38@tcp (source: 12345-192.168.202.38@tcp) 00000100:00100000:3.0:1715208116.955433:0:11480:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798523503951680 00000100:00100000:3.0:1715208116.955468:0:11480:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798523503951680 00000100:00100000:3.0:1715208116.955515:0:11480:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.38@tcp, seq: 410 00000100:00100000:3.0:1715208116.955534:0:11480:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008df96a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:cbae74da-7571-45ad-b971-0e0378bbd4e4+44:21508:x1798523503951680:12345-192.168.202.38@tcp:59:lhsmtool_posix.0 00000100:00100000:3.0:1715208116.955613:0:11480:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008df96a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:cbae74da-7571-45ad-b971-0e0378bbd4e4+44:21508:x1798523503951680:12345-192.168.202.38@tcp:59:lhsmtool_posix.0 Request processed in 80us (346us total) trans 0 rc 0/0 00000100:00100000:3.0:1715208116.955621:0:11480:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.38@tcp, seq: 410 00000100:00100000:0.0:1715208116.968090:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.38@tcp (source: 12345-192.168.202.38@tcp) 00000100:00100000:3.0:1715208116.968208:0:11480:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798523503952000 00000100:00100000:3.0:1715208116.968217:0:11480:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798523503952000 00000100:00100000:3.0:1715208116.968268:0:11480:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.38@tcp, seq: 411 00000100:00100000:3.0:1715208116.968305:0:11480:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008df94a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:cbae74da-7571-45ad-b971-0e0378bbd4e4+44:21511:x1798523503952000:12345-192.168.202.38@tcp:101:rm.0 00010000:00010000:3.0:1715208116.968320:0:11480:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1715208116.968334:0:11480:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012ffd4480/0x8c55e4ad37f67076 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbbeffb005ec3e893 expref: -99 pid: 11480 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715208116.968377:0:11480:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012ffd5680/0x8c55e4ad37f6707d lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11480 initiator: MDT0 00010000:00010000:3.0:1715208116.968388:0:11480:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012ffd5680/0x8c55e4ad37f6707d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11480 initiator: MDT0 00010000:00010000:3.0:1715208116.968397:0:11480:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012ffd5680/0x8c55e4ad37f6707d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11480 initiator: MDT0 00010000:00010000:3.0:1715208116.968410:0:11480:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012ffd7a80/0x8c55e4ad37f67084 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x8332b9f6 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11480 initiator: MDT0 00010000:00010000:3.0:1715208116.968417:0:11480:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012ffd7a80/0x8c55e4ad37f67084 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x8332b9f6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11480 initiator: MDT0 00010000:00010000:3.0:1715208116.968424:0:11480:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012ffd7a80/0x8c55e4ad37f67084 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x8332b9f6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11480 initiator: MDT0 00010000:00010000:3.0:1715208116.968518:0:11480:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012ffd5680/0x8c55e4ad37f6707d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11480 initiator: MDT0 00010000:00010000:3.0:1715208116.968535:0:11480:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012ffd5680/0x8c55e4ad37f6707d lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 11480 initiator: MDT0 00010000:00010000:3.0:1715208116.968542:0:11480:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012ffd5680/0x8c55e4ad37f6707d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11480 initiator: MDT0 00010000:00010000:3.0:1715208116.968547:0:11480:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88012ffd5680 already unused, calling callback (ffffffffa13a3730) 00010000:00010000:3.0:1715208116.968551:0:11480:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012ffd5680/0x8c55e4ad37f6707d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11480 initiator: MDT0 00010000:00010000:3.0:1715208116.968557:0:11480:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012ffd5680/0x8c55e4ad37f6707d lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 11480 initiator: MDT0 00010000:00010000:3.0:1715208116.968568:0:11480:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800a68d3500) 00010000:00010000:3.0:1715208116.968571:0:11480:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1715208116.968574:0:11480:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012ffd5680/0x8c55e4ad37f6707d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11480 initiator: MDT0 00010000:00010000:3.0:1715208116.968580:0:11480:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012ffd5680/0x8c55e4ad37f6707d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11480 initiator: MDT0 00010000:00010000:3.0:1715208116.968609:0:11480:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012ffd7a80/0x8c55e4ad37f67084 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x8332b9f6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11480 initiator: MDT0 00010000:00010000:3.0:1715208116.968616:0:11480:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012ffd7a80/0x8c55e4ad37f67084 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x8332b9f6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11480 initiator: MDT0 00010000:00010000:3.0:1715208116.968621:0:11480:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012ffd7a80/0x8c55e4ad37f67084 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x8332b9f6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11480 initiator: MDT0 00010000:00010000:3.0:1715208116.968626:0:11480:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88012ffd7a80 already unused, calling callback (ffffffffa13a3730) 00010000:00010000:3.0:1715208116.968629:0:11480:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012ffd7a80/0x8c55e4ad37f67084 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x8332b9f6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11480 initiator: MDT0 00010000:00010000:3.0:1715208116.968645:0:11480:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012ffd7a80/0x8c55e4ad37f67084 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x8332b9f6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11480 initiator: MDT0 00010000:00010000:3.0:1715208116.968653:0:11480:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x8332b9f6 (ffff88008e4cca00) 00010000:00010000:3.0:1715208116.968655:0:11480:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1715208116.968658:0:11480:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012ffd7a80/0x8c55e4ad37f67084 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x8332b9f6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11480 initiator: MDT0 00010000:00010000:3.0:1715208116.968663:0:11480:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012ffd7a80/0x8c55e4ad37f67084 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x8332b9f6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11480 initiator: MDT0 00010000:00010000:3.0:1715208116.968709:0:11480:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012ffd4480/0x8c55e4ad37f67076 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.38@tcp remote: 0xbbeffb005ec3e893 expref: 45 pid: 11480 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715208116.968718:0:11480:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012ffd4480/0x8c55e4ad37f67076 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.38@tcp remote: 0xbbeffb005ec3e893 expref: 45 pid: 11480 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715208116.968726:0:11480:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012ffd4480, rc 0) 00000100:00100000:3.0:1715208116.968763:0:11480:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008df94a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:cbae74da-7571-45ad-b971-0e0378bbd4e4+44:21511:x1798523503952000:12345-192.168.202.38@tcp:101:rm.0 Request processed in 487us (682us total) trans 0 rc 301/301 00000100:00100000:3.0:1715208116.968772:0:11480:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.38@tcp, seq: 411 00000001:00080000:2.0:1715208117.154527:0:7244:0:(tgt_lastrcvd.c:969:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967505 is committed 00000040:00080000:3.0:1715208117.237472:0:14992:0:(llog.c:735:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1715208117.237480:0:14992:0:(llog_cat.c:796:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1715208117.237899:0:14992:0:(llog.c:792:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 1 00000040:00080000:3.0:1715208117.237911:0:14992:0:(llog.c:792:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1715208117.294395:0:3209:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.38@tcp (source: 12345-192.168.202.38@tcp) 00000100:00100000:0.0:1715208117.294463:0:3209:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.38@tcp (source: 12345-192.168.202.38@tcp) 00000100:00100000:2.0:1715208117.294510:0:6992:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798523503952064 00000100:00100000:2.0:1715208117.294522:0:6992:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798523503952064 00000100:00080000:0.0:1715208117.294576:0:6994:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd MGS older than 1715208087 00000100:00100000:3.0:1715208117.294578:0:9149:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798523503952128 00000100:00100000:2.0:1715208117.294583:0:6992:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.38@tcp, seq: 1351 00000100:00100000:3.0:1715208117.294586:0:9149:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798523503952128 00000100:00100000:2.0:1715208117.294591:0:6992:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cb14850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ff645b43-0d7b-4a37-b9cc-6ac8f8d65c0d+12:1957:x1798523503952064:12345-192.168.202.38@tcp:400:kworker.0 00000100:00080000:0.0:1715208117.294607:0:6994:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 older than 1715208087 00000100:00100000:3.0:1715208117.294624:0:9149:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.38@tcp, seq: 1081 00000100:00100000:3.0:1715208117.294631:0:9149:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008df94700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:cbae74da-7571-45ad-b971-0e0378bbd4e4+12:1956:x1798523503952128:12345-192.168.202.38@tcp:400:kworker.0 00000100:00100000:2.0:1715208117.294665:0:6992:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cb14850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ff645b43-0d7b-4a37-b9cc-6ac8f8d65c0d+12:1957:x1798523503952064:12345-192.168.202.38@tcp:400:kworker.0 Request processed in 72us (277us total) trans 0 rc 0/0 00000100:00100000:2.0:1715208117.294677:0:6992:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.38@tcp, seq: 1351 00000100:00100000:3.0:1715208117.294680:0:9149:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008df94700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:cbae74da-7571-45ad-b971-0e0378bbd4e4+12:1956:x1798523503952128:12345-192.168.202.38@tcp:400:kworker.0 Request processed in 48us (217us total) trans 0 rc 0/0 00000100:00100000:3.0:1715208117.294688:0:9149:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.38@tcp, seq: 1081 00000001:02000400:3.0:1715208117.495334:0:28746:0:(debug.c:705:libcfs_debug_mark_buffer()) DEBUG MARKER: sanity-hsm test_25b: @@@@@@ FAIL: cannot create /mnt/lustre2/d25b.sanity-hsm/f25b.sanity-hsm with cp, status=1 00010000:00010000:2.0:1715208117.850505:0:6987:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) Debug log: 217 lines, 217 kept, 0 dropped, 0 bad.