00010000:00010000:2.0F:1715208087.790493:0:6987:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0F:1715208088.143094:0:3209:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.38@tcp (source: 12345-192.168.202.38@tcp) 00000100:00100000:1.0:1715208088.143145:0:11480:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798523503947840 00000100:00100000:1.0:1715208088.143155:0:11480:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798523503947840 00000100:00100000:1.0:1715208088.143196:0:11480:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.38@tcp, seq: 398 00000100:00100000:1.0:1715208088.143204:0:11480:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880132aca680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:cbae74da-7571-45ad-b971-0e0378bbd4e4+43:16448:x1798523503947840:12345-192.168.202.38@tcp:60:lhsmtool_posix.0 00000100:00100000:1.0:1715208088.143328:0:11480:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880132aca680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:cbae74da-7571-45ad-b971-0e0378bbd4e4+43:16448:x1798523503947840:12345-192.168.202.38@tcp:60:lhsmtool_posix.0 Request processed in 122us (241us total) trans 0 rc 0/0 00000100:00100000:1.0:1715208088.143336:0:11480:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.38@tcp, seq: 398 00000100:00100000:1.0:1715208088.145237:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.38@tcp (source: 12345-192.168.202.38@tcp) 00000100:00100000:3.0F:1715208088.145356:0:13448:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798523503947968 00000100:00100000:3.0:1715208088.145375:0:13448:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798523503947968 00000100:00100000:3.0:1715208088.145411:0:13448:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.38@tcp, seq: 84 00000100:00100000:3.0:1715208088.145418:0:13448:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e6e1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:cbae74da-7571-45ad-b971-0e0378bbd4e4+43:16448:x1798523503947968:12345-192.168.202.38@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1715208088.145737:0:13448:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e6e1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:cbae74da-7571-45ad-b971-0e0378bbd4e4+44:16448:x1798523503947968:12345-192.168.202.38@tcp:35:lhsmtool_posix.0 Request processed in 317us (503us total) trans 4294967498 rc 0/0 00000100:00100000:3.0:1715208088.145747:0:13448:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.38@tcp, seq: 84 00010000:00010000:2.0:1715208088.792497:0:8591:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1715208089.794473:0:6986:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1715208090.044481:0:3217:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1715208090.044508:0:3217:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008e6e0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3217:1798523508212992:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1715208090.044588:0:3217:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0F:1715208090.044637:0:8579:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798523508212992 00000100:00100000:0.0:1715208090.044657:0:8579:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798523508212992 00000100:00080000:1.0:1715208090.044742:0:6994:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 older than 1715208060 00000100:00100000:0.0:1715208090.044751:0:8579:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 955 00000100:00100000:0.0:1715208090.044761:0:8579:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e6e0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3217:x1798523508212992:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1715208090.044807:0:8579:0:(ofd_obd.c:743:ofd_statfs()) blocks cached 0 granted 54460416 pending 0 free 3851419648 avail 3849322496 00000100:00100000:0.0:1715208090.044881:0:8579:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e6e0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3217:x1798523508212992:12345-0@lo:13:osp-pre-0-0.0 Request processed in 119us (293us total) trans 0 rc 0/0 00000100:00100000:0.0:1715208090.044893:0:8579:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 955 00000100:00100000:1.0:1715208090.044924:0:3217:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008e6e0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3217:1798523508212992:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1715208090.252503:0:3216:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008db13480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:47336e3e-5c2f-4892-9b72-90c87ec36b26:3216:1798523508213120:0@lo:400:kworker.0 00000100:00100000:0.0:1715208090.252503:0:3217:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008db11880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3217:1798523508213184:0@lo:400:kworker.0 00000100:00100000:3.0:1715208090.252508:0:3218:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008db12a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3218:1798523508213248:0@lo:400:kworker.0 00000100:00100000:2.0:1715208090.252568:0:3215:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88009c344700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3215:1798523508213056:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1715208090.252587:0:3216:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1715208090.252587:0:3217:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1715208090.252621:0:3216:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008db11f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3216:1798523508213376:0@lo:400:kworker.0 00000100:00100000:3.0:1715208090.252630:0:3218:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1715208090.252662:0:6992:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798523508213120 00000100:00100000:3.0:1715208090.252695:0:11480:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798523508213184 00000100:00100000:2.0:1715208090.252695:0:3215:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1715208090.252697:0:3216:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1715208090.252702:0:11480:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798523508213184 00000100:00100000:0.0:1715208090.252702:0:6992:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798523508213120 00000100:00100000:3.0:1715208090.252736:0:11480:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798523508213248 00000100:00100000:3.0:1715208090.252738:0:11480:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798523508213248 00000100:00080000:1.0:1715208090.252738:0:6994:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd MGS older than 1715208060 00000100:00100000:2.0:1715208090.252741:0:3215:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008db10000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3215:1798523508213312:0@lo:400:kworker.0 00000100:00080000:1.0:1715208090.252744:0:6994:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 older than 1715208060 00000100:00100000:0.0:1715208090.252749:0:6992:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1340 00000100:00100000:3.0:1715208090.252758:0:11480:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2028 00000100:00100000:0.0:1715208090.252758:0:6992:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d3b7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:47336e3e-5c2f-4892-9b72-90c87ec36b26+18:3216:x1798523508213120:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1715208090.252764:0:11480:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c344e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3217:x1798523508213184:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1715208090.252769:0:3215:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1715208090.252772:0:8623:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2029 00000100:00100000:1.0:1715208090.252779:0:8623:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008db10e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3218:x1798523508213248:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1715208090.252819:0:11480:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c344e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3217:x1798523508213184:12345-0@lo:400:kworker.0 Request processed in 55us (235us total) trans 0 rc 0/0 00000100:00100000:2.0:1715208090.252823:0:14590:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798523508213376 00000100:00100000:1.0:1715208090.252826:0:8623:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008db10e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3218:x1798523508213248:12345-0@lo:400:kworker.0 Request processed in 46us (196us total) trans 0 rc 0/0 00000100:00100000:0.0:1715208090.252826:0:6992:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d3b7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:47336e3e-5c2f-4892-9b72-90c87ec36b26+18:3216:x1798523508213120:12345-0@lo:400:kworker.0 Request processed in 68us (240us total) trans 0 rc 0/0 00000100:00100000:3.0:1715208090.252827:0:11480:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2028 00000100:00100000:2.0:1715208090.252833:0:14590:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798523508213376 00000100:00100000:1.0:1715208090.252837:0:8623:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2029 00000100:00100000:0.0:1715208090.252837:0:6992:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1340 00000100:00100000:3.0:1715208090.252842:0:11480:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798523508213312 00000100:00100000:3.0:1715208090.252845:0:11480:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798523508213312 00000100:00100000:3.0:1715208090.252862:0:11480:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2030 00000100:00100000:3.0:1715208090.252866:0:11480:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800902a0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3215:x1798523508213312:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1715208090.252883:0:14590:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1070 00000100:00100000:2.0:1715208090.252889:0:14590:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e6e0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3216:x1798523508213376:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1715208090.252900:0:11480:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800902a0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3215:x1798523508213312:12345-0@lo:400:kworker.0 Request processed in 33us (131us total) trans 0 rc 0/0 00000100:00100000:1.0:1715208090.252904:0:3218:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008db12a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3218:1798523508213248:0@lo:400:kworker.0 00000100:00100000:0.0:1715208090.252904:0:3217:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008db11880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3217:1798523508213184:0@lo:400:kworker.0 00000100:00100000:3.0:1715208090.252906:0:11480:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2030 00000100:00100000:1.0:1715208090.252944:0:3216:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008db13480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:47336e3e-5c2f-4892-9b72-90c87ec36b26:3216:1798523508213120:0@lo:400:kworker.0 00000100:00100000:3.0:1715208090.252947:0:8579:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798523508213056 00000100:00100000:2.0:1715208090.252948:0:14590:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e6e0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3216:x1798523508213376:12345-0@lo:400:kworker.0 Request processed in 58us (283us total) trans 0 rc 0/0 00000100:00100000:3.0:1715208090.252950:0:8579:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798523508213056 00000100:00100000:2.0:1715208090.252956:0:14590:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1070 00000100:00100000:1.0:1715208090.252964:0:3216:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008db11f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3216:1798523508213376:0@lo:400:kworker.0 00000100:00100000:3.0:1715208090.252970:0:8579:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 956 00000100:00080000:2.0:1715208090.252984:0:6994:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 older than 1715208060 00000100:00100000:3.0:1715208090.252985:0:8579:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800902a0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3215:x1798523508213056:12345-0@lo:13:osp-pre-1-0.0 00000100:00080000:2.0:1715208090.252988:0:6994:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 older than 1715208060 00002000:00000024:3.0:1715208090.253018:0:8579:0:(ofd_obd.c:743:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3857711104 avail 3855613952 00000100:00100000:2.0:1715208090.253019:0:3215:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008db10000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3215:1798523508213312:0@lo:400:kworker.0 00000100:00100000:3.0:1715208090.253056:0:8579:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800902a0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3215:x1798523508213056:12345-0@lo:13:osp-pre-1-0.0 Request processed in 71us (363us total) trans 0 rc 0/0 00000100:00100000:3.0:1715208090.253062:0:8579:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 956 00000100:00100000:2.0:1715208090.253085:0:3215:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88009c344700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3215:1798523508213056:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1715208090.796395:0:10149:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1715208091.798518:0:18958:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1715208092.154973:0:7244:0:(tgt_lastrcvd.c:969:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967498 is committed 00000100:00100000:0.0:1715208092.254839:0:3208:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.38@tcp (source: 12345-192.168.202.38@tcp) 00000100:00100000:0.0:1715208092.254884:0:3208:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.38@tcp (source: 12345-192.168.202.38@tcp) 00000100:00100000:0.0:1715208092.254951:0:3208:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.38@tcp (source: 12345-192.168.202.38@tcp) 00000100:00100000:3.0:1715208092.254978:0:6998:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798523503948096 00000100:00100000:1.0:1715208092.254978:0:6993:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798523503948032 00000100:00100000:0.0:1715208092.254980:0:9149:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798523503948160 00000100:00100000:3.0:1715208092.254989:0:6998:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798523503948096 00000100:00100000:1.0:1715208092.254990:0:6993:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798523503948032 00000100:00100000:0.0:1715208092.254990:0:9149:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798523503948160 00000100:00100000:3.0:1715208092.255051:0:6998:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.38@tcp, seq: 2031 00000100:00100000:1.0:1715208092.255051:0:6993:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.38@tcp, seq: 1341 00000100:00100000:0.0:1715208092.255051:0:9149:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.38@tcp, seq: 1071 00000100:00100000:3.0:1715208092.255059:0:6998:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c345880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cbae74da-7571-45ad-b971-0e0378bbd4e4+43:1956:x1798523503948096:12345-192.168.202.38@tcp:400:kworker.0 00000100:00100000:1.0:1715208092.255060:0:6993:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d3b7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ff645b43-0d7b-4a37-b9cc-6ac8f8d65c0d+12:1957:x1798523503948032:12345-192.168.202.38@tcp:400:kworker.0 00000100:00100000:0.0:1715208092.255060:0:9149:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c344700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:cbae74da-7571-45ad-b971-0e0378bbd4e4+12:1957:x1798523503948160:12345-192.168.202.38@tcp:400:kworker.0 00000100:00080000:2.0:1715208092.255094:0:6994:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd MGS older than 1715208062 00000100:00080000:2.0:1715208092.255102:0:6994:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 older than 1715208062 00000100:00080000:2.0:1715208092.255105:0:6994:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 older than 1715208062 00000100:00100000:1.0:1715208092.255129:0:6993:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d3b7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ff645b43-0d7b-4a37-b9cc-6ac8f8d65c0d+12:1957:x1798523503948032:12345-192.168.202.38@tcp:400:kworker.0 Request processed in 69us (244us total) trans 0 rc 0/0 00000100:00100000:0.0:1715208092.255129:0:9149:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c344700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:cbae74da-7571-45ad-b971-0e0378bbd4e4+12:1957:x1798523503948160:12345-192.168.202.38@tcp:400:kworker.0 Request processed in 69us (178us total) trans 0 rc 0/0 00000100:00100000:3.0:1715208092.255135:0:6998:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c345880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cbae74da-7571-45ad-b971-0e0378bbd4e4+43:1956:x1798523503948096:12345-192.168.202.38@tcp:400:kworker.0 Request processed in 77us (305us total) trans 0 rc 0/0 00000100:00100000:1.0:1715208092.255140:0:6993:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.38@tcp, seq: 1341 00000100:00100000:3.0:1715208092.255143:0:6998:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.38@tcp, seq: 2031 00000100:00100000:0.0:1715208092.255153:0:9149:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.38@tcp, seq: 1071 00010000:00010000:2.0:1715208092.800548:0:6987:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1715208093.279769:0:24801:0:(debug.c:705:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-hsm test 24f: root can archive, release, and restore tar files ========================================================== 18:41:32 (1715208092) 00000100:00100000:0.0:1715208093.392394:0:3209:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.38@tcp (source: 12345-192.168.202.38@tcp) 00000100:00100000:3.0:1715208093.392529:0:6998:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798523503948352 00000100:00100000:3.0:1715208093.392546:0:6998:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798523503948352 00000100:00100000:3.0:1715208093.392622:0:6998:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.38@tcp, seq: 399 00000100:00100000:3.0:1715208093.392633:0:6998:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c345500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cbae74da-7571-45ad-b971-0e0378bbd4e4+43:17816:x1798523503948352:12345-192.168.202.38@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1715208093.392689:0:6998:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1715208093.392718:0:6998:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012ffd4900/0x8c55e4ad37f66ff1 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbbeffb005ec3e7b3 expref: -99 pid: 6998 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715208093.392879:0:6998:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012ffd58c0/0x8c55e4ad37f66ff8 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6998 initiator: MDT0 00010000:00010000:3.0:1715208093.392896:0:6998:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012ffd58c0/0x8c55e4ad37f66ff8 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6998 initiator: MDT0 00010000:00010000:3.0:1715208093.392911:0:6998:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012ffd58c0/0x8c55e4ad37f66ff8 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6998 initiator: MDT0 00010000:00010000:3.0:1715208093.392939:0:6998:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012ffd7180/0x8c55e4ad37f66fff lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x646966 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6998 initiator: MDT0 00010000:00010000:3.0:1715208093.392947:0:6998:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012ffd7180/0x8c55e4ad37f66fff lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x646966 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6998 initiator: MDT0 00010000:00010000:3.0:1715208093.392953:0:6998:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012ffd7180/0x8c55e4ad37f66fff lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x646966 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6998 initiator: MDT0 00000004:00200000:3.0:1715208093.393063:0:6998:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 10752 00010000:00010000:3.0:1715208093.393244:0:6998:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012ffd58c0/0x8c55e4ad37f66ff8 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6998 initiator: MDT0 00010000:00010000:3.0:1715208093.393252:0:6998:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012ffd58c0/0x8c55e4ad37f66ff8 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6998 initiator: MDT0 00010000:00010000:3.0:1715208093.393260:0:6998:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012ffd58c0/0x8c55e4ad37f66ff8 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6998 initiator: MDT0 00010000:00010000:3.0:1715208093.393266:0:6998:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88012ffd58c0 already unused, calling callback (ffffffffa13a3730) 00010000:00010000:3.0:1715208093.393310:0:6998:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012ffd58c0/0x8c55e4ad37f66ff8 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6998 initiator: MDT0 00010000:00010000:3.0:1715208093.393319:0:6998:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012ffd58c0/0x8c55e4ad37f66ff8 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6998 initiator: MDT0 00010000:00010000:3.0:1715208093.393334:0:6998:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff88008e524300) 00010000:00010000:3.0:1715208093.393338:0:6998:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1715208093.393343:0:6998:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012ffd58c0/0x8c55e4ad37f66ff8 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6998 initiator: MDT0 00010000:00010000:3.0:1715208093.393349:0:6998:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012ffd58c0/0x8c55e4ad37f66ff8 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6998 initiator: MDT0 00010000:00010000:3.0:1715208093.393388:0:6998:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012ffd7180/0x8c55e4ad37f66fff lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x646966 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6998 initiator: MDT0 00010000:00010000:3.0:1715208093.393395:0:6998:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012ffd7180/0x8c55e4ad37f66fff lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x646966 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6998 initiator: MDT0 00010000:00010000:3.0:1715208093.393401:0:6998:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012ffd7180/0x8c55e4ad37f66fff lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x646966 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6998 initiator: MDT0 00010000:00010000:3.0:1715208093.393405:0:6998:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88012ffd7180 already unused, calling callback (ffffffffa13a3730) 00010000:00010000:3.0:1715208093.393408:0:6998:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012ffd7180/0x8c55e4ad37f66fff lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x646966 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6998 initiator: MDT0 00010000:00010000:3.0:1715208093.393414:0:6998:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012ffd7180/0x8c55e4ad37f66fff lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x646966 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6998 initiator: MDT0 00010000:00010000:3.0:1715208093.393421:0:6998:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x646966 (ffff88008e4cc000) 00010000:00010000:3.0:1715208093.393424:0:6998:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1715208093.393426:0:6998:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012ffd7180/0x8c55e4ad37f66fff lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x646966 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6998 initiator: MDT0 00010000:00010000:3.0:1715208093.393431:0:6998:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012ffd7180/0x8c55e4ad37f66fff lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x646966 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6998 initiator: MDT0 00010000:00010000:3.0:1715208093.393476:0:6998:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012ffd4900/0x8c55e4ad37f66ff1 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.38@tcp remote: 0xbbeffb005ec3e7b3 expref: 45 pid: 6998 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715208093.393485:0:6998:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012ffd4900/0x8c55e4ad37f66ff1 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.38@tcp remote: 0xbbeffb005ec3e7b3 expref: 45 pid: 6998 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715208093.393493:0:6998:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012ffd4900, rc 0) 00000100:00100000:3.0:1715208093.393569:0:6998:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c345500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cbae74da-7571-45ad-b971-0e0378bbd4e4+44:17816:x1798523503948352:12345-192.168.202.38@tcp:101:lhsmtool_posix.0 Request processed in 936us (1186us total) trans 4294967499 rc 301/301 00000100:00100000:3.0:1715208093.393585:0:6998:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.38@tcp, seq: 399 00000100:00100000:0.0:1715208093.395687:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.38@tcp (source: 12345-192.168.202.38@tcp) 00000100:00100000:3.0:1715208093.395783:0:6998:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798523503948416 00000100:00100000:3.0:1715208093.395794:0:6998:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798523503948416 00000100:00100000:3.0:1715208093.395851:0:6998:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.38@tcp, seq: 400 00000100:00100000:3.0:1715208093.395861:0:6998:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008ebabb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cbae74da-7571-45ad-b971-0e0378bbd4e4+44:17816:x1798523503948416:12345-192.168.202.38@tcp:59:lhsmtool_posix.0 00000100:00100000:3.0:1715208093.395962:0:6998:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008ebabb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cbae74da-7571-45ad-b971-0e0378bbd4e4+44:17816:x1798523503948416:12345-192.168.202.38@tcp:59:lhsmtool_posix.0 Request processed in 99us (286us total) trans 0 rc 0/0 00000100:00100000:3.0:1715208093.395971:0:6998:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.38@tcp, seq: 400 00000100:00100000:0.0:1715208093.416327:0:3208:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.38@tcp (source: 12345-192.168.202.38@tcp) 00000100:00100000:3.0:1715208093.416474:0:6998:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798523503948800 00000100:00100000:3.0:1715208093.416483:0:6998:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798523503948800 00000100:00100000:3.0:1715208093.416534:0:6998:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.38@tcp, seq: 401 00000100:00100000:3.0:1715208093.416542:0:6998:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008ebab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cbae74da-7571-45ad-b971-0e0378bbd4e4+44:17820:x1798523503948800:12345-192.168.202.38@tcp:101:rm.0 00010000:00010000:3.0:1715208093.416558:0:6998:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1715208093.416575:0:6998:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012ffd7600/0x8c55e4ad37f6700d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbbeffb005ec3e7dd expref: -99 pid: 6998 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715208093.416624:0:6998:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012ffd61c0/0x8c55e4ad37f67014 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6998 initiator: MDT0 00010000:00010000:3.0:1715208093.416662:0:6998:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012ffd61c0/0x8c55e4ad37f67014 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6998 initiator: MDT0 00010000:00010000:3.0:1715208093.416674:0:6998:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012ffd61c0/0x8c55e4ad37f67014 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6998 initiator: MDT0 00010000:00010000:3.0:1715208093.416687:0:6998:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012ffd6ac0/0x8c55e4ad37f6701b lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa729b9f6 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6998 initiator: MDT0 00010000:00010000:3.0:1715208093.416695:0:6998:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012ffd6ac0/0x8c55e4ad37f6701b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa729b9f6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6998 initiator: MDT0 00010000:00010000:3.0:1715208093.416713:0:6998:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012ffd6ac0/0x8c55e4ad37f6701b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa729b9f6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6998 initiator: MDT0 00010000:00010000:3.0:1715208093.416788:0:6998:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012ffd61c0/0x8c55e4ad37f67014 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6998 initiator: MDT0 00010000:00010000:3.0:1715208093.416795:0:6998:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012ffd61c0/0x8c55e4ad37f67014 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6998 initiator: MDT0 00010000:00010000:3.0:1715208093.416802:0:6998:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012ffd61c0/0x8c55e4ad37f67014 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6998 initiator: MDT0 00010000:00010000:3.0:1715208093.416808:0:6998:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88012ffd61c0 already unused, calling callback (ffffffffa13a3730) 00010000:00010000:3.0:1715208093.416811:0:6998:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012ffd61c0/0x8c55e4ad37f67014 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6998 initiator: MDT0 00010000:00010000:3.0:1715208093.416818:0:6998:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012ffd61c0/0x8c55e4ad37f67014 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6998 initiator: MDT0 00010000:00010000:3.0:1715208093.416827:0:6998:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800a68d3500) 00010000:00010000:3.0:1715208093.416831:0:6998:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1715208093.416834:0:6998:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012ffd61c0/0x8c55e4ad37f67014 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6998 initiator: MDT0 00010000:00010000:3.0:1715208093.416840:0:6998:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012ffd61c0/0x8c55e4ad37f67014 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6998 initiator: MDT0 00010000:00010000:3.0:1715208093.416869:0:6998:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012ffd6ac0/0x8c55e4ad37f6701b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa729b9f6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6998 initiator: MDT0 00010000:00010000:3.0:1715208093.416875:0:6998:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012ffd6ac0/0x8c55e4ad37f6701b lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa729b9f6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6998 initiator: MDT0 00010000:00010000:3.0:1715208093.416881:0:6998:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012ffd6ac0/0x8c55e4ad37f6701b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa729b9f6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6998 initiator: MDT0 00010000:00010000:3.0:1715208093.416893:0:6998:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88012ffd6ac0 already unused, calling callback (ffffffffa13a3730) 00010000:00010000:3.0:1715208093.416896:0:6998:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012ffd6ac0/0x8c55e4ad37f6701b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa729b9f6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6998 initiator: MDT0 00010000:00010000:3.0:1715208093.416903:0:6998:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012ffd6ac0/0x8c55e4ad37f6701b lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa729b9f6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6998 initiator: MDT0 00010000:00010000:3.0:1715208093.416910:0:6998:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa729b9f6 (ffff88008e4cc200) 00010000:00010000:3.0:1715208093.416913:0:6998:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1715208093.416915:0:6998:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012ffd6ac0/0x8c55e4ad37f6701b lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa729b9f6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6998 initiator: MDT0 00010000:00010000:3.0:1715208093.416920:0:6998:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012ffd6ac0/0x8c55e4ad37f6701b lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa729b9f6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6998 initiator: MDT0 00010000:00010000:3.0:1715208093.416967:0:6998:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012ffd7600/0x8c55e4ad37f6700d lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.38@tcp remote: 0xbbeffb005ec3e7dd expref: 45 pid: 6998 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715208093.416976:0:6998:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012ffd7600/0x8c55e4ad37f6700d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.38@tcp remote: 0xbbeffb005ec3e7dd expref: 45 pid: 6998 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715208093.416984:0:6998:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012ffd7600, rc 0) 00000100:00100000:3.0:1715208093.417041:0:6998:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008ebab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cbae74da-7571-45ad-b971-0e0378bbd4e4+44:17820:x1798523503948800:12345-192.168.202.38@tcp:101:rm.0 Request processed in 498us (719us total) trans 0 rc 301/301 00000100:00100000:3.0:1715208093.417050:0:6998:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.38@tcp, seq: 401 00010000:00010000:2.0:1715208093.802531:0:8591:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1715208093.971987:0:24865:0:(debug.c:705:libcfs_debug_mark_buffer()) DEBUG MARKER: sanity-hsm test_24f: @@@@@@ FAIL: cannot create /mnt/lustre2/d24f.sanity-hsm/f24f.sanity-hsm with cp, status=1 00000040:00080000:3.0:1715208094.236543:0:14992:0:(llog.c:735:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1715208094.236554:0:14992:0:(llog_cat.c:796:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1715208094.237140:0:14992:0:(llog.c:792:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 1 00000040:00080000:3.0:1715208094.237166:0:14992:0:(llog.c:792:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 Debug log: 207 lines, 207 kept, 0 dropped, 0 bad.