00000100:00100000:0.0F:1715207112.708320:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.38@tcp (source: 12345-192.168.202.38@tcp) 00000100:00100000:3.0F:1715207112.708391:0:6998:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798523503878016 00000100:00100000:3.0:1715207112.708408:0:6998:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798523503878016 00000100:00080000:0.0:1715207112.708463:0:6994:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 older than 1715207082 00000100:00100000:3.0:1715207112.708477:0:6998:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.38@tcp, seq: 227 00000100:00100000:3.0:1715207112.708486:0:6998:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880135a98700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cbae74da-7571-45ad-b971-0e0378bbd4e4+18:13096:x1798523503878016:12345-192.168.202.38@tcp:60:lhsmtool_posix.0 00000100:00100000:3.0:1715207112.708582:0:6998:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880135a98700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cbae74da-7571-45ad-b971-0e0378bbd4e4+18:13096:x1798523503878016:12345-192.168.202.38@tcp:60:lhsmtool_posix.0 Request processed in 94us (268us total) trans 0 rc 0/0 00000100:00100000:3.0:1715207112.708592:0:6998:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.38@tcp, seq: 227 00000100:00100000:0.0:1715207112.709590:0:3209:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.38@tcp (source: 12345-192.168.202.38@tcp) 00000100:00100000:2.0F:1715207112.709672:0:13448:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798523503878144 00000100:00100000:2.0:1715207112.709683:0:13448:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798523503878144 00000100:00100000:2.0:1715207112.709714:0:13448:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.38@tcp, seq: 49 00000100:00100000:2.0:1715207112.709719:0:13448:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880135a98e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:cbae74da-7571-45ad-b971-0e0378bbd4e4+18:13096:x1798523503878144:12345-192.168.202.38@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1715207112.709926:0:13448:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880135a98e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:cbae74da-7571-45ad-b971-0e0378bbd4e4+19:13096:x1798523503878144:12345-192.168.202.38@tcp:35:lhsmtool_posix.0 Request processed in 205us (337us total) trans 4294967422 rc 0/0 00000100:00100000:2.0:1715207112.709931:0:13448:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.38@tcp, seq: 49 00010000:00010000:3.0:1715207112.832556:0:6986:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1715207112.939310:0:7244:0:(tgt_lastrcvd.c:969:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967422 is committed 00000100:00100000:2.0:1715207113.484380:0:3216:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008db67100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3216:1798523508122624:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1715207113.484435:0:3216:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1715207113.484488:0:8579:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798523508122624 00000100:00100000:0.0:1715207113.484495:0:8579:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798523508122624 00000100:00080000:2.0:1715207113.484521:0:6994:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 older than 1715207083 00000100:00100000:0.0:1715207113.484536:0:8579:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 565 00000100:00100000:0.0:1715207113.484542:0:8579:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e93f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3216:x1798523508122624:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1715207113.484573:0:8579:0:(ofd_obd.c:743:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3857711104 avail 3855613952 00000100:00100000:0.0:1715207113.484617:0:8579:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e93f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3216:x1798523508122624:12345-0@lo:13:osp-pre-0-0.0 Request processed in 75us (182us total) trans 0 rc 0/0 00000100:00100000:0.0:1715207113.484623:0:8579:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 565 00000100:00100000:2.0:1715207113.484664:0:3216:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008db67100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3216:1798523508122624:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1715207113.598357:0:3208:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.38@tcp (source: 12345-192.168.202.38@tcp) 00000100:00100000:0.0:1715207113.598395:0:3208:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.38@tcp (source: 12345-192.168.202.38@tcp) 00000100:00100000:0.0:1715207113.598422:0:3208:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.38@tcp (source: 12345-192.168.202.38@tcp) 00000100:00100000:3.0:1715207113.598424:0:6998:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798523503878272 00000100:00100000:3.0:1715207113.598436:0:6998:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798523503878272 00000100:00100000:2.0:1715207113.598476:0:6992:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798523503878208 00000100:00100000:2.0:1715207113.598483:0:6992:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798523503878208 00000100:00100000:3.0:1715207113.598486:0:6998:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.38@tcp, seq: 1215 00000100:00100000:1.0F:1715207113.598486:0:16530:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798523503878336 00000100:00100000:3.0:1715207113.598495:0:6998:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880135a9ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cbae74da-7571-45ad-b971-0e0378bbd4e4+18:1956:x1798523503878272:12345-192.168.202.38@tcp:400:kworker.0 00000100:00100000:1.0:1715207113.598499:0:16530:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798523503878336 00000100:00100000:2.0:1715207113.598514:0:6992:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.38@tcp, seq: 925 00000100:00100000:2.0:1715207113.598518:0:6992:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012bdaf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ff645b43-0d7b-4a37-b9cc-6ac8f8d65c0d+12:1957:x1798523503878208:12345-192.168.202.38@tcp:400:kworker.0 00000100:00100000:1.0:1715207113.598542:0:16530:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.38@tcp, seq: 629 00000100:00100000:1.0:1715207113.598548:0:16530:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880135a99f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:cbae74da-7571-45ad-b971-0e0378bbd4e4+6:1957:x1798523503878336:12345-192.168.202.38@tcp:400:kworker.0 00000100:00100000:2.0:1715207113.598564:0:6992:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012bdaf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ff645b43-0d7b-4a37-b9cc-6ac8f8d65c0d+12:1957:x1798523503878208:12345-192.168.202.38@tcp:400:kworker.0 Request processed in 45us (169us total) trans 0 rc 0/0 00000100:00100000:2.0:1715207113.598570:0:6992:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.38@tcp, seq: 925 00000100:00100000:3.0:1715207113.598572:0:6998:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880135a9ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cbae74da-7571-45ad-b971-0e0378bbd4e4+18:1956:x1798523503878272:12345-192.168.202.38@tcp:400:kworker.0 Request processed in 78us (223us total) trans 0 rc 0/0 00000100:00100000:3.0:1715207113.598578:0:6998:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.38@tcp, seq: 1215 00000100:00100000:1.0:1715207113.598586:0:16530:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880135a99f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:cbae74da-7571-45ad-b971-0e0378bbd4e4+6:1957:x1798523503878336:12345-192.168.202.38@tcp:400:kworker.0 Request processed in 38us (163us total) trans 0 rc 0/0 00000100:00100000:1.0:1715207113.598594:0:16530:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.38@tcp, seq: 629 00000100:00080000:0.0:1715207113.598633:0:6994:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 older than 1715207083 00000100:00080000:0.0:1715207113.598637:0:6994:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd MGS older than 1715207083 00000100:00100000:2.0:1715207113.692386:0:3217:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008e93df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3217:1798523508122688:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1715207113.692453:0:3217:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1715207113.692482:0:3217:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008d9cce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3217:1798523508122944:0@lo:400:kworker.0 00000100:00100000:1.0:1715207113.692497:0:3215:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008d9cc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3215:1798523508122816:0@lo:400:kworker.0 00000100:00100000:2.0:1715207113.692503:0:3217:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1715207113.692516:0:3217:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1715207113.692522:0:3217:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008d9cca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:47336e3e-5c2f-4892-9b72-90c87ec36b26:3217:1798523508122752:0@lo:400:kworker.0 00000100:00100000:2.0:1715207113.692546:0:3217:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1715207113.692547:0:3215:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1715207113.692576:0:3216:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008d9cd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3216:1798523508122880:0@lo:400:kworker.0 00000100:00100000:2.0:1715207113.692596:0:3216:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1715207113.692611:0:6998:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798523508122944 00000100:00100000:2.0:1715207113.692619:0:11480:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798523508122816 00000100:00100000:1.0:1715207113.692619:0:6998:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798523508122944 00000100:00100000:2.0:1715207113.692625:0:11480:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798523508122816 00000100:00100000:2.0:1715207113.692656:0:11480:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1216 00000100:00100000:2.0:1715207113.692662:0:11480:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d9cc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3215:x1798523508122816:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1715207113.692667:0:6998:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798523508122880 00000100:00100000:1.0:1715207113.692669:0:6998:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798523508122880 00000100:00100000:1.0:1715207113.692686:0:6998:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1217 00000100:00100000:1.0:1715207113.692691:0:6998:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e93c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3217:x1798523508122944:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1715207113.692707:0:11480:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d9cc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3215:x1798523508122816:12345-0@lo:400:kworker.0 Request processed in 45us (162us total) trans 0 rc 0/0 00000100:00100000:2.0:1715207113.692714:0:11480:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1216 00000100:00100000:1.0:1715207113.692731:0:6998:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e93c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3217:x1798523508122944:12345-0@lo:400:kworker.0 Request processed in 40us (227us total) trans 0 rc 0/0 00000100:00100000:2.0:1715207113.692732:0:11480:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1218 00000100:00100000:2.0:1715207113.692736:0:11480:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e93dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3216:x1798523508122880:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1715207113.692738:0:6998:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1217 00000100:00080000:1.0:1715207113.692758:0:6994:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 older than 1715207083 00000100:00100000:2.0:1715207113.692759:0:11480:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e93dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3216:x1798523508122880:12345-0@lo:400:kworker.0 Request processed in 22us (162us total) trans 0 rc 0/0 00000100:00100000:2.0:1715207113.692765:0:11480:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1218 00000100:00100000:1.0:1715207113.692787:0:3215:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008d9cc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3215:1798523508122816:0@lo:400:kworker.0 00000100:00100000:2.0:1715207113.692794:0:3216:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008d9cd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3216:1798523508122880:0@lo:400:kworker.0 00000100:00100000:2.0:1715207113.692813:0:8579:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798523508122688 00000100:00100000:2.0:1715207113.692816:0:8579:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798523508122688 00000100:00100000:1.0:1715207113.692827:0:6993:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798523508122752 00000100:00100000:1.0:1715207113.692830:0:6993:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798523508122752 00000100:00100000:2.0:1715207113.692839:0:8579:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 566 00000100:00100000:2.0:1715207113.692843:0:8579:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e93d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3217:x1798523508122688:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1715207113.692853:0:6993:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 926 00000100:00100000:1.0:1715207113.692857:0:6993:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012bdaec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:47336e3e-5c2f-4892-9b72-90c87ec36b26+18:3217:x1798523508122752:12345-0@lo:400:kworker.0 00002000:00000024:2.0:1715207113.692866:0:8579:0:(ofd_obd.c:743:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3857711104 avail 3855613952 00000100:00100000:1.0:1715207113.692888:0:6993:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012bdaec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:47336e3e-5c2f-4892-9b72-90c87ec36b26+18:3217:x1798523508122752:12345-0@lo:400:kworker.0 Request processed in 30us (342us total) trans 0 rc 0/0 00000100:00100000:1.0:1715207113.692893:0:6993:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 926 00000100:00100000:2.0:1715207113.692894:0:8579:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e93d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3217:x1798523508122688:12345-0@lo:13:osp-pre-1-0.0 Request processed in 50us (442us total) trans 0 rc 0/0 00000100:00100000:2.0:1715207113.692900:0:8579:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 566 00000100:00100000:2.0:1715207113.692929:0:3217:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008d9cca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:47336e3e-5c2f-4892-9b72-90c87ec36b26:3217:1798523508122752:0@lo:400:kworker.0 00000100:00080000:1.0:1715207113.692929:0:6994:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd MGS older than 1715207083 00000100:00080000:1.0:1715207113.692932:0:6994:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 older than 1715207083 00000100:00100000:2.0:1715207113.692939:0:3217:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008d9cce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3217:1798523508122944:0@lo:400:kworker.0 00000100:00100000:2.0:1715207113.692963:0:3217:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008e93df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3217:1798523508122688:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1715207113.834500:0:8591:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1715207114.836396:0:10149:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1715207115.838353:0:18958:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1715207116.840745:0:6987:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1715207116.964695:0:17668:0:(debug.c:705:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-hsm test 12h: Restore a released file implicitly from a second node ========================================================== 18:25:16 (1715207116) 00000040:00080000:3.0:1715207117.227482:0:14992:0:(llog.c:735:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1715207117.227490:0:14992:0:(llog_cat.c:796:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1715207117.228023:0:14992:0:(llog.c:792:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 1 00000040:00080000:3.0:1715207117.228037:0:14992:0:(llog.c:792:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000001:02000400:1.0:1715207117.509526:0:17733:0:(debug.c:705:libcfs_debug_mark_buffer()) DEBUG MARKER: SKIP: sanity-hsm test_12h Need 2 or more clients, have 1 00010000:00010000:2.0:1715207117.842412:0:6986:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1715207118.492471:0:3218:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008e93df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3218:1798523508123008:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1715207118.492547:0:3218:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1715207118.492607:0:10974:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798523508123008 00000100:00100000:2.0:1715207118.492617:0:10974:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798523508123008 00000100:00080000:0.0:1715207118.492645:0:6994:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 older than 1715207088 00000100:00100000:2.0:1715207118.492671:0:10974:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 567 00000100:00100000:2.0:1715207118.492678:0:10974:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880135a98000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3218:x1798523508123008:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1715207118.492719:0:10974:0:(ofd_obd.c:743:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3857711104 avail 3855613952 00000100:00100000:2.0:1715207118.492780:0:10974:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880135a98000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3218:x1798523508123008:12345-0@lo:13:osp-pre-0-0.0 Request processed in 102us (234us total) trans 0 rc 0/0 00000100:00100000:2.0:1715207118.492788:0:10974:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 567 00000100:00100000:0.0:1715207118.492829:0:3218:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008e93df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3218:1798523508123008:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1715207118.606392:0:3209:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.38@tcp (source: 12345-192.168.202.38@tcp) 00000100:00100000:1.0:1715207118.606444:0:6993:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798523503878400 00000100:00100000:0.0:1715207118.606444:0:3209:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.38@tcp (source: 12345-192.168.202.38@tcp) 00000100:00100000:1.0:1715207118.606456:0:6993:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798523503878400 00000100:00100000:0.0:1715207118.606490:0:3209:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.38@tcp (source: 12345-192.168.202.38@tcp) 00000100:00080000:0.0:1715207118.606519:0:6994:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd MGS older than 1715207088 00000100:00100000:1.0:1715207118.606521:0:6993:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.38@tcp, seq: 927 00000100:00100000:1.0:1715207118.606530:0:6993:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012bdae850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ff645b43-0d7b-4a37-b9cc-6ac8f8d65c0d+12:1956:x1798523503878400:12345-192.168.202.38@tcp:400:kworker.0 00000100:00100000:0.0:1715207118.606568:0:4437:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798523503878464 00000100:00100000:0.0:1715207118.606574:0:4437:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798523503878464 00000100:00100000:1.0:1715207118.606599:0:6993:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012bdae850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ff645b43-0d7b-4a37-b9cc-6ac8f8d65c0d+12:1956:x1798523503878400:12345-192.168.202.38@tcp:400:kworker.0 Request processed in 69us (216us total) trans 0 rc 0/0 00000100:00100000:1.0:1715207118.606607:0:6993:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.38@tcp, seq: 927 00000100:00100000:3.0:1715207118.606684:0:16530:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798523503878528 00000100:00100000:3.0:1715207118.606693:0:16530:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798523503878528 00000100:00080000:1.0:1715207118.607875:0:6994:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 older than 1715207088 00000100:00080000:1.0:1715207118.607882:0:6994:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 older than 1715207088 00000100:00100000:0.0:1715207118.607917:0:4437:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.38@tcp, seq: 1219 00000100:00100000:0.0:1715207118.607935:0:4437:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88013239aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:cbae74da-7571-45ad-b971-0e0378bbd4e4+18:1957:x1798523503878464:12345-192.168.202.38@tcp:400:kworker.0 00000100:00100000:0.0:1715207118.607998:0:4437:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88013239aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:cbae74da-7571-45ad-b971-0e0378bbd4e4+18:1957:x1798523503878464:12345-192.168.202.38@tcp:400:kworker.0 Request processed in 65us (1555us total) trans 0 rc 0/0 00000100:00100000:0.0:1715207118.608006:0:4437:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.38@tcp, seq: 1219 00000100:00100000:3.0:1715207118.608039:0:16530:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.38@tcp, seq: 630 00000100:00100000:3.0:1715207118.608050:0:16530:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880132398000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:cbae74da-7571-45ad-b971-0e0378bbd4e4+6:1956:x1798523503878528:12345-192.168.202.38@tcp:400:kworker.0 00000100:00100000:3.0:1715207118.608153:0:16530:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880132398000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:cbae74da-7571-45ad-b971-0e0378bbd4e4+6:1956:x1798523503878528:12345-192.168.202.38@tcp:400:kworker.0 Request processed in 102us (1659us total) trans 0 rc 0/0 00000100:00100000:3.0:1715207118.608183:0:16530:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.38@tcp, seq: 630 00000100:00100000:2.0:1715207118.700407:0:3215:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008d9cc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:47336e3e-5c2f-4892-9b72-90c87ec36b26:3215:1798523508123136:0@lo:400:kworker.0 00000100:00100000:0.0:1715207118.700424:0:3218:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008d9cce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3218:1798523508123264:0@lo:400:kworker.0 00000100:00100000:1.0:1715207118.700444:0:3217:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008d9cc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3217:1798523508123200:0@lo:400:kworker.0 00000100:00100000:3.0:1715207118.700478:0:3216:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008e93ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3216:1798523508123072:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1715207118.700482:0:3215:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1715207118.700486:0:3218:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1715207118.700501:0:6993:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798523508123136 00000100:00100000:1.0:1715207118.700508:0:6993:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798523508123136 00000100:00100000:2.0:1715207118.700511:0:3215:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008d9cca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3215:1798523508123328:0@lo:400:kworker.0 00000100:00100000:2.0:1715207118.700536:0:3215:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1715207118.700543:0:4437:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798523508123264 00000100:00100000:1.0:1715207118.700546:0:6993:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 928 00000100:00100000:3.0:1715207118.700547:0:3216:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1715207118.700548:0:4437:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798523508123264 00000100:00100000:1.0:1715207118.700554:0:6993:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012bdae450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:47336e3e-5c2f-4892-9b72-90c87ec36b26+18:3215:x1798523508123136:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1715207118.700570:0:6996:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798523508123328 00000100:00100000:3.0:1715207118.700571:0:3216:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008d9cd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3216:1798523508123392:0@lo:400:kworker.0 00000100:00100000:2.0:1715207118.700575:0:6996:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798523508123328 00000100:00100000:0.0:1715207118.700579:0:4437:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1220 00000100:00100000:0.0:1715207118.700585:0:4437:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880132398380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0000_UUID+5:3218:x1798523508123264:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1715207118.700595:0:3216:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1715207118.700601:0:6996:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1221 00000100:00100000:1.0:1715207118.700606:0:6993:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012bdae450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:47336e3e-5c2f-4892-9b72-90c87ec36b26+18:3215:x1798523508123136:12345-0@lo:400:kworker.0 Request processed in 52us (125us total) trans 0 rc 0/0 00000100:00100000:2.0:1715207118.700607:0:6996:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e93c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3215:x1798523508123328:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1715207118.700613:0:6993:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 928 00000100:00100000:0.0:1715207118.700624:0:4437:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880132398380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0000_UUID+5:3218:x1798523508123264:12345-0@lo:400:kworker.0 Request processed in 39us (139us total) trans 0 rc 0/0 00000100:00100000:0.0:1715207118.700632:0:4437:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1220 00000100:00100000:2.0:1715207118.700641:0:6996:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e93c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3215:x1798523508123328:12345-0@lo:400:kworker.0 Request processed in 34us (105us total) trans 0 rc 0/0 00000100:00080000:1.0:1715207118.700641:0:6994:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 older than 1715207088 00000100:00080000:1.0:1715207118.700645:0:6994:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd MGS older than 1715207088 00000100:00100000:2.0:1715207118.700648:0:6996:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1221 00000100:00100000:1.0:1715207118.700654:0:3217:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1715207118.700668:0:3218:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008d9cce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3218:1798523508123264:0@lo:400:kworker.0 00000100:00100000:2.0:1715207118.700674:0:6996:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798523508123200 00000100:00100000:2.0:1715207118.700678:0:6996:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798523508123200 00000100:00100000:3.0:1715207118.700692:0:16530:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798523508123392 00000100:00100000:3.0:1715207118.700698:0:16530:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798523508123392 00000100:00100000:2.0:1715207118.700698:0:6996:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1222 00000100:00100000:2.0:1715207118.700702:0:6996:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d9cdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3217:x1798523508123200:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1715207118.700731:0:16530:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 631 00000100:00100000:3.0:1715207118.700736:0:16530:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008db66d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+5:3216:x1798523508123392:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1715207118.700747:0:6996:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d9cdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3217:x1798523508123200:12345-0@lo:400:kworker.0 Request processed in 44us (92us total) trans 0 rc 0/0 00000100:00100000:2.0:1715207118.700754:0:6996:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1222 00000100:00100000:2.0:1715207118.700775:0:10974:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798523508123072 00000100:00100000:3.0:1715207118.700788:0:16530:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008db66d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+5:3216:x1798523508123392:12345-0@lo:400:kworker.0 Request processed in 50us (191us total) trans 0 rc 0/0 00000100:00100000:2.0:1715207118.700788:0:10974:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798523508123072 00000100:00100000:3.0:1715207118.700795:0:16530:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 631 00000100:00100000:2.0:1715207118.700811:0:10974:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 568 00000100:00080000:3.0:1715207118.700813:0:6994:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 older than 1715207088 00000100:00100000:2.0:1715207118.700815:0:10974:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008db67100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3216:x1798523508123072:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1715207118.700834:0:3216:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008d9cd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3216:1798523508123392:0@lo:400:kworker.0 00002000:00000024:2.0:1715207118.700844:0:10974:0:(ofd_obd.c:743:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3857711104 avail 3855613952 00000100:00100000:2.0:1715207118.700875:0:10974:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008db67100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3216:x1798523508123072:12345-0@lo:13:osp-pre-1-0.0 Request processed in 59us (330us total) trans 0 rc 0/0 00000100:00100000:2.0:1715207118.700881:0:10974:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 568 00000100:00100000:3.0:1715207118.700886:0:3216:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008e93ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3216:1798523508123072:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1715207118.700911:0:3215:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008d9cca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3215:1798523508123328:0@lo:400:kworker.0 00000100:00100000:2.0:1715207118.700920:0:3215:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008d9cc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:47336e3e-5c2f-4892-9b72-90c87ec36b26:3215:1798523508123136:0@lo:400:kworker.0 00000100:00100000:1.0:1715207118.701911:0:3217:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008d9cc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3217:1798523508123200:0@lo:400:kworker.0 00010000:00010000:3.0:1715207118.849531:0:8591:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1715207119.852625:0:10149:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1715207120.261419:0:18186:0:(debug.c:705:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-hsm test 12m: Archive/release/implicit restore ========================================================== 18:25:19 (1715207119) 00000100:00100000:1.0:1715207120.358996:0:3208:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.38@tcp (source: 12345-192.168.202.38@tcp) 00000100:00100000:2.0:1715207120.359144:0:4437:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798523503878720 00000100:00100000:2.0:1715207120.359154:0:4437:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798523503878720 00000100:00100000:2.0:1715207120.359223:0:4437:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.38@tcp, seq: 228 00000100:00100000:2.0:1715207120.359231:0:4437:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d9cc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:cbae74da-7571-45ad-b971-0e0378bbd4e4+18:16285:x1798523503878720:12345-192.168.202.38@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1715207120.359262:0:4437:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00080000:3.0:1715207120.359314:0:6994:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 older than 1715207090 00010000:00010000:2.0:1715207120.359356:0:4437:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009bffeac0/0x8c55e4ad37f665b0 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbbeffb005ec3e115 expref: -99 pid: 4437 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715207120.359481:0:4437:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009bffed00/0x8c55e4ad37f665b7 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 4437 initiator: MDT0 00010000:00010000:2.0:1715207120.359495:0:4437:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009bffed00/0x8c55e4ad37f665b7 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 4437 initiator: MDT0 00010000:00010000:2.0:1715207120.359515:0:4437:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009bffed00/0x8c55e4ad37f665b7 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 4437 initiator: MDT0 00010000:00010000:2.0:1715207120.359530:0:4437:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009bffe640/0x8c55e4ad37f665be lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x646966 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 4437 initiator: MDT0 00010000:00010000:2.0:1715207120.359536:0:4437:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009bffe640/0x8c55e4ad37f665be lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x646966 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 4437 initiator: MDT0 00010000:00010000:2.0:1715207120.359541:0:4437:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009bffe640/0x8c55e4ad37f665be lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x646966 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 4437 initiator: MDT0 00000004:00200000:2.0:1715207120.359651:0:4437:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 10752 00010000:00010000:2.0:1715207120.359800:0:4437:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009bffed00/0x8c55e4ad37f665b7 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 4437 initiator: MDT0 00010000:00010000:2.0:1715207120.359808:0:4437:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009bffed00/0x8c55e4ad37f665b7 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 4437 initiator: MDT0 00010000:00010000:2.0:1715207120.359815:0:4437:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009bffed00/0x8c55e4ad37f665b7 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 4437 initiator: MDT0 00010000:00010000:2.0:1715207120.359821:0:4437:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88009bffed00 already unused, calling callback (ffffffffa13a3730) 00010000:00010000:2.0:1715207120.359825:0:4437:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009bffed00/0x8c55e4ad37f665b7 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 4437 initiator: MDT0 00010000:00010000:2.0:1715207120.359833:0:4437:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009bffed00/0x8c55e4ad37f665b7 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 4437 initiator: MDT0 00010000:00010000:2.0:1715207120.359844:0:4437:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff88008e524300) 00010000:00010000:2.0:1715207120.359847:0:4437:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1715207120.359851:0:4437:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009bffed00/0x8c55e4ad37f665b7 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 4437 initiator: MDT0 00010000:00010000:2.0:1715207120.359869:0:4437:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009bffed00/0x8c55e4ad37f665b7 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 4437 initiator: MDT0 00010000:00010000:2.0:1715207120.359903:0:4437:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009bffe640/0x8c55e4ad37f665be lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x646966 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 4437 initiator: MDT0 00010000:00010000:2.0:1715207120.359910:0:4437:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009bffe640/0x8c55e4ad37f665be lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x646966 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 4437 initiator: MDT0 00010000:00010000:2.0:1715207120.359915:0:4437:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009bffe640/0x8c55e4ad37f665be lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x646966 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 4437 initiator: MDT0 00010000:00010000:2.0:1715207120.359920:0:4437:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88009bffe640 already unused, calling callback (ffffffffa13a3730) 00010000:00010000:2.0:1715207120.359923:0:4437:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009bffe640/0x8c55e4ad37f665be lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x646966 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 4437 initiator: MDT0 00010000:00010000:2.0:1715207120.359929:0:4437:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009bffe640/0x8c55e4ad37f665be lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x646966 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 4437 initiator: MDT0 00010000:00010000:2.0:1715207120.359936:0:4437:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x646966 (ffff8800a68d3100) 00010000:00010000:2.0:1715207120.359939:0:4437:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1715207120.359941:0:4437:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009bffe640/0x8c55e4ad37f665be lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x646966 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 4437 initiator: MDT0 00010000:00010000:2.0:1715207120.359964:0:4437:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009bffe640/0x8c55e4ad37f665be lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x646966 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 4437 initiator: MDT0 00010000:00010000:2.0:1715207120.360019:0:4437:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009bffeac0/0x8c55e4ad37f665b0 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.38@tcp remote: 0xbbeffb005ec3e115 expref: 20 pid: 4437 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715207120.360026:0:4437:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009bffeac0/0x8c55e4ad37f665b0 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.38@tcp remote: 0xbbeffb005ec3e115 expref: 20 pid: 4437 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715207120.360043:0:4437:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009bffeac0, rc 0) 00000100:00100000:2.0:1715207120.360120:0:4437:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d9cc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:cbae74da-7571-45ad-b971-0e0378bbd4e4+19:16285:x1798523503878720:12345-192.168.202.38@tcp:101:lhsmtool_posix.0 Request processed in 889us (1135us total) trans 4294967423 rc 301/301 00000100:00100000:2.0:1715207120.360128:0:4437:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.38@tcp, seq: 228 00000100:00100000:0.0:1715207120.361568:0:3209:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.38@tcp (source: 12345-192.168.202.38@tcp) 00000100:00100000:2.0:1715207120.361636:0:4437:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798523503878784 00000100:00100000:2.0:1715207120.361644:0:4437:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798523503878784 00000100:00100000:2.0:1715207120.361685:0:4437:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.38@tcp, seq: 229 00000100:00100000:2.0:1715207120.361692:0:4437:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880132398700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:cbae74da-7571-45ad-b971-0e0378bbd4e4+19:16285:x1798523503878784:12345-192.168.202.38@tcp:59:lhsmtool_posix.0 00000100:00100000:2.0:1715207120.361761:0:4437:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880132398700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:cbae74da-7571-45ad-b971-0e0378bbd4e4+19:16285:x1798523503878784:12345-192.168.202.38@tcp:59:lhsmtool_posix.0 Request processed in 69us (196us total) trans 0 rc 0/0 00000100:00100000:2.0:1715207120.361769:0:4437:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.38@tcp, seq: 229 00000100:00100000:0.0:1715207120.374819:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.38@tcp (source: 12345-192.168.202.38@tcp) 00000100:00100000:2.0:1715207120.374908:0:4437:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798523503879104 00000100:00100000:2.0:1715207120.374919:0:4437:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798523503879104 00000100:00100000:2.0:1715207120.374976:0:4437:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.38@tcp, seq: 230 00000100:00100000:2.0:1715207120.374986:0:4437:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880132398a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:cbae74da-7571-45ad-b971-0e0378bbd4e4+19:16288:x1798523503879104:12345-192.168.202.38@tcp:101:rm.0 00010000:00010000:2.0:1715207120.375002:0:4437:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1715207120.375022:0:4437:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009bffef40/0x8c55e4ad37f665cc lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbbeffb005ec3e138 expref: -99 pid: 4437 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715207120.375108:0:4437:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009bfffa80/0x8c55e4ad37f665d3 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 4437 initiator: MDT0 00010000:00010000:2.0:1715207120.375125:0:4437:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009bfffa80/0x8c55e4ad37f665d3 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 4437 initiator: MDT0 00010000:00010000:2.0:1715207120.375139:0:4437:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009bfffa80/0x8c55e4ad37f665d3 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 4437 initiator: MDT0 00010000:00010000:2.0:1715207120.375209:0:4437:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009bfff600/0x8c55e4ad37f665da lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xe617b0f7 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 4437 initiator: MDT0 00010000:00010000:2.0:1715207120.375224:0:4437:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009bfff600/0x8c55e4ad37f665da lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xe617b0f7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 4437 initiator: MDT0 00010000:00010000:2.0:1715207120.375237:0:4437:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009bfff600/0x8c55e4ad37f665da lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xe617b0f7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 4437 initiator: MDT0 00010000:00010000:2.0:1715207120.375366:0:4437:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009bfffa80/0x8c55e4ad37f665d3 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 4437 initiator: MDT0 00010000:00010000:2.0:1715207120.375378:0:4437:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009bfffa80/0x8c55e4ad37f665d3 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 4437 initiator: MDT0 00010000:00010000:2.0:1715207120.375388:0:4437:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009bfffa80/0x8c55e4ad37f665d3 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 4437 initiator: MDT0 00010000:00010000:2.0:1715207120.375398:0:4437:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88009bfffa80 already unused, calling callback (ffffffffa13a3730) 00010000:00010000:2.0:1715207120.375403:0:4437:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009bfffa80/0x8c55e4ad37f665d3 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 4437 initiator: MDT0 00010000:00010000:2.0:1715207120.375413:0:4437:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009bfffa80/0x8c55e4ad37f665d3 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 4437 initiator: MDT0 00010000:00010000:2.0:1715207120.375428:0:4437:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800a68d3200) 00010000:00010000:2.0:1715207120.375433:0:4437:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1715207120.375438:0:4437:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009bfffa80/0x8c55e4ad37f665d3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 4437 initiator: MDT0 00010000:00010000:2.0:1715207120.375447:0:4437:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009bfffa80/0x8c55e4ad37f665d3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 4437 initiator: MDT0 00010000:00010000:2.0:1715207120.375487:0:4437:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009bfff600/0x8c55e4ad37f665da lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xe617b0f7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 4437 initiator: MDT0 00010000:00010000:2.0:1715207120.375507:0:4437:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009bfff600/0x8c55e4ad37f665da lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xe617b0f7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 4437 initiator: MDT0 00010000:00010000:2.0:1715207120.375517:0:4437:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009bfff600/0x8c55e4ad37f665da lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xe617b0f7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 4437 initiator: MDT0 00010000:00010000:2.0:1715207120.375525:0:4437:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88009bfff600 already unused, calling callback (ffffffffa13a3730) 00010000:00010000:2.0:1715207120.375531:0:4437:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009bfff600/0x8c55e4ad37f665da lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xe617b0f7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 4437 initiator: MDT0 00010000:00010000:2.0:1715207120.375541:0:4437:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009bfff600/0x8c55e4ad37f665da lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xe617b0f7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 4437 initiator: MDT0 00010000:00010000:2.0:1715207120.375554:0:4437:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xe617b0f7 (ffff8800a68d3b00) 00010000:00010000:2.0:1715207120.375559:0:4437:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1715207120.375563:0:4437:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009bfff600/0x8c55e4ad37f665da lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xe617b0f7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 4437 initiator: MDT0 00010000:00010000:2.0:1715207120.375573:0:4437:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009bfff600/0x8c55e4ad37f665da lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xe617b0f7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 4437 initiator: MDT0 00010000:00010000:2.0:1715207120.375641:0:4437:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009bffef40/0x8c55e4ad37f665cc lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.38@tcp remote: 0xbbeffb005ec3e138 expref: 20 pid: 4437 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715207120.375657:0:4437:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009bffef40/0x8c55e4ad37f665cc lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.38@tcp remote: 0xbbeffb005ec3e138 expref: 20 pid: 4437 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715207120.375674:0:4437:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009bffef40, rc 0) 00000100:00100000:2.0:1715207120.375742:0:4437:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880132398a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:cbae74da-7571-45ad-b971-0e0378bbd4e4+19:16288:x1798523503879104:12345-192.168.202.38@tcp:101:rm.0 Request processed in 753us (924us total) trans 0 rc 301/301 00000100:00100000:2.0:1715207120.375755:0:4437:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.38@tcp, seq: 230 00010000:00010000:2.0:1715207120.854436:0:18958:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1715207120.910880:0:18251:0:(debug.c:705:libcfs_debug_mark_buffer()) DEBUG MARKER: sanity-hsm test_12m: @@@@@@ FAIL: cannot create /mnt/lustre2/d12m.sanity-hsm/f12m.sanity-hsm with cp, status=1 00000040:00080000:2.0:1715207121.227373:0:14992:0:(llog.c:735:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1715207121.227378:0:14992:0:(llog_cat.c:796:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1715207121.227654:0:14992:0:(llog.c:792:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 1 00000040:00080000:2.0:1715207121.227659:0:14992:0:(llog.c:792:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 Debug log: 299 lines, 299 kept, 0 dropped, 0 bad.