00000100:00100000:0.0F:1715206622.390301:0:3208:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.38@tcp (source: 12345-192.168.202.38@tcp) 00000100:00100000:2.0F:1715206622.390371:0:6997:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798523503844480 00000100:00100000:2.0:1715206622.390384:0:6997:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798523503844480 00000100:00080000:0.0:1715206622.390410:0:6994:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 older than 1715206592 00000100:00100000:2.0:1715206622.390436:0:6997:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.38@tcp, seq: 181 00000100:00100000:2.0:1715206622.390444:0:6997:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880132af0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cbae74da-7571-45ad-b971-0e0378bbd4e4+18:24675:x1798523503844480:12345-192.168.202.38@tcp:60:lhsmtool_posix.0 00000100:00100000:2.0:1715206622.390526:0:6997:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880132af0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cbae74da-7571-45ad-b971-0e0378bbd4e4+18:24675:x1798523503844480:12345-192.168.202.38@tcp:60:lhsmtool_posix.0 Request processed in 81us (230us total) trans 0 rc 0/0 00000100:00100000:2.0:1715206622.390533:0:6997:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.38@tcp, seq: 181 00000100:00100000:2.0:1715206622.391809:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.38@tcp (source: 12345-192.168.202.38@tcp) 00000100:00100000:0.0:1715206622.391848:0:13448:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798523503844608 00000100:00100000:0.0:1715206622.391853:0:13448:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798523503844608 00000100:00100000:0.0:1715206622.391880:0:13448:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.38@tcp, seq: 37 00000100:00100000:0.0:1715206622.391886:0:13448:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f55ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:cbae74da-7571-45ad-b971-0e0378bbd4e4+18:24675:x1798523503844608:12345-192.168.202.38@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1715206622.392108:0:13448:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f55ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:cbae74da-7571-45ad-b971-0e0378bbd4e4+19:24675:x1798523503844608:12345-192.168.202.38@tcp:35:lhsmtool_posix.0 Request processed in 220us (298us total) trans 4294967398 rc 0/0 00000100:00100000:0.0:1715206622.392115:0:13448:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.38@tcp, seq: 37 00000100:00100000:3.0F:1715206622.700503:0:3218:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008f55ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3218:1798523508065792:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1715206622.700612:0:3218:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0F:1715206622.700732:0:8579:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798523508065792 00000100:00100000:1.0:1715206622.700752:0:8579:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798523508065792 00000100:00080000:0.0:1715206622.700808:0:6994:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 older than 1715206592 00000100:00100000:1.0:1715206622.700818:0:8579:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 369 00000100:00100000:1.0:1715206622.700827:0:8579:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bfced80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3218:x1798523508065792:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1715206622.700865:0:8579:0:(ofd_obd.c:743:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3857711104 avail 3855613952 00000100:00100000:1.0:1715206622.700926:0:8579:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bfced80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3218:x1798523508065792:12345-0@lo:13:osp-pre-0-0.0 Request processed in 99us (314us total) trans 0 rc 0/0 00000100:00100000:1.0:1715206622.700935:0:8579:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 369 00000100:00100000:3.0:1715206622.700975:0:3218:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008f55ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3218:1798523508065792:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1715206622.814333:0:3209:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.38@tcp (source: 12345-192.168.202.38@tcp) 00000100:00100000:3.0:1715206622.814416:0:6997:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798523503844736 00000100:00100000:0.0:1715206622.814427:0:3209:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.38@tcp (source: 12345-192.168.202.38@tcp) 00000100:00100000:3.0:1715206622.814428:0:6997:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798523503844736 00000100:00100000:2.0:1715206622.814458:0:6992:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798523503844672 00000100:00100000:2.0:1715206622.814465:0:6992:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798523503844672 00000100:00100000:3.0:1715206622.814490:0:6997:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.38@tcp, seq: 823 00000100:00100000:3.0:1715206622.814501:0:6997:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880132af2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cbae74da-7571-45ad-b971-0e0378bbd4e4+19:1956:x1798523503844736:12345-192.168.202.38@tcp:400:kworker.0 00000100:00100000:2.0:1715206622.814502:0:6992:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.38@tcp, seq: 565 00000100:00100000:2.0:1715206622.814509:0:6992:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012bda9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ff645b43-0d7b-4a37-b9cc-6ac8f8d65c0d+12:1956:x1798523503844672:12345-192.168.202.38@tcp:400:kworker.0 00000100:00100000:0.0:1715206622.814510:0:3209:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.38@tcp (source: 12345-192.168.202.38@tcp) 00000100:00080000:1.0:1715206622.814514:0:6994:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd MGS older than 1715206592 00000100:00100000:1.0:1715206622.814535:0:8577:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798523503844800 00000100:00100000:1.0:1715206622.814540:0:8577:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798523503844800 00000100:00100000:2.0:1715206622.814566:0:6992:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012bda9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ff645b43-0d7b-4a37-b9cc-6ac8f8d65c0d+12:1956:x1798523503844672:12345-192.168.202.38@tcp:400:kworker.0 Request processed in 58us (138us total) trans 0 rc 0/0 00000100:00100000:3.0:1715206622.814573:0:6997:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880132af2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cbae74da-7571-45ad-b971-0e0378bbd4e4+19:1956:x1798523503844736:12345-192.168.202.38@tcp:400:kworker.0 Request processed in 71us (247us total) trans 0 rc 0/0 00000100:00100000:1.0:1715206622.814573:0:8577:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.38@tcp, seq: 413 00000100:00100000:2.0:1715206622.814574:0:6992:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.38@tcp, seq: 565 00000100:00100000:1.0:1715206622.814580:0:8577:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880131e0b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:cbae74da-7571-45ad-b971-0e0378bbd4e4+6:1956:x1798523503844800:12345-192.168.202.38@tcp:400:kworker.0 00000100:00100000:3.0:1715206622.814585:0:6997:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.38@tcp, seq: 823 00000100:00080000:0.0:1715206622.814588:0:6994:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 older than 1715206592 00000100:00100000:1.0:1715206622.814623:0:8577:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880131e0b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:cbae74da-7571-45ad-b971-0e0378bbd4e4+6:1956:x1798523503844800:12345-192.168.202.38@tcp:400:kworker.0 Request processed in 41us (113us total) trans 0 rc 0/0 00000100:00100000:1.0:1715206622.814633:0:8577:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.38@tcp, seq: 413 00010000:00010000:2.0:1715206622.854499:0:10149:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1715206622.908472:0:3216:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008f55f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3216:1798523508065920:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1715206622.908498:0:3218:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88009bfcca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3218:1798523508066048:0@lo:400:kworker.0 00000100:00100000:1.0:1715206622.908545:0:3215:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88009bfce300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:47336e3e-5c2f-4892-9b72-90c87ec36b26:3215:1798523508065856:0@lo:400:kworker.0 00000100:00100000:3.0:1715206622.908554:0:3218:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1715206622.908554:0:3216:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1715206622.908556:0:3217:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88009bfce680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3217:1798523508065984:0@lo:400:kworker.0 00000100:00100000:2.0:1715206622.908593:0:3216:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88013235ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3216:1798523508066176:0@lo:400:kworker.0 00000100:00100000:3.0:1715206622.908598:0:6997:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798523508066048 00000100:00100000:1.0:1715206622.908599:0:3215:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1715206622.908605:0:3217:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1715206622.908606:0:6997:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798523508066048 00000100:00100000:1.0:1715206622.908623:0:3215:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88009bfcce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3215:1798523508066112:0@lo:400:kworker.0 00000100:00100000:3.0:1715206622.908642:0:6997:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798523508065984 00000100:00100000:3.0:1715206622.908645:0:6997:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798523508065984 00000100:00100000:0.0:1715206622.908646:0:3217:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88013235d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3217:1798523508066240:0@lo:400:kworker.0 00000100:00100000:1.0:1715206622.908655:0:3215:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1715206622.908656:0:3216:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1715206622.908661:0:6997:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 824 00000100:00100000:3.0:1715206622.908668:0:6997:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88013235d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3218:x1798523508066048:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1715206622.908676:0:11480:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798523508066176 00000100:00100000:0.0:1715206622.908682:0:11480:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798523508066176 00000100:00100000:1.0:1715206622.908713:0:8579:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798523508065920 00000100:00100000:0.0:1715206622.908714:0:11480:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 825 00000100:00100000:3.0:1715206622.908718:0:6997:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88013235d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3218:x1798523508066048:12345-0@lo:400:kworker.0 Request processed in 50us (165us total) trans 0 rc 0/0 00000100:00100000:1.0:1715206622.908719:0:8579:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798523508065920 00000100:00100000:0.0:1715206622.908721:0:11480:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880131e09f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3217:x1798523508065984:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1715206622.908725:0:4437:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 826 00000100:00100000:2.0:1715206622.908736:0:4437:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f55f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0001_UUID+5:3216:x1798523508066176:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1715206622.908740:0:6997:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 824 00000100:00100000:1.0:1715206622.908749:0:8579:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 370 00000100:00100000:1.0:1715206622.908756:0:8579:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f55f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3216:x1798523508065920:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1715206622.908759:0:11480:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880131e09f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3217:x1798523508065984:12345-0@lo:400:kworker.0 Request processed in 37us (154us total) trans 0 rc 0/0 00000100:00100000:3.0:1715206622.908767:0:6993:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798523508065856 00000100:00100000:0.0:1715206622.908767:0:11480:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 825 00000100:00100000:3.0:1715206622.908770:0:6993:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798523508065856 00000100:00080000:0.0:1715206622.908787:0:6994:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd MGS older than 1715206592 00000100:00080000:0.0:1715206622.908791:0:6994:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 older than 1715206592 00000100:00100000:3.0:1715206622.908793:0:6993:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 566 00002000:00000024:1.0:1715206622.908794:0:8579:0:(ofd_obd.c:743:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3857711104 avail 3855613952 00000100:00080000:0.0:1715206622.908794:0:6994:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 older than 1715206592 00000100:00100000:3.0:1715206622.908798:0:6993:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012bda8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:47336e3e-5c2f-4892-9b72-90c87ec36b26+18:3215:x1798523508065856:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1715206622.908798:0:4437:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f55f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0001_UUID+5:3216:x1798523508066176:12345-0@lo:400:kworker.0 Request processed in 61us (143us total) trans 0 rc 0/0 00000100:00100000:2.0:1715206622.908810:0:4437:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 826 00000100:00100000:0.0:1715206622.908815:0:3217:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1715206622.908828:0:8579:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f55f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3216:x1798523508065920:12345-0@lo:13:osp-pre-1-0.0 Request processed in 71us (276us total) trans 0 rc 0/0 00000100:00100000:3.0:1715206622.908832:0:6993:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012bda8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:47336e3e-5c2f-4892-9b72-90c87ec36b26+18:3215:x1798523508065856:12345-0@lo:400:kworker.0 Request processed in 34us (233us total) trans 0 rc 0/0 00000100:00100000:1.0:1715206622.908849:0:8579:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 370 00000100:00100000:3.0:1715206622.908853:0:6993:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 566 00000100:00100000:0.0:1715206622.908857:0:3217:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88009bfce680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3217:1798523508065984:0@lo:400:kworker.0 00000100:00100000:2.0:1715206622.908872:0:3216:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88013235ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3216:1798523508066176:0@lo:400:kworker.0 00000100:00100000:1.0:1715206622.908877:0:8577:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798523508066112 00000100:00100000:0.0:1715206622.908881:0:16530:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798523508066240 00000100:00100000:1.0:1715206622.908882:0:8577:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798523508066112 00000100:00100000:0.0:1715206622.908884:0:16530:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798523508066240 00000100:00100000:3.0:1715206622.908899:0:3218:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88009bfcca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3218:1798523508066048:0@lo:400:kworker.0 00000100:00100000:1.0:1715206622.908905:0:8577:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 414 00000100:00100000:2.0:1715206622.908910:0:3216:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008f55f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3216:1798523508065920:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1715206622.908911:0:16530:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 415 00000100:00100000:1.0:1715206622.908912:0:8577:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e6f2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3215:x1798523508066112:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1715206622.908917:0:16530:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fb91f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+5:3217:x1798523508066240:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1715206622.908948:0:8577:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e6f2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3215:x1798523508066112:12345-0@lo:400:kworker.0 Request processed in 38us (295us total) trans 0 rc 0/0 00000100:00100000:0.0:1715206622.908953:0:16530:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fb91f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+5:3217:x1798523508066240:12345-0@lo:400:kworker.0 Request processed in 36us (137us total) trans 0 rc 0/0 00000100:00100000:1.0:1715206622.908955:0:8577:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 414 00000100:00100000:0.0:1715206622.908960:0:16530:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 415 00000100:00100000:1.0:1715206622.908980:0:3215:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88009bfce300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:47336e3e-5c2f-4892-9b72-90c87ec36b26:3215:1798523508065856:0@lo:400:kworker.0 00000100:00100000:0.0:1715206622.908985:0:3217:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88013235d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3217:1798523508066240:0@lo:400:kworker.0 00000100:00100000:1.0:1715206622.908993:0:3215:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88009bfcce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3215:1798523508066112:0@lo:400:kworker.0 00010000:00010000:2.0:1715206623.856455:0:6986:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1715206624.858397:0:8591:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1715206625.860352:0:6987:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1715206625.931950:0:7244:0:(tgt_lastrcvd.c:969:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967398 is committed 00000001:02000400:1.0:1715206626.196063:0:9900:0:(debug.c:705:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-hsm test 9a: Multiple remote agents ============ 18:17:05 (1715206625) 00000001:02000400:1.0:1715206626.516997:0:9964:0:(debug.c:705:libcfs_debug_mark_buffer()) DEBUG MARKER: SKIP: sanity-hsm test_9a Need 3 or more clients, have 1 00010000:00010000:3.0:1715206626.862385:0:10149:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1715206627.221454:0:14992:0:(llog.c:735:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1715206627.221461:0:14992:0:(llog_cat.c:796:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1715206627.221769:0:14992:0:(llog.c:792:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 1 00000040:00080000:1.0:1715206627.221776:0:14992:0:(llog.c:792:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1715206627.708431:0:3218:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008f55f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3218:1798523508066304:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1715206627.708489:0:3218:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1715206627.708515:0:8579:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798523508066304 00000100:00100000:1.0:1715206627.708524:0:8579:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798523508066304 00000100:00080000:0.0:1715206627.708548:0:6994:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 older than 1715206597 00000100:00100000:1.0:1715206627.708568:0:8579:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 371 00000100:00100000:1.0:1715206627.708573:0:8579:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fb90000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3218:x1798523508066304:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1715206627.708599:0:8579:0:(ofd_obd.c:743:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3857711104 avail 3855613952 00000100:00100000:1.0:1715206627.708645:0:8579:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fb90000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3218:x1798523508066304:12345-0@lo:13:osp-pre-0-0.0 Request processed in 72us (157us total) trans 0 rc 0/0 00000100:00100000:1.0:1715206627.708651:0:8579:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 371 00000100:00100000:0.0:1715206627.708681:0:3218:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008f55f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3218:1798523508066304:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1715206627.821926:0:3208:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.38@tcp (source: 12345-192.168.202.38@tcp) 00000100:00100000:1.0:1715206627.821961:0:3208:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.38@tcp (source: 12345-192.168.202.38@tcp) 00000100:00100000:1.0:1715206627.821986:0:3208:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.38@tcp (source: 12345-192.168.202.38@tcp) 00000100:00100000:3.0:1715206627.822006:0:6993:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798523503844864 00000100:00100000:1.0:1715206627.822006:0:6996:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798523503844928 00000100:00100000:3.0:1715206627.822012:0:6993:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798523503844864 00000100:00100000:1.0:1715206627.822013:0:6996:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798523503844928 00000100:00100000:1.0:1715206627.822045:0:6996:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.38@tcp, seq: 827 00000100:00100000:3.0:1715206627.822049:0:6993:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.38@tcp, seq: 567 00000100:00100000:1.0:1715206627.822050:0:6996:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e6f3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cbae74da-7571-45ad-b971-0e0378bbd4e4+18:1957:x1798523503844928:12345-192.168.202.38@tcp:400:kworker.0 00000100:00100000:3.0:1715206627.822052:0:6993:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012bda8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ff645b43-0d7b-4a37-b9cc-6ac8f8d65c0d+12:1956:x1798523503844864:12345-192.168.202.38@tcp:400:kworker.0 00000100:00100000:0.0:1715206627.822093:0:16530:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798523503844992 00000100:00100000:3.0:1715206627.822094:0:6993:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012bda8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ff645b43-0d7b-4a37-b9cc-6ac8f8d65c0d+12:1956:x1798523503844864:12345-192.168.202.38@tcp:400:kworker.0 Request processed in 42us (134us total) trans 0 rc 0/0 00000100:00100000:1.0:1715206627.822095:0:6996:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e6f3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cbae74da-7571-45ad-b971-0e0378bbd4e4+18:1957:x1798523503844928:12345-192.168.202.38@tcp:400:kworker.0 Request processed in 44us (174us total) trans 0 rc 0/0 00000100:00100000:0.0:1715206627.822097:0:16530:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798523503844992 00000100:00100000:3.0:1715206627.822098:0:6993:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.38@tcp, seq: 567 00000100:00100000:1.0:1715206627.822101:0:6996:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.38@tcp, seq: 827 00000100:00100000:0.0:1715206627.822116:0:16530:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.38@tcp, seq: 416 00000100:00100000:0.0:1715206627.822120:0:16530:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e6f1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:cbae74da-7571-45ad-b971-0e0378bbd4e4+6:1957:x1798523503844992:12345-192.168.202.38@tcp:400:kworker.0 00000100:00100000:0.0:1715206627.822141:0:16530:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e6f1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:cbae74da-7571-45ad-b971-0e0378bbd4e4+6:1957:x1798523503844992:12345-192.168.202.38@tcp:400:kworker.0 Request processed in 21us (156us total) trans 0 rc 0/0 00000100:00100000:0.0:1715206627.822144:0:16530:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.38@tcp, seq: 416 00000100:00080000:0.0:1715206627.822153:0:6994:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 older than 1715206597 00000100:00080000:0.0:1715206627.822155:0:6994:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 older than 1715206597 00000100:00080000:0.0:1715206627.822156:0:6994:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd MGS older than 1715206597 00010000:00010000:2.0:1715206627.864364:0:6986:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1715206627.916368:0:3216:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008f55fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3216:1798523508066432:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1715206627.916368:0:3217:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88013235e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3217:1798523508066496:0@lo:400:kworker.0 00000100:00100000:0.0:1715206627.916378:0:3215:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88013235df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:47336e3e-5c2f-4892-9b72-90c87ec36b26:3215:1798523508066368:0@lo:400:kworker.0 00000100:00100000:3.0:1715206627.916406:0:3218:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88013235e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3218:1798523508066560:0@lo:400:kworker.0 00000100:00100000:2.0:1715206627.916425:0:3216:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1715206627.916425:0:3217:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1715206627.916425:0:3215:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1715206627.916445:0:3218:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1715206627.916446:0:3215:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88013235d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3215:1798523508066624:0@lo:400:kworker.0 00000100:00100000:2.0:1715206627.916450:0:3216:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88013235ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3216:1798523508066688:0@lo:400:kworker.0 00000100:00100000:1.0:1715206627.916450:0:3217:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008e540000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3217:1798523508066752:0@lo:400:kworker.0 00000100:00100000:3.0:1715206627.916469:0:6993:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798523508066368 00000100:00100000:2.0:1715206627.916469:0:3216:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1715206627.916470:0:3215:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1715206627.916475:0:6993:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798523508066368 00000100:00100000:1.0:1715206627.916475:0:6998:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798523508066496 00000100:00100000:1.0:1715206627.916478:0:6998:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798523508066496 00000100:00100000:2.0:1715206627.916492:0:10974:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798523508066432 00000100:00100000:2.0:1715206627.916495:0:10974:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798523508066432 00000100:00100000:0.0:1715206627.916499:0:16530:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798523508066624 00000100:00100000:3.0:1715206627.916501:0:6993:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 568 00000100:00100000:1.0:1715206627.916501:0:6998:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798523508066560 00000100:00100000:0.0:1715206627.916502:0:16530:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798523508066624 00000100:00100000:1.0:1715206627.916503:0:6998:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798523508066560 00000100:00100000:3.0:1715206627.916507:0:6993:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012bda8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:47336e3e-5c2f-4892-9b72-90c87ec36b26+18:3215:x1798523508066368:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1715206627.916515:0:6998:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798523508066688 00000100:00100000:2.0:1715206627.916517:0:10974:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 372 00000100:00100000:1.0:1715206627.916517:0:6998:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798523508066688 00000100:00100000:2.0:1715206627.916521:0:10974:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f55f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3216:x1798523508066432:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1715206627.916522:0:16530:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 417 00000100:00100000:0.0:1715206627.916527:0:16530:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bfcce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+5:3215:x1798523508066624:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1715206627.916529:0:6998:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 828 00000100:00100000:1.0:1715206627.916534:0:6998:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e6f1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3217:x1798523508066496:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1715206627.916538:0:6993:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012bda8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:47336e3e-5c2f-4892-9b72-90c87ec36b26+18:3215:x1798523508066368:12345-0@lo:400:kworker.0 Request processed in 32us (114us total) trans 0 rc 0/0 00000100:00100000:3.0:1715206627.916544:0:6993:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 568 00002000:00000024:2.0:1715206627.916546:0:10974:0:(ofd_obd.c:743:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3857711104 avail 3855613952 00000100:00100000:0.0:1715206627.916557:0:16530:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bfcce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+5:3215:x1798523508066624:12345-0@lo:400:kworker.0 Request processed in 29us (87us total) trans 0 rc 0/0 00000100:00100000:0.0:1715206627.916562:0:16530:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 417 00000100:00100000:1.0:1715206627.916565:0:6998:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e6f1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3217:x1798523508066496:12345-0@lo:400:kworker.0 Request processed in 31us (142us total) trans 0 rc 0/0 00000100:00100000:3.0:1715206627.916569:0:6996:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 829 00000100:00100000:1.0:1715206627.916573:0:6998:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 828 00000100:00100000:3.0:1715206627.916574:0:6996:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e540380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3218:x1798523508066560:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1715206627.916574:0:10974:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f55f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3216:x1798523508066432:12345-0@lo:13:osp-pre-1-0.0 Request processed in 52us (151us total) trans 0 rc 0/0 00000100:00100000:2.0:1715206627.916580:0:10974:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 372 00000100:00100000:0.0:1715206627.916581:0:11480:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 830 00000100:00100000:0.0:1715206627.916585:0:11480:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f55ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3216:x1798523508066688:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1715206627.916597:0:6996:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e540380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3218:x1798523508066560:12345-0@lo:400:kworker.0 Request processed in 23us (152us total) trans 0 rc 0/0 00000100:00100000:3.0:1715206627.916611:0:6996:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 829 00000100:00100000:2.0:1715206627.916612:0:3216:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008f55fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3216:1798523508066432:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1715206627.916612:0:11480:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f55ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3216:x1798523508066688:12345-0@lo:400:kworker.0 Request processed in 26us (142us total) trans 0 rc 0/0 00000100:00100000:0.0:1715206627.916617:0:11480:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 830 00000100:00100000:2.0:1715206627.916626:0:3216:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88013235ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3216:1798523508066688:0@lo:400:kworker.0 00000100:00080000:3.0:1715206627.916628:0:6994:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 older than 1715206597 00000100:00080000:3.0:1715206627.916630:0:6994:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 older than 1715206597 00000100:00080000:3.0:1715206627.916631:0:6994:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd MGS older than 1715206597 00000100:00100000:0.0:1715206627.916635:0:3217:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1715206627.916645:0:3218:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88013235e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3218:1798523508066560:0@lo:400:kworker.0 00000100:00100000:0.0:1715206627.916651:0:3217:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88013235e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3217:1798523508066496:0@lo:400:kworker.0 00000100:00100000:0.0:1715206627.916663:0:8577:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798523508066752 00000100:00100000:0.0:1715206627.916665:0:8577:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798523508066752 00000100:00100000:0.0:1715206627.916682:0:8577:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 418 00000100:00100000:0.0:1715206627.916684:0:8577:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bfce300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3217:x1798523508066752:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1715206627.916703:0:8577:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bfce300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3217:x1798523508066752:12345-0@lo:400:kworker.0 Request processed in 18us (68us total) trans 0 rc 0/0 00000100:00100000:0.0:1715206627.916706:0:8577:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 418 00000100:00100000:0.0:1715206627.916718:0:3217:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008e540000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3217:1798523508066752:0@lo:400:kworker.0 00000100:00100000:0.0:1715206627.916734:0:3215:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88013235df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:47336e3e-5c2f-4892-9b72-90c87ec36b26:3215:1798523508066368:0@lo:400:kworker.0 00000100:00100000:0.0:1715206627.916738:0:3215:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88013235d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3215:1798523508066624:0@lo:400:kworker.0 00000001:02000400:1.0:1715206628.352178:0:10421:0:(debug.c:705:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-hsm test 10a: Archive a file =================== 18:17:07 (1715206627) 00000100:00100000:0.0:1715206628.409259:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.38@tcp (source: 12345-192.168.202.38@tcp) 00000100:00100000:3.0:1715206628.409325:0:6997:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798523503845184 00000100:00100000:3.0:1715206628.409333:0:6997:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798523503845184 00000100:00100000:3.0:1715206628.409371:0:6997:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.38@tcp, seq: 182 00000100:00100000:3.0:1715206628.409377:0:6997:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bfcca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cbae74da-7571-45ad-b971-0e0378bbd4e4+18:28411:x1798523503845184:12345-192.168.202.38@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1715206628.409392:0:6997:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1715206628.409405:0:6997:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012ffd5440/0x8c55e4ad37f661ab lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbbeffb005ec3dddb expref: -99 pid: 6997 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715206628.409486:0:6997:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012ffd4240/0x8c55e4ad37f661b2 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6997 initiator: MDT0 00010000:00010000:3.0:1715206628.409495:0:6997:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012ffd4240/0x8c55e4ad37f661b2 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6997 initiator: MDT0 00010000:00010000:3.0:1715206628.409503:0:6997:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012ffd4240/0x8c55e4ad37f661b2 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6997 initiator: MDT0 00010000:00010000:3.0:1715206628.409511:0:6997:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012ffd6d00/0x8c55e4ad37f661b9 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x646966 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6997 initiator: MDT0 00010000:00010000:3.0:1715206628.409515:0:6997:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012ffd6d00/0x8c55e4ad37f661b9 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x646966 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6997 initiator: MDT0 00010000:00010000:3.0:1715206628.409518:0:6997:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012ffd6d00/0x8c55e4ad37f661b9 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x646966 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6997 initiator: MDT0 00000004:00200000:3.0:1715206628.409582:0:6997:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 10752 00010000:00010000:3.0:1715206628.409674:0:6997:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012ffd4240/0x8c55e4ad37f661b2 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6997 initiator: MDT0 00010000:00010000:3.0:1715206628.409679:0:6997:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012ffd4240/0x8c55e4ad37f661b2 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6997 initiator: MDT0 00010000:00010000:3.0:1715206628.409683:0:6997:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012ffd4240/0x8c55e4ad37f661b2 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6997 initiator: MDT0 00010000:00010000:3.0:1715206628.409686:0:6997:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88012ffd4240 already unused, calling callback (ffffffffa13a3730) 00010000:00010000:3.0:1715206628.409688:0:6997:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012ffd4240/0x8c55e4ad37f661b2 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6997 initiator: MDT0 00010000:00010000:3.0:1715206628.409692:0:6997:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012ffd4240/0x8c55e4ad37f661b2 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6997 initiator: MDT0 00010000:00010000:3.0:1715206628.409698:0:6997:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff88008e524300) 00010000:00010000:3.0:1715206628.409700:0:6997:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1715206628.409702:0:6997:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012ffd4240/0x8c55e4ad37f661b2 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6997 initiator: MDT0 00010000:00010000:3.0:1715206628.409705:0:6997:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012ffd4240/0x8c55e4ad37f661b2 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6997 initiator: MDT0 00010000:00010000:3.0:1715206628.409722:0:6997:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012ffd6d00/0x8c55e4ad37f661b9 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x646966 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6997 initiator: MDT0 00010000:00010000:3.0:1715206628.409725:0:6997:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012ffd6d00/0x8c55e4ad37f661b9 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x646966 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6997 initiator: MDT0 00010000:00010000:3.0:1715206628.409728:0:6997:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012ffd6d00/0x8c55e4ad37f661b9 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x646966 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6997 initiator: MDT0 00010000:00010000:3.0:1715206628.409737:0:6997:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88012ffd6d00 already unused, calling callback (ffffffffa13a3730) 00010000:00010000:3.0:1715206628.409739:0:6997:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012ffd6d00/0x8c55e4ad37f661b9 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x646966 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6997 initiator: MDT0 00010000:00010000:3.0:1715206628.409742:0:6997:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012ffd6d00/0x8c55e4ad37f661b9 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x646966 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6997 initiator: MDT0 00010000:00010000:3.0:1715206628.409746:0:6997:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x646966 (ffff8800a6ad9300) 00010000:00010000:3.0:1715206628.409747:0:6997:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1715206628.409749:0:6997:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012ffd6d00/0x8c55e4ad37f661b9 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x646966 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6997 initiator: MDT0 00010000:00010000:3.0:1715206628.409751:0:6997:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012ffd6d00/0x8c55e4ad37f661b9 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x646966 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6997 initiator: MDT0 00010000:00010000:3.0:1715206628.409774:0:6997:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012ffd5440/0x8c55e4ad37f661ab lrc: 1/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.38@tcp remote: 0xbbeffb005ec3dddb expref: 20 pid: 6997 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715206628.409779:0:6997:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012ffd5440/0x8c55e4ad37f661ab lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.38@tcp remote: 0xbbeffb005ec3dddb expref: 20 pid: 6997 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715206628.409784:0:6997:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012ffd5440, rc 0) 00000100:00100000:3.0:1715206628.409821:0:6997:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bfcca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cbae74da-7571-45ad-b971-0e0378bbd4e4+19:28411:x1798523503845184:12345-192.168.202.38@tcp:101:lhsmtool_posix.0 Request processed in 445us (571us total) trans 4294967399 rc 301/301 00000100:00100000:3.0:1715206628.409826:0:6997:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.38@tcp, seq: 182 00000100:00100000:0.0:1715206628.410690:0:3209:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.38@tcp (source: 12345-192.168.202.38@tcp) 00000100:00100000:3.0:1715206628.410722:0:6997:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798523503845248 00000100:00100000:3.0:1715206628.410725:0:6997:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798523503845248 00000100:00100000:3.0:1715206628.410744:0:6997:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.38@tcp, seq: 183 00000100:00100000:3.0:1715206628.410747:0:6997:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bfce680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cbae74da-7571-45ad-b971-0e0378bbd4e4+19:28411:x1798523503845248:12345-192.168.202.38@tcp:59:lhsmtool_posix.0 00000100:00100000:3.0:1715206628.410783:0:6997:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bfce680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cbae74da-7571-45ad-b971-0e0378bbd4e4+19:28411:x1798523503845248:12345-192.168.202.38@tcp:59:lhsmtool_posix.0 Request processed in 35us (96us total) trans 0 rc 0/0 00000100:00100000:3.0:1715206628.410787:0:6997:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.38@tcp, seq: 183 00000100:00100000:0.0:1715206628.421653:0:3208:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.38@tcp (source: 12345-192.168.202.38@tcp) 00000100:00100000:3.0:1715206628.421747:0:6997:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798523503845632 00000100:00100000:3.0:1715206628.421755:0:6997:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798523503845632 00000100:00100000:3.0:1715206628.421791:0:6997:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.38@tcp, seq: 184 00000100:00100000:3.0:1715206628.421797:0:6997:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008eba9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cbae74da-7571-45ad-b971-0e0378bbd4e4+19:28415:x1798523503845632:12345-192.168.202.38@tcp:101:rm.0 00010000:00010000:3.0:1715206628.421811:0:6997:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1715206628.421826:0:6997:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012ffd4480/0x8c55e4ad37f661c7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbbeffb005ec3de05 expref: -99 pid: 6997 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715206628.421868:0:6997:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012ffd5680/0x8c55e4ad37f661ce lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6997 initiator: MDT0 00010000:00010000:3.0:1715206628.421877:0:6997:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012ffd5680/0x8c55e4ad37f661ce lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6997 initiator: MDT0 00010000:00010000:3.0:1715206628.421884:0:6997:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012ffd5680/0x8c55e4ad37f661ce lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6997 initiator: MDT0 00010000:00010000:3.0:1715206628.422743:0:6997:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012ffd6880/0x8c55e4ad37f661d5 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7a05b0f6 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6997 initiator: MDT0 00010000:00010000:3.0:1715206628.422752:0:6997:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012ffd6880/0x8c55e4ad37f661d5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7a05b0f6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6997 initiator: MDT0 00010000:00010000:3.0:1715206628.422758:0:6997:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012ffd6880/0x8c55e4ad37f661d5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7a05b0f6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6997 initiator: MDT0 00010000:00010000:3.0:1715206628.422820:0:6997:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012ffd5680/0x8c55e4ad37f661ce lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6997 initiator: MDT0 00010000:00010000:3.0:1715206628.422837:0:6997:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012ffd5680/0x8c55e4ad37f661ce lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6997 initiator: MDT0 00010000:00010000:3.0:1715206628.422843:0:6997:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012ffd5680/0x8c55e4ad37f661ce lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6997 initiator: MDT0 00010000:00010000:3.0:1715206628.422848:0:6997:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88012ffd5680 already unused, calling callback (ffffffffa13a3730) 00010000:00010000:3.0:1715206628.422851:0:6997:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012ffd5680/0x8c55e4ad37f661ce lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6997 initiator: MDT0 00010000:00010000:3.0:1715206628.422857:0:6997:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012ffd5680/0x8c55e4ad37f661ce lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6997 initiator: MDT0 00010000:00010000:3.0:1715206628.422866:0:6997:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800a68d3200) 00010000:00010000:3.0:1715206628.422868:0:6997:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1715206628.422871:0:6997:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012ffd5680/0x8c55e4ad37f661ce lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6997 initiator: MDT0 00010000:00010000:3.0:1715206628.422875:0:6997:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012ffd5680/0x8c55e4ad37f661ce lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6997 initiator: MDT0 00010000:00010000:3.0:1715206628.422900:0:6997:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012ffd6880/0x8c55e4ad37f661d5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7a05b0f6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6997 initiator: MDT0 00010000:00010000:3.0:1715206628.422905:0:6997:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012ffd6880/0x8c55e4ad37f661d5 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7a05b0f6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6997 initiator: MDT0 00010000:00010000:3.0:1715206628.422909:0:6997:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012ffd6880/0x8c55e4ad37f661d5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7a05b0f6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6997 initiator: MDT0 00010000:00010000:3.0:1715206628.422913:0:6997:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88012ffd6880 already unused, calling callback (ffffffffa13a3730) 00010000:00010000:3.0:1715206628.422915:0:6997:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012ffd6880/0x8c55e4ad37f661d5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7a05b0f6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6997 initiator: MDT0 00010000:00010000:3.0:1715206628.422926:0:6997:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012ffd6880/0x8c55e4ad37f661d5 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7a05b0f6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6997 initiator: MDT0 00010000:00010000:3.0:1715206628.422932:0:6997:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7a05b0f6 (ffff8800a6ad9d00) 00010000:00010000:3.0:1715206628.422934:0:6997:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1715206628.422936:0:6997:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012ffd6880/0x8c55e4ad37f661d5 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7a05b0f6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6997 initiator: MDT0 00010000:00010000:3.0:1715206628.422941:0:6997:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012ffd6880/0x8c55e4ad37f661d5 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7a05b0f6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6997 initiator: MDT0 00010000:00010000:3.0:1715206628.422973:0:6997:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012ffd4480/0x8c55e4ad37f661c7 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.38@tcp remote: 0xbbeffb005ec3de05 expref: 20 pid: 6997 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715206628.422978:0:6997:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012ffd4480/0x8c55e4ad37f661c7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.38@tcp remote: 0xbbeffb005ec3de05 expref: 20 pid: 6997 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715206628.422984:0:6997:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012ffd4480, rc 0) 00000100:00100000:3.0:1715206628.423030:0:6997:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008eba9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cbae74da-7571-45ad-b971-0e0378bbd4e4+19:28415:x1798523503845632:12345-192.168.202.38@tcp:101:rm.0 Request processed in 1233us (1385us total) trans 0 rc 301/301 00000100:00100000:3.0:1715206628.423035:0:6997:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.38@tcp, seq: 184 00000001:02000400:3.0:1715206628.752174:0:10485:0:(debug.c:705:libcfs_debug_mark_buffer()) DEBUG MARKER: sanity-hsm test_10a: @@@@@@ FAIL: cannot create /mnt/lustre2/d10a.sanity-hsm/f10a.sanity-hsm with cp, status=1 00010000:00010000:1.0:1715206628.866432:0:8591:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) Debug log: 318 lines, 318 kept, 0 dropped, 0 bad.