00000100:00100000:2.0F:1715206696.758660:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.38@tcp (source: 12345-192.168.202.38@tcp) 00000100:00100000:3.0F:1715206696.758782:0:4437:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798523503860288 00000100:00100000:3.0:1715206696.758793:0:4437:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798523503860288 00000100:00080000:1.0F:1715206696.758834:0:6994:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 older than 1715206666 00000100:00100000:3.0:1715206696.758836:0:4437:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.38@tcp, seq: 218 00000100:00100000:3.0:1715206696.758842:0:4437:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e41ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:cbae74da-7571-45ad-b971-0e0378bbd4e4+19:8951:x1798523503860288:12345-192.168.202.38@tcp:60:lhsmtool_posix.0 00000100:00100000:3.0:1715206696.758914:0:4437:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e41ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:cbae74da-7571-45ad-b971-0e0378bbd4e4+19:8951:x1798523503860288:12345-192.168.202.38@tcp:60:lhsmtool_posix.0 Request processed in 71us (259us total) trans 0 rc 0/0 00000100:00100000:3.0:1715206696.758921:0:4437:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.38@tcp, seq: 218 00000100:00100000:0.0F:1715206696.761004:0:3208:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.38@tcp (source: 12345-192.168.202.38@tcp) 00000100:00100000:2.0:1715206696.761038:0:13448:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798523503860416 00000100:00100000:2.0:1715206696.761044:0:13448:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798523503860416 00000100:00100000:2.0:1715206696.761064:0:13448:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.38@tcp, seq: 47 00000100:00100000:2.0:1715206696.761070:0:13448:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880132398e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:cbae74da-7571-45ad-b971-0e0378bbd4e4+19:8951:x1798523503860416:12345-192.168.202.38@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1715206696.761253:0:13448:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880132398e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:cbae74da-7571-45ad-b971-0e0378bbd4e4+20:8951:x1798523503860416:12345-192.168.202.38@tcp:35:lhsmtool_posix.0 Request processed in 181us (251us total) trans 4294967418 rc 0/0 00000100:00100000:2.0:1715206696.761261:0:13448:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.38@tcp, seq: 47 00010000:00010000:2.0:1715206697.002367:0:6986:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1715206697.222416:0:14992:0:(llog.c:735:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1715206697.222422:0:14992:0:(llog_cat.c:796:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1715206697.222796:0:14992:0:(llog.c:792:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 1 00000040:00080000:2.0:1715206697.222804:0:14992:0:(llog.c:792:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1715206697.820364:0:3217:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880132399180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3217:1798523508085120:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1715206697.820412:0:3217:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1715206697.820440:0:10974:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798523508085120 00000100:00100000:1.0:1715206697.820448:0:10974:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798523508085120 00000100:00080000:0.0:1715206697.820477:0:6994:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 older than 1715206667 00000100:00100000:1.0:1715206697.820481:0:10974:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 399 00000100:00100000:1.0:1715206697.820485:0:10974:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e41ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3217:x1798523508085120:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1715206697.820511:0:10974:0:(ofd_obd.c:743:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3857711104 avail 3855613952 00000100:00100000:1.0:1715206697.820552:0:10974:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e41ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3217:x1798523508085120:12345-0@lo:13:osp-pre-0-0.0 Request processed in 66us (139us total) trans 0 rc 0/0 00000100:00100000:1.0:1715206697.820556:0:10974:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 399 00000100:00100000:2.0:1715206697.820571:0:3217:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff880132399180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3217:1798523508085120:0@lo:13:osp-pre-0-0.0 00000001:00080000:3.0:1715206697.932892:0:7244:0:(tgt_lastrcvd.c:969:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967418 is committed 00000100:00100000:0.0:1715206697.934108:0:3209:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.38@tcp (source: 12345-192.168.202.38@tcp) 00000100:00100000:0.0:1715206697.934145:0:3209:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.38@tcp (source: 12345-192.168.202.38@tcp) 00000100:00100000:3.0:1715206697.934156:0:4437:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798523503860544 00000100:00100000:3.0:1715206697.934164:0:4437:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798523503860544 00000100:00100000:0.0:1715206697.934176:0:3209:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.38@tcp (source: 12345-192.168.202.38@tcp) 00000100:00100000:1.0:1715206697.934177:0:6993:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798523503860480 00000100:00100000:1.0:1715206697.934182:0:6993:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798523503860480 00000100:00100000:3.0:1715206697.934203:0:4437:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.38@tcp, seq: 883 00000100:00100000:1.0:1715206697.934205:0:6993:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.38@tcp, seq: 759 00000100:00080000:0.0:1715206697.934205:0:6994:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd MGS older than 1715206667 00000100:00100000:3.0:1715206697.934210:0:4437:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880132399500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:cbae74da-7571-45ad-b971-0e0378bbd4e4+18:1954:x1798523503860544:12345-192.168.202.38@tcp:400:kworker.0 00000100:00100000:1.0:1715206697.934210:0:6993:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012bda8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ff645b43-0d7b-4a37-b9cc-6ac8f8d65c0d+12:1955:x1798523503860480:12345-192.168.202.38@tcp:400:kworker.0 00000100:00100000:1.0:1715206697.934258:0:6993:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012bda8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ff645b43-0d7b-4a37-b9cc-6ac8f8d65c0d+12:1955:x1798523503860480:12345-192.168.202.38@tcp:400:kworker.0 Request processed in 49us (114us total) trans 0 rc 0/0 00000100:00100000:1.0:1715206697.934264:0:6993:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.38@tcp, seq: 759 00000100:00100000:3.0:1715206697.934265:0:4437:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880132399500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:cbae74da-7571-45ad-b971-0e0378bbd4e4+18:1954:x1798523503860544:12345-192.168.202.38@tcp:400:kworker.0 Request processed in 54us (161us total) trans 0 rc 0/0 00000100:00100000:3.0:1715206697.934287:0:4437:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.38@tcp, seq: 883 00000100:00100000:1.0:1715206697.934302:0:8576:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798523503860608 00000100:00100000:1.0:1715206697.934304:0:8576:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798523503860608 00000100:00080000:2.0:1715206697.934315:0:6994:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 older than 1715206667 00000100:00100000:1.0:1715206697.934319:0:8576:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.38@tcp, seq: 458 00000100:00100000:1.0:1715206697.934322:0:8576:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880132399880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:cbae74da-7571-45ad-b971-0e0378bbd4e4+6:1955:x1798523503860608:12345-192.168.202.38@tcp:400:kworker.0 00000100:00100000:1.0:1715206697.934336:0:8576:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880132399880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:cbae74da-7571-45ad-b971-0e0378bbd4e4+6:1955:x1798523503860608:12345-192.168.202.38@tcp:400:kworker.0 Request processed in 15us (162us total) trans 0 rc 0/0 00000100:00100000:1.0:1715206697.934340:0:8576:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.38@tcp, seq: 458 00010000:00010000:2.0:1715206698.004456:0:8591:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1715206698.028364:0:3216:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1715206698.028364:0:3218:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880132399c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:47336e3e-5c2f-4892-9b72-90c87ec36b26:3218:1798523508085184:0@lo:400:kworker.0 00000100:00100000:2.0:1715206698.028377:0:3216:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880132399f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3216:1798523508085312:0@lo:400:kworker.0 00000100:00100000:3.0:1715206698.028394:0:3215:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88013239aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3215:1798523508085504:0@lo:400:kworker.0 00000100:00100000:0.0:1715206698.028401:0:3217:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88013239a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3217:1798523508085376:0@lo:400:kworker.0 00000100:00100000:2.0:1715206698.028425:0:3216:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1715206698.028426:0:3218:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1715206698.028441:0:4437:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798523508085312 00000100:00100000:0.0:1715206698.028442:0:6992:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798523508085184 00000100:00100000:3.0:1715206698.028447:0:4437:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798523508085312 00000100:00100000:0.0:1715206698.028447:0:6992:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798523508085184 00000100:00100000:2.0:1715206698.028452:0:3216:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800b524df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3216:1798523508085248:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1715206698.028454:0:3218:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88013239a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3218:1798523508085440:0@lo:400:kworker.0 00000100:00100000:2.0:1715206698.028471:0:3216:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1715206698.028473:0:6992:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 760 00000100:00100000:3.0:1715206698.028474:0:4437:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 884 00000100:00100000:3.0:1715206698.028479:0:4437:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d8f7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0000_UUID+5:3216:x1798523508085312:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1715206698.028479:0:6992:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012bda8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:47336e3e-5c2f-4892-9b72-90c87ec36b26+18:3218:x1798523508085184:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1715206698.028482:0:3218:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1715206698.028484:0:3216:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88013239ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3216:1798523508085568:0@lo:400:kworker.0 00000100:00100000:2.0:1715206698.028500:0:3216:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1715206698.028507:0:10974:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798523508085248 00000100:00100000:1.0:1715206698.028510:0:10974:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798523508085248 00000100:00100000:3.0:1715206698.028515:0:4437:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d8f7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0000_UUID+5:3216:x1798523508085312:12345-0@lo:400:kworker.0 Request processed in 37us (92us total) trans 0 rc 0/0 00000100:00100000:0.0:1715206698.028520:0:6992:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012bda8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:47336e3e-5c2f-4892-9b72-90c87ec36b26+18:3218:x1798523508085184:12345-0@lo:400:kworker.0 Request processed in 42us (94us total) trans 0 rc 0/0 00000100:00100000:3.0:1715206698.028521:0:4437:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 884 00000100:00100000:0.0:1715206698.028525:0:6992:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 760 00000100:00100000:2.0:1715206698.028526:0:3216:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff880132399f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3216:1798523508085312:0@lo:400:kworker.0 00000100:00100000:1.0:1715206698.028528:0:10974:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 400 00000100:00100000:1.0:1715206698.028531:0:10974:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bfc3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3216:x1798523508085248:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1715206698.028542:0:16530:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798523508085440 00000100:00100000:3.0:1715206698.028544:0:16530:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798523508085440 00000100:00100000:0.0:1715206698.028545:0:3217:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00000024:1.0:1715206698.028555:0:10974:0:(ofd_obd.c:743:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3857711104 avail 3855613952 00000100:00100000:3.0:1715206698.028558:0:16530:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798523508085568 00000100:00100000:2.0:1715206698.028558:0:11480:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798523508085376 00000100:00100000:3.0:1715206698.028560:0:16530:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798523508085568 00000100:00100000:2.0:1715206698.028561:0:11480:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798523508085376 00000100:00100000:0.0:1715206698.028567:0:3218:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff880132399c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:47336e3e-5c2f-4892-9b72-90c87ec36b26:3218:1798523508085184:0@lo:400:kworker.0 00000100:00100000:1.0:1715206698.028580:0:10974:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bfc3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3216:x1798523508085248:12345-0@lo:13:osp-pre-1-0.0 Request processed in 48us (108us total) trans 0 rc 0/0 00000100:00100000:3.0:1715206698.028582:0:16530:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 459 00000100:00100000:1.0:1715206698.028585:0:10974:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 400 00000100:00100000:3.0:1715206698.028586:0:16530:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008dfd7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+5:3218:x1798523508085440:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1715206698.028589:0:8576:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 460 00000100:00100000:2.0:1715206698.028590:0:11480:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 885 00000100:00100000:0.0:1715206698.028593:0:8576:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801329fb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3216:x1798523508085568:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1715206698.028594:0:11480:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88013239b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3217:x1798523508085376:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1715206698.028620:0:16530:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008dfd7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+5:3218:x1798523508085440:12345-0@lo:400:kworker.0 Request processed in 34us (137us total) trans 0 rc 0/0 00000100:00100000:0.0:1715206698.028621:0:8576:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8801329fb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3216:x1798523508085568:12345-0@lo:400:kworker.0 Request processed in 27us (120us total) trans 0 rc 0/0 00000100:00100000:3.0:1715206698.028626:0:16530:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 459 00000100:00100000:2.0:1715206698.028626:0:11480:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88013239b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3217:x1798523508085376:12345-0@lo:400:kworker.0 Request processed in 31us (80us total) trans 0 rc 0/0 00000100:00100000:0.0:1715206698.028628:0:8576:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 460 00000100:00100000:2.0:1715206698.028631:0:11480:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 885 00000100:00100000:3.0:1715206698.028641:0:3215:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1715206698.028651:0:6996:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798523508085504 00000100:00100000:0.0:1715206698.028651:0:3217:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88013239a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3217:1798523508085376:0@lo:400:kworker.0 00000100:00100000:2.0:1715206698.028654:0:6996:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798523508085504 00000100:00100000:3.0:1715206698.028665:0:4437:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 886 00000100:00100000:0.0:1715206698.028666:0:3218:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88013239a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3218:1798523508085440:0@lo:400:kworker.0 00000100:00100000:3.0:1715206698.028668:0:4437:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009becfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0001_UUID+5:3215:x1798523508085504:12345-0@lo:400:kworker.0 00000100:00080000:2.0:1715206698.028671:0:6994:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 older than 1715206668 00000100:00080000:2.0:1715206698.028674:0:6994:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 older than 1715206668 00000100:00080000:2.0:1715206698.028675:0:6994:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd MGS older than 1715206668 00000100:00100000:2.0:1715206698.028704:0:3216:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88013239ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3216:1798523508085568:0@lo:400:kworker.0 00000100:00100000:3.0:1715206698.028706:0:4437:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009becfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0001_UUID+5:3215:x1798523508085504:12345-0@lo:400:kworker.0 Request processed in 37us (64us total) trans 0 rc 0/0 00000100:00100000:3.0:1715206698.028711:0:4437:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 886 00000100:00100000:2.0:1715206698.028715:0:3216:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff8800b524df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3216:1798523508085248:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1715206698.028732:0:3215:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88013239aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3215:1798523508085504:0@lo:400:kworker.0 00010000:00010000:2.0:1715206699.006446:0:10149:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1715206700.008429:0:18958:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1715206700.428908:0:25993:0:(debug.c:705:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-hsm test 12f: Restore a released file explicitly ========================================================== 18:18:20 (1715206700) 00000100:00100000:0.0:1715206700.488383:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.38@tcp (source: 12345-192.168.202.38@tcp) 00000100:00100000:2.0:1715206700.488420:0:11480:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798523503860800 00000100:00100000:2.0:1715206700.488428:0:11480:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798523503860800 00000100:00080000:0.0:1715206700.488460:0:6994:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 older than 1715206670 00000100:00100000:2.0:1715206700.488474:0:11480:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.38@tcp, seq: 219 00000100:00100000:2.0:1715206700.488480:0:11480:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88013239a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:cbae74da-7571-45ad-b971-0e0378bbd4e4+18:10314:x1798523503860800:12345-192.168.202.38@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1715206700.488510:0:11480:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1715206700.488524:0:11480:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009bfff600/0x8c55e4ad37f6654e lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbbeffb005ec3e0a5 expref: -99 pid: 11480 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715206700.488622:0:11480:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009bffe1c0/0x8c55e4ad37f66555 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11480 initiator: MDT0 00010000:00010000:2.0:1715206700.488631:0:11480:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009bffe1c0/0x8c55e4ad37f66555 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11480 initiator: MDT0 00010000:00010000:2.0:1715206700.488646:0:11480:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009bffe1c0/0x8c55e4ad37f66555 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11480 initiator: MDT0 00010000:00010000:2.0:1715206700.488655:0:11480:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009bffe880/0x8c55e4ad37f6655c lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x646966 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11480 initiator: MDT0 00010000:00010000:2.0:1715206700.488658:0:11480:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009bffe880/0x8c55e4ad37f6655c lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x646966 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11480 initiator: MDT0 00010000:00010000:2.0:1715206700.488662:0:11480:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009bffe880/0x8c55e4ad37f6655c lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x646966 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11480 initiator: MDT0 00000004:00200000:2.0:1715206700.488758:0:11480:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 10752 00010000:00010000:2.0:1715206700.488849:0:11480:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009bffe1c0/0x8c55e4ad37f66555 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11480 initiator: MDT0 00010000:00010000:2.0:1715206700.488853:0:11480:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009bffe1c0/0x8c55e4ad37f66555 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 11480 initiator: MDT0 00010000:00010000:2.0:1715206700.488857:0:11480:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009bffe1c0/0x8c55e4ad37f66555 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11480 initiator: MDT0 00010000:00010000:2.0:1715206700.488861:0:11480:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88009bffe1c0 already unused, calling callback (ffffffffa13a3730) 00010000:00010000:2.0:1715206700.488863:0:11480:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009bffe1c0/0x8c55e4ad37f66555 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11480 initiator: MDT0 00010000:00010000:2.0:1715206700.488867:0:11480:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009bffe1c0/0x8c55e4ad37f66555 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 11480 initiator: MDT0 00010000:00010000:2.0:1715206700.488873:0:11480:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff88008e524300) 00010000:00010000:2.0:1715206700.488875:0:11480:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1715206700.488877:0:11480:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009bffe1c0/0x8c55e4ad37f66555 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11480 initiator: MDT0 00010000:00010000:2.0:1715206700.488887:0:11480:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009bffe1c0/0x8c55e4ad37f66555 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11480 initiator: MDT0 00010000:00010000:2.0:1715206700.488893:0:11480:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009bffe880/0x8c55e4ad37f6655c lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x646966 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11480 initiator: MDT0 00010000:00010000:2.0:1715206700.488896:0:11480:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009bffe880/0x8c55e4ad37f6655c lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x646966 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11480 initiator: MDT0 00010000:00010000:2.0:1715206700.488900:0:11480:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009bffe880/0x8c55e4ad37f6655c lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x646966 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11480 initiator: MDT0 00010000:00010000:2.0:1715206700.488903:0:11480:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88009bffe880 already unused, calling callback (ffffffffa13a3730) 00010000:00010000:2.0:1715206700.488904:0:11480:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009bffe880/0x8c55e4ad37f6655c lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x646966 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11480 initiator: MDT0 00010000:00010000:2.0:1715206700.488907:0:11480:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009bffe880/0x8c55e4ad37f6655c lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x646966 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11480 initiator: MDT0 00010000:00010000:2.0:1715206700.488910:0:11480:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x646966 (ffff8800a68d3800) 00010000:00010000:2.0:1715206700.488911:0:11480:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1715206700.488912:0:11480:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009bffe880/0x8c55e4ad37f6655c lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x646966 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11480 initiator: MDT0 00010000:00010000:2.0:1715206700.488915:0:11480:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009bffe880/0x8c55e4ad37f6655c lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x646966 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11480 initiator: MDT0 00010000:00010000:2.0:1715206700.488936:0:11480:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009bfff600/0x8c55e4ad37f6654e lrc: 1/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.38@tcp remote: 0xbbeffb005ec3e0a5 expref: 20 pid: 11480 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715206700.488941:0:11480:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009bfff600/0x8c55e4ad37f6654e lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.38@tcp remote: 0xbbeffb005ec3e0a5 expref: 20 pid: 11480 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715206700.488951:0:11480:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009bfff600, rc 0) 00000100:00100000:2.0:1715206700.488991:0:11480:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88013239a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:cbae74da-7571-45ad-b971-0e0378bbd4e4+19:10314:x1798523503860800:12345-192.168.202.38@tcp:101:lhsmtool_posix.0 Request processed in 512us (616us total) trans 4294967419 rc 301/301 00000100:00100000:2.0:1715206700.488996:0:11480:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.38@tcp, seq: 219 00000100:00100000:0.0:1715206700.489860:0:3208:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.38@tcp (source: 12345-192.168.202.38@tcp) 00000100:00100000:2.0:1715206700.489901:0:11480:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798523503860864 00000100:00100000:2.0:1715206700.489906:0:11480:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798523503860864 00000100:00100000:2.0:1715206700.489927:0:11480:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.38@tcp, seq: 220 00000100:00100000:2.0:1715206700.489931:0:11480:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88013239a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:cbae74da-7571-45ad-b971-0e0378bbd4e4+19:10314:x1798523503860864:12345-192.168.202.38@tcp:59:lhsmtool_posix.0 00000100:00100000:2.0:1715206700.489970:0:11480:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88013239a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:cbae74da-7571-45ad-b971-0e0378bbd4e4+19:10314:x1798523503860864:12345-192.168.202.38@tcp:59:lhsmtool_posix.0 Request processed in 38us (112us total) trans 0 rc 0/0 00000100:00100000:2.0:1715206700.489975:0:11480:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.38@tcp, seq: 220 00000100:00100000:0.0:1715206700.497135:0:3209:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.38@tcp (source: 12345-192.168.202.38@tcp) 00000100:00100000:2.0:1715206700.497194:0:11480:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798523503861184 00000100:00100000:2.0:1715206700.497201:0:11480:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798523503861184 00000100:00100000:2.0:1715206700.497238:0:11480:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.38@tcp, seq: 221 00000100:00100000:2.0:1715206700.497244:0:11480:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880132399c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:cbae74da-7571-45ad-b971-0e0378bbd4e4+19:10317:x1798523503861184:12345-192.168.202.38@tcp:101:rm.0 00010000:00010000:2.0:1715206700.497259:0:11480:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1715206700.497289:0:11480:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009bffe640/0x8c55e4ad37f6656a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbbeffb005ec3e0c8 expref: -99 pid: 11480 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715206700.497330:0:11480:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009bfffa80/0x8c55e4ad37f66571 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11480 initiator: MDT0 00010000:00010000:2.0:1715206700.497347:0:11480:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009bfffa80/0x8c55e4ad37f66571 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11480 initiator: MDT0 00010000:00010000:2.0:1715206700.497356:0:11480:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009bfffa80/0x8c55e4ad37f66571 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11480 initiator: MDT0 00010000:00010000:2.0:1715206700.497375:0:11480:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009bffef40/0x8c55e4ad37f66578 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa717b0f6 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11480 initiator: MDT0 00010000:00010000:2.0:1715206700.497381:0:11480:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009bffef40/0x8c55e4ad37f66578 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa717b0f6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11480 initiator: MDT0 00010000:00010000:2.0:1715206700.497387:0:11480:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009bffef40/0x8c55e4ad37f66578 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa717b0f6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11480 initiator: MDT0 00010000:00010000:2.0:1715206700.497454:0:11480:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009bfffa80/0x8c55e4ad37f66571 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11480 initiator: MDT0 00010000:00010000:2.0:1715206700.497461:0:11480:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009bfffa80/0x8c55e4ad37f66571 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 11480 initiator: MDT0 00010000:00010000:2.0:1715206700.497466:0:11480:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009bfffa80/0x8c55e4ad37f66571 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11480 initiator: MDT0 00010000:00010000:2.0:1715206700.497471:0:11480:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88009bfffa80 already unused, calling callback (ffffffffa13a3730) 00010000:00010000:2.0:1715206700.497475:0:11480:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009bfffa80/0x8c55e4ad37f66571 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11480 initiator: MDT0 00010000:00010000:2.0:1715206700.497480:0:11480:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009bfffa80/0x8c55e4ad37f66571 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 11480 initiator: MDT0 00010000:00010000:2.0:1715206700.497489:0:11480:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800a68d3200) 00010000:00010000:2.0:1715206700.497492:0:11480:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1715206700.497495:0:11480:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009bfffa80/0x8c55e4ad37f66571 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11480 initiator: MDT0 00010000:00010000:2.0:1715206700.497500:0:11480:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009bfffa80/0x8c55e4ad37f66571 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11480 initiator: MDT0 00010000:00010000:2.0:1715206700.497520:0:11480:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009bffef40/0x8c55e4ad37f66578 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa717b0f6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11480 initiator: MDT0 00010000:00010000:2.0:1715206700.497536:0:11480:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009bffef40/0x8c55e4ad37f66578 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa717b0f6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11480 initiator: MDT0 00010000:00010000:2.0:1715206700.497541:0:11480:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009bffef40/0x8c55e4ad37f66578 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa717b0f6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11480 initiator: MDT0 00010000:00010000:2.0:1715206700.497556:0:11480:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88009bffef40 already unused, calling callback (ffffffffa13a3730) 00010000:00010000:2.0:1715206700.497558:0:11480:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009bffef40/0x8c55e4ad37f66578 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa717b0f6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11480 initiator: MDT0 00010000:00010000:2.0:1715206700.497562:0:11480:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009bffef40/0x8c55e4ad37f66578 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa717b0f6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11480 initiator: MDT0 00010000:00010000:2.0:1715206700.497568:0:11480:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa717b0f6 (ffff8800a68d3b00) 00010000:00010000:2.0:1715206700.497570:0:11480:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1715206700.497572:0:11480:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009bffef40/0x8c55e4ad37f66578 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa717b0f6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11480 initiator: MDT0 00010000:00010000:2.0:1715206700.497577:0:11480:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009bffef40/0x8c55e4ad37f66578 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa717b0f6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11480 initiator: MDT0 00010000:00010000:2.0:1715206700.497623:0:11480:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009bffe640/0x8c55e4ad37f6656a lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.38@tcp remote: 0xbbeffb005ec3e0c8 expref: 20 pid: 11480 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715206700.497630:0:11480:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009bffe640/0x8c55e4ad37f6656a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.38@tcp remote: 0xbbeffb005ec3e0c8 expref: 20 pid: 11480 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715206700.497636:0:11480:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009bffe640, rc 0) 00000100:00100000:2.0:1715206700.497693:0:11480:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880132399c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:cbae74da-7571-45ad-b971-0e0378bbd4e4+19:10317:x1798523503861184:12345-192.168.202.38@tcp:101:rm.0 Request processed in 447us (563us total) trans 0 rc 301/301 00000100:00100000:2.0:1715206700.497699:0:11480:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.38@tcp, seq: 221 00000001:02000400:1.0:1715206700.820526:0:26057:0:(debug.c:705:libcfs_debug_mark_buffer()) DEBUG MARKER: sanity-hsm test_12f: @@@@@@ FAIL: cannot create /mnt/lustre2/d12f.sanity-hsm/f12f.sanity-hsm with cp, status=1 00010000:00010000:2.0:1715206701.010487:0:6987:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) Debug log: 214 lines, 214 kept, 0 dropped, 0 bad.