00010000:00010000:2.0F:1715206684.978376:0:18958:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0F:1715206685.327255:0:3208:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.38@tcp (source: 12345-192.168.202.38@tcp) 00000100:00100000:2.0:1715206685.327308:0:11480:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798523503858240 00000100:00100000:2.0:1715206685.327318:0:11480:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798523503858240 00000100:00080000:3.0F:1715206685.327361:0:6994:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 older than 1715206655 00000100:00100000:2.0:1715206685.327367:0:11480:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.38@tcp, seq: 210 00000100:00100000:2.0:1715206685.327373:0:11480:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008db29f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:cbae74da-7571-45ad-b971-0e0378bbd4e4+19:6676:x1798523503858240:12345-192.168.202.38@tcp:60:lhsmtool_posix.0 00000100:00100000:2.0:1715206685.327453:0:11480:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008db29f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:cbae74da-7571-45ad-b971-0e0378bbd4e4+19:6676:x1798523503858240:12345-192.168.202.38@tcp:60:lhsmtool_posix.0 Request processed in 81us (206us total) trans 0 rc 0/0 00000100:00100000:2.0:1715206685.327459:0:11480:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.38@tcp, seq: 210 00000100:00100000:0.0:1715206685.328204:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.38@tcp (source: 12345-192.168.202.38@tcp) 00000100:00100000:3.0:1715206685.328287:0:13448:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798523503858368 00000100:00100000:3.0:1715206685.328292:0:13448:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798523503858368 00000100:00100000:3.0:1715206685.328317:0:13448:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.38@tcp, seq: 45 00000100:00100000:3.0:1715206685.328323:0:13448:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008db2a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:cbae74da-7571-45ad-b971-0e0378bbd4e4+19:6676:x1798523503858368:12345-192.168.202.38@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1715206685.328524:0:13448:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008db2a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:cbae74da-7571-45ad-b971-0e0378bbd4e4+20:6676:x1798523503858368:12345-192.168.202.38@tcp:35:lhsmtool_posix.0 Request processed in 199us (320us total) trans 4294967414 rc 0/0 00000100:00100000:3.0:1715206685.328531:0:13448:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.38@tcp, seq: 45 00010000:00010000:2.0:1715206685.980408:0:6987:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1715206686.982403:0:6986:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1715206687.221375:0:14992:0:(llog.c:735:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1715206687.221380:0:14992:0:(llog_cat.c:796:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1715206687.221740:0:14992:0:(llog.c:792:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 1 00000040:00080000:0.0:1715206687.221746:0:14992:0:(llog.c:792:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1715206687.804353:0:3218:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1715206687.804368:0:3218:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008e41d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3218:1798523508084096:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1715206687.804430:0:3218:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1715206687.804498:0:8579:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798523508084096 00000100:00100000:0.0:1715206687.804505:0:8579:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798523508084096 00000100:00100000:0.0:1715206687.804544:0:8579:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 395 00000100:00080000:2.0:1715206687.804545:0:6994:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 older than 1715206657 00000100:00100000:0.0:1715206687.804548:0:8579:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e41f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3218:x1798523508084096:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1715206687.804574:0:8579:0:(ofd_obd.c:743:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3857711104 avail 3855613952 00000100:00100000:0.0:1715206687.804604:0:8579:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e41f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3218:x1798523508084096:12345-0@lo:13:osp-pre-0-0.0 Request processed in 55us (174us total) trans 0 rc 0/0 00000100:00100000:0.0:1715206687.804608:0:8579:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 395 00000100:00100000:2.0:1715206687.804626:0:3218:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008e41d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3218:1798523508084096:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1715206687.918164:0:3209:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.38@tcp (source: 12345-192.168.202.38@tcp) 00000100:00100000:2.0:1715206687.918194:0:3209:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.38@tcp (source: 12345-192.168.202.38@tcp) 00000100:00100000:2.0:1715206687.918212:0:3209:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.38@tcp (source: 12345-192.168.202.38@tcp) 00000100:00100000:3.0:1715206687.918215:0:11480:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798523503858496 00000100:00100000:3.0:1715206687.918225:0:11480:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798523503858496 00000100:00100000:2.0:1715206687.918225:0:6993:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798523503858432 00000100:00100000:2.0:1715206687.918228:0:6993:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798523503858432 00000100:00100000:2.0:1715206687.918262:0:6993:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.38@tcp, seq: 755 00000100:00100000:2.0:1715206687.918266:0:6993:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012bda9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ff645b43-0d7b-4a37-b9cc-6ac8f8d65c0d+12:1956:x1798523503858432:12345-192.168.202.38@tcp:400:kworker.0 00000100:00100000:3.0:1715206687.918267:0:11480:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.38@tcp, seq: 875 00000100:00100000:3.0:1715206687.918285:0:11480:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e41d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:cbae74da-7571-45ad-b971-0e0378bbd4e4+20:1957:x1798523503858496:12345-192.168.202.38@tcp:400:kworker.0 00000100:00100000:1.0F:1715206687.918304:0:8576:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798523503858560 00000100:00100000:1.0:1715206687.918314:0:8576:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798523503858560 00000100:00100000:3.0:1715206687.918328:0:11480:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e41d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:cbae74da-7571-45ad-b971-0e0378bbd4e4+20:1957:x1798523503858496:12345-192.168.202.38@tcp:400:kworker.0 Request processed in 58us (170us total) trans 0 rc 0/0 00000100:00100000:2.0:1715206687.918329:0:6993:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012bda9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ff645b43-0d7b-4a37-b9cc-6ac8f8d65c0d+12:1956:x1798523503858432:12345-192.168.202.38@tcp:400:kworker.0 Request processed in 62us (134us total) trans 0 rc 0/0 00000100:00100000:3.0:1715206687.918333:0:11480:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.38@tcp, seq: 875 00000100:00100000:2.0:1715206687.918334:0:6993:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.38@tcp, seq: 755 00000100:00100000:1.0:1715206687.918340:0:8576:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.38@tcp, seq: 452 00000100:00100000:1.0:1715206687.918345:0:8576:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e41d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:cbae74da-7571-45ad-b971-0e0378bbd4e4+6:1956:x1798523503858560:12345-192.168.202.38@tcp:400:kworker.0 00000100:00080000:3.0:1715206687.918346:0:6994:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 older than 1715206657 00000100:00080000:3.0:1715206687.918349:0:6994:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd MGS older than 1715206657 00000100:00080000:3.0:1715206687.918350:0:6994:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 older than 1715206657 00000100:00100000:1.0:1715206687.918373:0:8576:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e41d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:cbae74da-7571-45ad-b971-0e0378bbd4e4+6:1956:x1798523503858560:12345-192.168.202.38@tcp:400:kworker.0 Request processed in 28us (160us total) trans 0 rc 0/0 00000100:00100000:1.0:1715206687.918379:0:8576:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.38@tcp, seq: 452 00000001:00080000:3.0:1715206687.933089:0:7244:0:(tgt_lastrcvd.c:969:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967413 is committed 00000001:00080000:3.0:1715206687.933101:0:7244:0:(tgt_lastrcvd.c:969:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967414 is committed 00010000:00010000:2.0:1715206687.984370:0:8591:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1715206688.012348:0:3217:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1715206688.012361:0:3217:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88009becea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3217:1798523508084160:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1715206688.012373:0:3215:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008db2a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:47336e3e-5c2f-4892-9b72-90c87ec36b26:3215:1798523508084224:0@lo:400:kworker.0 00000100:00100000:0.0:1715206688.012402:0:3216:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008db2aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3216:1798523508084288:0@lo:400:kworker.0 00000100:00100000:3.0:1715206688.012404:0:3217:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1715206688.012409:0:3215:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1715206688.012422:0:3217:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008db2ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3217:1798523508084352:0@lo:400:kworker.0 00000100:00100000:2.0:1715206688.012426:0:3215:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008db2b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3215:1798523508084480:0@lo:400:kworker.0 00000100:00100000:0.0:1715206688.012432:0:3216:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1715206688.012443:0:6993:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798523508084224 00000100:00100000:2.0:1715206688.012445:0:3215:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1715206688.012447:0:6993:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798523508084224 00000100:00100000:0.0:1715206688.012450:0:3216:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008db2b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3216:1798523508084544:0@lo:400:kworker.0 00000100:00100000:2.0:1715206688.012464:0:3218:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008db2b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3218:1798523508084416:0@lo:400:kworker.0 00000100:00100000:0.0:1715206688.012467:0:3216:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1715206688.012472:0:6993:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 756 00000100:00100000:3.0:1715206688.012480:0:6993:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012bda9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:47336e3e-5c2f-4892-9b72-90c87ec36b26+18:3215:x1798523508084224:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1715206688.012482:0:3218:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1715206688.012490:0:8579:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798523508084160 00000100:00100000:0.0:1715206688.012493:0:8579:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798523508084160 00000100:00100000:2.0:1715206688.012499:0:16530:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798523508084544 00000100:00100000:2.0:1715206688.012502:0:16530:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798523508084544 00000100:00100000:3.0:1715206688.012508:0:6993:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012bda9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:47336e3e-5c2f-4892-9b72-90c87ec36b26+18:3215:x1798523508084224:12345-0@lo:400:kworker.0 Request processed in 28us (100us total) trans 0 rc 0/0 00000100:00100000:3.0:1715206688.012513:0:6993:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 756 00000100:00100000:0.0:1715206688.012513:0:8579:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 396 00000100:00100000:0.0:1715206688.012517:0:8579:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009becf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3217:x1798523508084160:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1715206688.012518:0:16530:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798523508084416 00000100:00100000:2.0:1715206688.012521:0:16530:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798523508084416 00000100:00100000:3.0:1715206688.012532:0:11480:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798523508084288 00000100:00100000:2.0:1715206688.012532:0:16530:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 453 00000100:00100000:3.0:1715206688.012534:0:11480:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798523508084288 00000100:00100000:2.0:1715206688.012536:0:16530:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008db28700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+6:3216:x1798523508084544:12345-0@lo:400:kworker.0 00002000:00000024:0.0:1715206688.012542:0:8579:0:(ofd_obd.c:743:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3857711104 avail 3855613952 00000100:00100000:3.0:1715206688.012545:0:11480:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798523508084480 00000100:00100000:3.0:1715206688.012547:0:11480:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798523508084480 00000100:00100000:3.0:1715206688.012556:0:11480:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 876 00000100:00100000:3.0:1715206688.012559:0:11480:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008db2bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3216:x1798523508084288:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1715206688.012566:0:8579:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009becf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3217:x1798523508084160:12345-0@lo:13:osp-pre-1-0.0 Request processed in 49us (162us total) trans 0 rc 0/0 00000100:00100000:2.0:1715206688.012567:0:16530:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008db28700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+6:3216:x1798523508084544:12345-0@lo:400:kworker.0 Request processed in 31us (100us total) trans 0 rc 0/0 00000100:00100000:0.0:1715206688.012572:0:8579:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 396 00000100:00100000:2.0:1715206688.012573:0:16530:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 453 00000100:00100000:3.0:1715206688.012581:0:11480:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008db2bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3216:x1798523508084288:12345-0@lo:400:kworker.0 Request processed in 21us (148us total) trans 0 rc 0/0 00000100:00100000:2.0:1715206688.012582:0:16530:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 454 00000100:00100000:2.0:1715206688.012585:0:16530:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e41c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+5:3218:x1798523508084416:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1715206688.012586:0:11480:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 876 00000100:00100000:0.0:1715206688.012590:0:4437:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 877 00000100:00100000:0.0:1715206688.012594:0:4437:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e41ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0001_UUID+5:3215:x1798523508084480:12345-0@lo:400:kworker.0 00000100:00080000:3.0:1715206688.012598:0:6994:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 older than 1715206658 00000100:00080000:3.0:1715206688.012600:0:6994:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 older than 1715206658 00000100:00080000:3.0:1715206688.012602:0:6994:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd MGS older than 1715206658 00000100:00100000:2.0:1715206688.012609:0:16530:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e41c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+5:3218:x1798523508084416:12345-0@lo:400:kworker.0 Request processed in 22us (126us total) trans 0 rc 0/0 00000100:00100000:3.0:1715206688.012611:0:3217:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1715206688.012614:0:16530:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 454 00000100:00100000:0.0:1715206688.012623:0:4437:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e41ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0001_UUID+5:3215:x1798523508084480:12345-0@lo:400:kworker.0 Request processed in 29us (177us total) trans 0 rc 0/0 00000100:00100000:0.0:1715206688.012628:0:4437:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 877 00000100:00100000:2.0:1715206688.012631:0:6998:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798523508084352 00000100:00100000:2.0:1715206688.012634:0:6998:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798523508084352 00000100:00100000:3.0:1715206688.012637:0:3217:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88009becea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3217:1798523508084160:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1715206688.012649:0:6998:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 878 00000100:00100000:2.0:1715206688.012652:0:6998:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009becf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3217:x1798523508084352:12345-0@lo:400:kworker.0 00000100:00080000:3.0:1715206688.012654:0:6994:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 older than 1715206658 00000100:00100000:2.0:1715206688.012674:0:6998:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009becf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3217:x1798523508084352:12345-0@lo:400:kworker.0 Request processed in 22us (63us total) trans 0 rc 0/0 00000100:00100000:2.0:1715206688.012680:0:6998:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 878 00000100:00100000:3.0:1715206688.012683:0:3217:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008db2ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3217:1798523508084352:0@lo:400:kworker.0 00000100:00100000:0.0:1715206688.012688:0:3216:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008db2aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3216:1798523508084288:0@lo:400:kworker.0 00000100:00100000:0.0:1715206688.012696:0:3216:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008db2b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3216:1798523508084544:0@lo:400:kworker.0 00000100:00100000:2.0:1715206688.012707:0:3218:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008db2b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3218:1798523508084416:0@lo:400:kworker.0 00000100:00100000:2.0:1715206688.012723:0:3215:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008db2b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3215:1798523508084480:0@lo:400:kworker.0 00000100:00100000:2.0:1715206688.012730:0:3215:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008db2a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:47336e3e-5c2f-4892-9b72-90c87ec36b26:3215:1798523508084224:0@lo:400:kworker.0 00000001:02000400:1.0:1715206688.787118:0:23322:0:(debug.c:705:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-hsm test 12d: Restore of a non archived, non released file must work ========================================================== 18:18:08 (1715206688) 00000100:00100000:0.0:1715206688.845985:0:3208:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.38@tcp (source: 12345-192.168.202.38@tcp) 00000100:00100000:2.0:1715206688.846083:0:6998:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798523503858752 00000100:00100000:2.0:1715206688.846092:0:6998:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798523503858752 00000100:00100000:2.0:1715206688.846145:0:6998:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.38@tcp, seq: 211 00000100:00100000:2.0:1715206688.846152:0:6998:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008db2b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cbae74da-7571-45ad-b971-0e0378bbd4e4+18:7586:x1798523503858752:12345-192.168.202.38@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1715206688.846170:0:6998:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1715206688.846188:0:6998:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009bffef40/0x8c55e4ad37f664ec lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbbeffb005ec3e035 expref: -99 pid: 6998 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715206688.846293:0:6998:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009bffed00/0x8c55e4ad37f664f3 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6998 initiator: MDT0 00010000:00010000:2.0:1715206688.846303:0:6998:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009bffed00/0x8c55e4ad37f664f3 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6998 initiator: MDT0 00010000:00010000:2.0:1715206688.846310:0:6998:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009bffed00/0x8c55e4ad37f664f3 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6998 initiator: MDT0 00010000:00010000:2.0:1715206688.846319:0:6998:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009bffeac0/0x8c55e4ad37f664fa lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x646966 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6998 initiator: MDT0 00010000:00010000:2.0:1715206688.846325:0:6998:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009bffeac0/0x8c55e4ad37f664fa lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x646966 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6998 initiator: MDT0 00010000:00010000:2.0:1715206688.846331:0:6998:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009bffeac0/0x8c55e4ad37f664fa lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x646966 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6998 initiator: MDT0 00000004:00200000:2.0:1715206688.846405:0:6998:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 10752 00010000:00010000:2.0:1715206688.846522:0:6998:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009bffed00/0x8c55e4ad37f664f3 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6998 initiator: MDT0 00010000:00010000:2.0:1715206688.846529:0:6998:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009bffed00/0x8c55e4ad37f664f3 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6998 initiator: MDT0 00010000:00010000:2.0:1715206688.846535:0:6998:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009bffed00/0x8c55e4ad37f664f3 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6998 initiator: MDT0 00010000:00010000:2.0:1715206688.846540:0:6998:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88009bffed00 already unused, calling callback (ffffffffa13a3730) 00010000:00010000:2.0:1715206688.846544:0:6998:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009bffed00/0x8c55e4ad37f664f3 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6998 initiator: MDT0 00010000:00010000:2.0:1715206688.846550:0:6998:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009bffed00/0x8c55e4ad37f664f3 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6998 initiator: MDT0 00010000:00010000:2.0:1715206688.846560:0:6998:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff88008e524300) 00010000:00010000:2.0:1715206688.846563:0:6998:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1715206688.846566:0:6998:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009bffed00/0x8c55e4ad37f664f3 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6998 initiator: MDT0 00010000:00010000:2.0:1715206688.846569:0:6998:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009bffed00/0x8c55e4ad37f664f3 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6998 initiator: MDT0 00010000:00010000:2.0:1715206688.846588:0:6998:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009bffeac0/0x8c55e4ad37f664fa lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x646966 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6998 initiator: MDT0 00010000:00010000:2.0:1715206688.846591:0:6998:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009bffeac0/0x8c55e4ad37f664fa lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x646966 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6998 initiator: MDT0 00010000:00010000:2.0:1715206688.846594:0:6998:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009bffeac0/0x8c55e4ad37f664fa lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x646966 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6998 initiator: MDT0 00010000:00010000:2.0:1715206688.846597:0:6998:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88009bffeac0 already unused, calling callback (ffffffffa13a3730) 00010000:00010000:2.0:1715206688.846598:0:6998:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009bffeac0/0x8c55e4ad37f664fa lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x646966 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6998 initiator: MDT0 00010000:00010000:2.0:1715206688.846606:0:6998:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009bffeac0/0x8c55e4ad37f664fa lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x646966 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6998 initiator: MDT0 00010000:00010000:2.0:1715206688.846610:0:6998:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x646966 (ffff8800a68d3700) 00010000:00010000:2.0:1715206688.846612:0:6998:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1715206688.846613:0:6998:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009bffeac0/0x8c55e4ad37f664fa lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x646966 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6998 initiator: MDT0 00010000:00010000:2.0:1715206688.846616:0:6998:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009bffeac0/0x8c55e4ad37f664fa lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x646966 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6998 initiator: MDT0 00010000:00010000:2.0:1715206688.846641:0:6998:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009bffef40/0x8c55e4ad37f664ec lrc: 1/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.38@tcp remote: 0xbbeffb005ec3e035 expref: 20 pid: 6998 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715206688.846646:0:6998:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009bffef40/0x8c55e4ad37f664ec lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.38@tcp remote: 0xbbeffb005ec3e035 expref: 20 pid: 6998 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715206688.846651:0:6998:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009bffef40, rc 0) 00000100:00100000:2.0:1715206688.846700:0:6998:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008db2b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cbae74da-7571-45ad-b971-0e0378bbd4e4+19:7586:x1798523503858752:12345-192.168.202.38@tcp:101:lhsmtool_posix.0 Request processed in 546us (721us total) trans 4294967415 rc 301/301 00000100:00100000:2.0:1715206688.846704:0:6998:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.38@tcp, seq: 211 00000100:00100000:0.0:1715206688.847583:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.38@tcp (source: 12345-192.168.202.38@tcp) 00000100:00100000:2.0:1715206688.847632:0:6998:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798523503858816 00000100:00100000:2.0:1715206688.847636:0:6998:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798523503858816 00000100:00100000:2.0:1715206688.847657:0:6998:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.38@tcp, seq: 212 00000100:00100000:2.0:1715206688.847661:0:6998:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008db2aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cbae74da-7571-45ad-b971-0e0378bbd4e4+19:7586:x1798523503858816:12345-192.168.202.38@tcp:59:lhsmtool_posix.0 00000100:00100000:2.0:1715206688.847705:0:6998:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008db2aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cbae74da-7571-45ad-b971-0e0378bbd4e4+19:7586:x1798523503858816:12345-192.168.202.38@tcp:59:lhsmtool_posix.0 Request processed in 42us (122us total) trans 0 rc 0/0 00000100:00100000:2.0:1715206688.847712:0:6998:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.38@tcp, seq: 212 00000100:00100000:0.0:1715206688.855937:0:3209:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.38@tcp (source: 12345-192.168.202.38@tcp) 00000100:00100000:2.0:1715206688.855997:0:6998:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798523503859136 00000100:00100000:2.0:1715206688.856004:0:6998:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798523503859136 00000100:00100000:2.0:1715206688.856034:0:6998:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.38@tcp, seq: 213 00000100:00100000:2.0:1715206688.856039:0:6998:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008db29500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cbae74da-7571-45ad-b971-0e0378bbd4e4+19:7589:x1798523503859136:12345-192.168.202.38@tcp:101:rm.0 00010000:00010000:2.0:1715206688.856050:0:6998:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1715206688.856062:0:6998:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009bffe880/0x8c55e4ad37f66508 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbbeffb005ec3e058 expref: -99 pid: 6998 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715206688.856099:0:6998:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009bfffa80/0x8c55e4ad37f6650f lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6998 initiator: MDT0 00010000:00010000:2.0:1715206688.856107:0:6998:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009bfffa80/0x8c55e4ad37f6650f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6998 initiator: MDT0 00010000:00010000:2.0:1715206688.856114:0:6998:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009bfffa80/0x8c55e4ad37f6650f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6998 initiator: MDT0 00010000:00010000:2.0:1715206688.856121:0:6998:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009bffe640/0x8c55e4ad37f66516 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x9517b0f6 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6998 initiator: MDT0 00010000:00010000:2.0:1715206688.856124:0:6998:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009bffe640/0x8c55e4ad37f66516 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9517b0f6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6998 initiator: MDT0 00010000:00010000:2.0:1715206688.856128:0:6998:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009bffe640/0x8c55e4ad37f66516 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9517b0f6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6998 initiator: MDT0 00010000:00010000:2.0:1715206688.856190:0:6998:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009bfffa80/0x8c55e4ad37f6650f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6998 initiator: MDT0 00010000:00010000:2.0:1715206688.856197:0:6998:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009bfffa80/0x8c55e4ad37f6650f lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6998 initiator: MDT0 00010000:00010000:2.0:1715206688.856202:0:6998:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009bfffa80/0x8c55e4ad37f6650f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6998 initiator: MDT0 00010000:00010000:2.0:1715206688.856218:0:6998:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88009bfffa80 already unused, calling callback (ffffffffa13a3730) 00010000:00010000:2.0:1715206688.856221:0:6998:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009bfffa80/0x8c55e4ad37f6650f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6998 initiator: MDT0 00010000:00010000:2.0:1715206688.856228:0:6998:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009bfffa80/0x8c55e4ad37f6650f lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6998 initiator: MDT0 00010000:00010000:2.0:1715206688.856237:0:6998:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800a68d3200) 00010000:00010000:2.0:1715206688.856240:0:6998:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1715206688.856243:0:6998:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009bfffa80/0x8c55e4ad37f6650f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6998 initiator: MDT0 00010000:00010000:2.0:1715206688.856249:0:6998:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009bfffa80/0x8c55e4ad37f6650f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6998 initiator: MDT0 00010000:00010000:2.0:1715206688.856296:0:6998:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009bffe640/0x8c55e4ad37f66516 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9517b0f6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6998 initiator: MDT0 00010000:00010000:2.0:1715206688.856301:0:6998:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009bffe640/0x8c55e4ad37f66516 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9517b0f6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6998 initiator: MDT0 00010000:00010000:2.0:1715206688.856306:0:6998:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009bffe640/0x8c55e4ad37f66516 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9517b0f6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6998 initiator: MDT0 00010000:00010000:2.0:1715206688.856311:0:6998:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88009bffe640 already unused, calling callback (ffffffffa13a3730) 00010000:00010000:2.0:1715206688.856314:0:6998:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009bffe640/0x8c55e4ad37f66516 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9517b0f6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6998 initiator: MDT0 00010000:00010000:2.0:1715206688.856319:0:6998:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009bffe640/0x8c55e4ad37f66516 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9517b0f6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6998 initiator: MDT0 00010000:00010000:2.0:1715206688.856326:0:6998:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x9517b0f6 (ffff8800a68d3100) 00010000:00010000:2.0:1715206688.856328:0:6998:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1715206688.856337:0:6998:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009bffe640/0x8c55e4ad37f66516 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x9517b0f6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6998 initiator: MDT0 00010000:00010000:2.0:1715206688.856342:0:6998:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009bffe640/0x8c55e4ad37f66516 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x9517b0f6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6998 initiator: MDT0 00010000:00010000:2.0:1715206688.856381:0:6998:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009bffe880/0x8c55e4ad37f66508 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.38@tcp remote: 0xbbeffb005ec3e058 expref: 20 pid: 6998 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715206688.856388:0:6998:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009bffe880/0x8c55e4ad37f66508 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.38@tcp remote: 0xbbeffb005ec3e058 expref: 20 pid: 6998 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715206688.856396:0:6998:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009bffe880, rc 0) 00000100:00100000:2.0:1715206688.856445:0:6998:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008db29500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cbae74da-7571-45ad-b971-0e0378bbd4e4+19:7589:x1798523503859136:12345-192.168.202.38@tcp:101:rm.0 Request processed in 404us (513us total) trans 0 rc 301/301 00000100:00100000:2.0:1715206688.856452:0:6998:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.38@tcp, seq: 213 00010000:00010000:2.0:1715206688.986363:0:10149:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1715206689.177731:0:23386:0:(debug.c:705:libcfs_debug_mark_buffer()) DEBUG MARKER: sanity-hsm test_12d: @@@@@@ FAIL: cannot create /mnt/lustre2/d12d.sanity-hsm/f12d.sanity-hsm with cp, status=1 00000040:00080000:0.0:1715206689.221379:0:14992:0:(llog.c:735:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1715206689.221385:0:14992:0:(llog_cat.c:796:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1715206689.221661:0:14992:0:(llog.c:792:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 1 00000040:00080000:0.0:1715206689.221666:0:14992:0:(llog.c:792:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 Debug log: 221 lines, 221 kept, 0 dropped, 0 bad.