00000040:00080000:2.0F:1715206203.638350:0:15899:0:(llog.c:735:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1715206203.638357:0:15899:0:(llog_cat.c:796:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1715206203.638656:0:15899:0:(llog.c:792:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 1 00000040:00080000:2.0:1715206203.638665:0:15899:0:(llog.c:792:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:2.0:1715206204.014374:0:6986:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0F:1715206205.016386:0:8591:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1715206205.932850:0:7244:0:(tgt_lastrcvd.c:969:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967393 is committed 00000001:00080000:3.0:1715206205.932865:0:7244:0:(tgt_lastrcvd.c:969:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967394 is committed 00010000:00010000:2.0:1715206206.018399:0:6987:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1715206207.020414:0:10149:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0F:1715206207.036430:0:3216:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008eba8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3216:1798523508028416:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1715206207.036500:0:3216:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1715206207.036538:0:10974:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798523508028416 00000100:00100000:2.0:1715206207.036546:0:10974:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798523508028416 00000100:00080000:1.0:1715206207.036568:0:6994:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 older than 1715206177 00000100:00100000:2.0:1715206207.036592:0:10974:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 203 00000100:00100000:2.0:1715206207.036598:0:10974:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e636300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3216:x1798523508028416:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1715206207.036636:0:10974:0:(ofd_obd.c:743:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3857711104 avail 3855613952 00000100:00100000:2.0:1715206207.036685:0:10974:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e636300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3216:x1798523508028416:12345-0@lo:13:osp-pre-0-0.0 Request processed in 85us (184us total) trans 0 rc 0/0 00000100:00100000:2.0:1715206207.036692:0:10974:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 203 00000100:00100000:1.0:1715206207.036727:0:3216:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008eba8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3216:1798523508028416:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1715206207.150387:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.38@tcp (source: 12345-192.168.202.38@tcp) 00000100:00100000:2.0:1715206207.150433:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.38@tcp (source: 12345-192.168.202.38@tcp) 00000100:00100000:3.0:1715206207.150450:0:6992:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798523503827072 00000100:00100000:3.0:1715206207.150460:0:6992:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798523503827072 00000100:00100000:0.0F:1715206207.150471:0:6997:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798523503827136 00000100:00100000:2.0:1715206207.150474:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.38@tcp (source: 12345-192.168.202.38@tcp) 00000100:00100000:0.0:1715206207.150484:0:6997:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798523503827136 00000100:00100000:2.0:1715206207.150508:0:8577:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798523503827200 00000100:00100000:3.0:1715206207.150511:0:6992:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.38@tcp, seq: 399 00000100:00100000:2.0:1715206207.150512:0:8577:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798523503827200 00000100:00100000:3.0:1715206207.150516:0:6992:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cb12850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ff645b43-0d7b-4a37-b9cc-6ac8f8d65c0d+12:1957:x1798523503827072:12345-192.168.202.38@tcp:400:kworker.0 00000100:00100000:0.0:1715206207.150519:0:6997:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.38@tcp, seq: 491 00000100:00080000:1.0:1715206207.150522:0:6994:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 older than 1715206177 00000100:00100000:0.0:1715206207.150524:0:6997:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008eba8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cbae74da-7571-45ad-b971-0e0378bbd4e4+18:1956:x1798523503827136:12345-192.168.202.38@tcp:400:kworker.0 00000100:00080000:1.0:1715206207.150526:0:6994:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 older than 1715206177 00000100:02000400:1.0:1715206207.150530:0:6994:0:(pinger.c:527:ping_evictor_main()) lustre-MDT0000: haven't heard from client 46af332d-2ee7-4d47-b762-82c1eb2b6bbd (at 192.168.202.38@tcp) in 31 seconds. I think it's dead, and I am evicting it. exp ffff880090f54000, cur 1715206207 expire 1715206177 last 1715206176 00000100:00100000:2.0:1715206207.150537:0:8577:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.38@tcp, seq: 244 00000100:00100000:2.0:1715206207.150542:0:8577:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008eba9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:cbae74da-7571-45ad-b971-0e0378bbd4e4+6:1957:x1798523503827200:12345-192.168.202.38@tcp:400:kworker.0 00000100:00100000:0.0:1715206207.150580:0:6997:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008eba8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cbae74da-7571-45ad-b971-0e0378bbd4e4+18:1956:x1798523503827136:12345-192.168.202.38@tcp:400:kworker.0 Request processed in 55us (146us total) trans 0 rc 0/0 00000100:00100000:3.0:1715206207.150585:0:6992:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cb12850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ff645b43-0d7b-4a37-b9cc-6ac8f8d65c0d+12:1957:x1798523503827072:12345-192.168.202.38@tcp:400:kworker.0 Request processed in 68us (207us total) trans 0 rc 0/0 00000100:00100000:2.0:1715206207.150585:0:8577:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008eba9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:cbae74da-7571-45ad-b971-0e0378bbd4e4+6:1957:x1798523503827200:12345-192.168.202.38@tcp:400:kworker.0 Request processed in 43us (111us total) trans 0 rc 0/0 00000100:00100000:0.0:1715206207.150587:0:6997:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.38@tcp, seq: 491 00000100:00100000:2.0:1715206207.150591:0:8577:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.38@tcp, seq: 244 00000100:00100000:3.0:1715206207.150592:0:6992:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.38@tcp, seq: 399 00000100:00080000:1.0:1715206207.156037:0:6994:0:(pinger.c:529:ping_evictor_main()) Last request was at 1715206176 00000020:00080000:1.0:1715206207.156041:0:6994:0:(genops.c:1561:class_fail_export()) disconnecting export ffff880090f54000/46af332d-2ee7-4d47-b762-82c1eb2b6bbd 00000020:00000080:1.0:1715206207.156049:0:6994:0:(genops.c:1395:class_disconnect()) disconnect: cookie 0x8c55e4ad37f66038 00000100:00080000:1.0:1715206207.156054:0:6994:0:(import.c:86:import_set_state_nolock()) ffff880090f50800 ÿÿÿÿ: changing import state from FULL to CLOSED 00010000:00010000:2.0:1715206207.156102:0:6986:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00000004:1.0:1715206207.156104:0:6994:0:(tgt_lastrcvd.c:715:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967394 00000020:00080000:1.0:1715206207.156322:0:6994:0:(genops.c:1578:class_fail_export()) disconnected export ffff880090f54000/46af332d-2ee7-4d47-b762-82c1eb2b6bbd 00000100:00080000:1.0:1715206207.156326:0:6994:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd MGS older than 1715206177 00000040:00080000:0.0:1715206207.219403:0:14992:0:(llog.c:735:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1715206207.219409:0:14992:0:(llog_cat.c:796:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1715206207.219705:0:14992:0:(llog.c:792:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 1 00000040:00080000:0.0:1715206207.219710:0:14992:0:(llog.c:792:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1715206207.244400:0:3218:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008eba8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:47336e3e-5c2f-4892-9b72-90c87ec36b26:3218:1798523508028480:0@lo:400:kworker.0 00000100:00100000:1.0:1715206207.244417:0:3217:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008e48ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3217:1798523508028544:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1715206207.244422:0:3215:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008eba8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3215:1798523508028608:0@lo:400:kworker.0 00000100:00100000:2.0:1715206207.244466:0:3215:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1715206207.244469:0:3218:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1715206207.244470:0:3217:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1715206207.244491:0:3217:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008eba9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3217:1798523508028736:0@lo:400:kworker.0 00000100:00100000:0.0:1715206207.244493:0:8623:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798523508028608 00000100:00100000:2.0:1715206207.244496:0:3215:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1715206207.244497:0:3218:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008ebab800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3218:1798523508028800:0@lo:400:kworker.0 00000100:00100000:2.0:1715206207.244500:0:3215:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008eba8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3215:1798523508028672:0@lo:400:kworker.0 00000100:00100000:0.0:1715206207.244502:0:8623:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798523508028608 00000100:00100000:1.0:1715206207.244511:0:3217:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1715206207.244519:0:3218:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1715206207.244522:0:10974:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798523508028544 00000100:00100000:2.0:1715206207.244525:0:10974:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798523508028544 00000100:00100000:0.0:1715206207.244532:0:8623:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798523508028736 00000100:00100000:0.0:1715206207.244534:0:8623:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798523508028736 00000100:00080000:1.0:1715206207.244540:0:6994:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 older than 1715206177 00000100:00100000:3.0:1715206207.244542:0:6992:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798523508028480 00000100:00080000:1.0:1715206207.244544:0:6994:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 older than 1715206177 00000100:00100000:3.0:1715206207.244545:0:6992:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798523508028480 00000100:00100000:0.0:1715206207.244548:0:8623:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 492 00000100:00100000:2.0:1715206207.244550:0:10974:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 204 00000100:00100000:2.0:1715206207.244553:0:10974:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e636680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3217:x1798523508028544:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1715206207.244553:0:8623:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008ebabb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3215:x1798523508028608:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1715206207.244558:0:11480:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 493 00000100:00100000:1.0:1715206207.244562:0:11480:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e636a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3217:x1798523508028736:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1715206207.244571:0:6992:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 400 00000100:00100000:3.0:1715206207.244576:0:6992:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cb12450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:47336e3e-5c2f-4892-9b72-90c87ec36b26+18:3218:x1798523508028480:12345-0@lo:400:kworker.0 00002000:00000024:2.0:1715206207.244582:0:10974:0:(ofd_obd.c:743:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3857711104 avail 3855613952 00000100:00100000:0.0:1715206207.244596:0:8623:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008ebabb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3215:x1798523508028608:12345-0@lo:400:kworker.0 Request processed in 44us (131us total) trans 0 rc 0/0 00000100:00100000:1.0:1715206207.244599:0:11480:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e636a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3217:x1798523508028736:12345-0@lo:400:kworker.0 Request processed in 36us (88us total) trans 0 rc 0/0 00000100:00100000:0.0:1715206207.244602:0:8623:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 492 00000100:00100000:1.0:1715206207.244605:0:11480:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 493 00000100:00100000:2.0:1715206207.244606:0:10974:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e636680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3217:x1798523508028544:12345-0@lo:13:osp-pre-1-0.0 Request processed in 52us (137us total) trans 0 rc 0/0 00000100:00100000:3.0:1715206207.244608:0:6992:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cb12450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:47336e3e-5c2f-4892-9b72-90c87ec36b26+18:3218:x1798523508028480:12345-0@lo:400:kworker.0 Request processed in 32us (140us total) trans 0 rc 0/0 00000100:00100000:2.0:1715206207.244610:0:10974:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 204 00000100:00100000:3.0:1715206207.244614:0:6992:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 400 00000100:00080000:1.0:1715206207.244621:0:6994:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd MGS older than 1715206177 00000100:00100000:2.0:1715206207.244623:0:3215:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1715206207.244637:0:14590:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798523508028800 00000100:00100000:0.0:1715206207.244637:0:4437:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798523508028672 00000100:00100000:3.0:1715206207.244640:0:14590:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798523508028800 00000100:00100000:0.0:1715206207.244640:0:4437:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798523508028672 00000100:00100000:2.0:1715206207.244649:0:3215:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008eba8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3215:1798523508028608:0@lo:400:kworker.0 00000100:00100000:1.0:1715206207.244654:0:3217:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008e48ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3217:1798523508028544:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1715206207.244655:0:4437:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 494 00000100:00100000:3.0:1715206207.244657:0:14590:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 245 00000100:00100000:0.0:1715206207.244658:0:4437:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008ebaa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0000_UUID+5:3215:x1798523508028672:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1715206207.244661:0:14590:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e48f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3218:x1798523508028800:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1715206207.244663:0:3217:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008eba9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3217:1798523508028736:0@lo:400:kworker.0 00000100:00100000:0.0:1715206207.244684:0:4437:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008ebaa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0000_UUID+5:3215:x1798523508028672:12345-0@lo:400:kworker.0 Request processed in 26us (61us total) trans 0 rc 0/0 00000100:00100000:3.0:1715206207.244687:0:14590:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e48f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3218:x1798523508028800:12345-0@lo:400:kworker.0 Request processed in 25us (167us total) trans 0 rc 0/0 00000100:00100000:0.0:1715206207.244689:0:4437:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 494 00000100:00100000:2.0:1715206207.244693:0:3215:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008eba8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3215:1798523508028672:0@lo:400:kworker.0 00000100:00080000:1.0:1715206207.244699:0:6994:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 older than 1715206177 00000100:00100000:3.0:1715206207.244701:0:14590:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 245 00000100:00100000:3.0:1715206207.244726:0:3218:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008ebab800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3218:1798523508028800:0@lo:400:kworker.0 00000100:00100000:3.0:1715206207.244733:0:3218:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008eba8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:47336e3e-5c2f-4892-9b72-90c87ec36b26:3218:1798523508028480:0@lo:400:kworker.0 00010000:00010000:3.0:1715206208.022447:0:8591:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1715206208.252764:0:16920:0:(debug.c:705:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-hsm test 8: Test default archive number ======== 18:10:07 (1715206207) 00000100:00100000:2.0:1715206208.310701:0:3208:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.38@tcp (source: 12345-192.168.202.38@tcp) 00000100:00100000:1.0:1715206208.310789:0:11480:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798523503827392 00000100:00100000:1.0:1715206208.310797:0:11480:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798523503827392 00000100:00100000:1.0:1715206208.310837:0:11480:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.38@tcp, seq: 174 00000100:00100000:1.0:1715206208.310842:0:11480:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008eba8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:cbae74da-7571-45ad-b971-0e0378bbd4e4+18:21835:x1798523503827392:12345-192.168.202.38@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1715206208.310857:0:11480:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1715206208.310870:0:11480:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5261440/0x8c55e4ad37f66149 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbbeffb005ec3dd6b expref: -99 pid: 11480 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715206208.310975:0:11480:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5262ac0/0x8c55e4ad37f66150 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11480 initiator: MDT0 00010000:00010000:1.0:1715206208.310984:0:11480:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5262ac0/0x8c55e4ad37f66150 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11480 initiator: MDT0 00010000:00010000:1.0:1715206208.310991:0:11480:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5262ac0/0x8c55e4ad37f66150 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11480 initiator: MDT0 00010000:00010000:1.0:1715206208.310998:0:11480:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5262640/0x8c55e4ad37f66157 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x646966 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11480 initiator: MDT0 00010000:00010000:1.0:1715206208.311002:0:11480:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5262640/0x8c55e4ad37f66157 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x646966 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11480 initiator: MDT0 00010000:00010000:1.0:1715206208.311005:0:11480:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5262640/0x8c55e4ad37f66157 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x646966 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11480 initiator: MDT0 00000004:00200000:1.0:1715206208.311063:0:11480:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 10752 00010000:00010000:1.0:1715206208.311154:0:11480:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5262ac0/0x8c55e4ad37f66150 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11480 initiator: MDT0 00010000:00010000:1.0:1715206208.311159:0:11480:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5262ac0/0x8c55e4ad37f66150 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 11480 initiator: MDT0 00010000:00010000:1.0:1715206208.311163:0:11480:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5262ac0/0x8c55e4ad37f66150 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11480 initiator: MDT0 00010000:00010000:1.0:1715206208.311166:0:11480:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800a5262ac0 already unused, calling callback (ffffffffa13a3730) 00010000:00010000:1.0:1715206208.311168:0:11480:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5262ac0/0x8c55e4ad37f66150 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11480 initiator: MDT0 00010000:00010000:1.0:1715206208.311172:0:11480:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5262ac0/0x8c55e4ad37f66150 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 11480 initiator: MDT0 00010000:00010000:1.0:1715206208.311179:0:11480:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff88008e524300) 00010000:00010000:1.0:1715206208.311180:0:11480:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1715206208.311183:0:11480:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5262ac0/0x8c55e4ad37f66150 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11480 initiator: MDT0 00010000:00010000:1.0:1715206208.311186:0:11480:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5262ac0/0x8c55e4ad37f66150 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11480 initiator: MDT0 00010000:00010000:1.0:1715206208.311203:0:11480:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5262640/0x8c55e4ad37f66157 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x646966 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11480 initiator: MDT0 00010000:00010000:1.0:1715206208.311206:0:11480:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5262640/0x8c55e4ad37f66157 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x646966 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11480 initiator: MDT0 00010000:00010000:1.0:1715206208.311209:0:11480:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5262640/0x8c55e4ad37f66157 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x646966 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11480 initiator: MDT0 00010000:00010000:1.0:1715206208.311212:0:11480:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800a5262640 already unused, calling callback (ffffffffa13a3730) 00010000:00010000:1.0:1715206208.311213:0:11480:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5262640/0x8c55e4ad37f66157 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x646966 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11480 initiator: MDT0 00010000:00010000:1.0:1715206208.311220:0:11480:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5262640/0x8c55e4ad37f66157 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x646966 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11480 initiator: MDT0 00010000:00010000:1.0:1715206208.311224:0:11480:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x646966 (ffff88008ef1e800) 00010000:00010000:1.0:1715206208.311225:0:11480:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1715206208.311226:0:11480:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5262640/0x8c55e4ad37f66157 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x646966 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11480 initiator: MDT0 00010000:00010000:1.0:1715206208.311229:0:11480:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5262640/0x8c55e4ad37f66157 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x646966 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11480 initiator: MDT0 00010000:00010000:1.0:1715206208.311252:0:11480:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5261440/0x8c55e4ad37f66149 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.38@tcp remote: 0xbbeffb005ec3dd6b expref: 20 pid: 11480 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715206208.311257:0:11480:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5261440/0x8c55e4ad37f66149 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.38@tcp remote: 0xbbeffb005ec3dd6b expref: 20 pid: 11480 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715206208.311261:0:11480:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5261440, rc 0) 00000100:00100000:1.0:1715206208.311322:0:11480:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008eba8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:cbae74da-7571-45ad-b971-0e0378bbd4e4+19:21835:x1798523503827392:12345-192.168.202.38@tcp:101:lhsmtool_posix.0 Request processed in 479us (632us total) trans 4294967395 rc 301/301 00000100:00100000:1.0:1715206208.311327:0:11480:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.38@tcp, seq: 174 00000100:00100000:2.0:1715206208.312191:0:3209:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.38@tcp (source: 12345-192.168.202.38@tcp) 00000100:00100000:1.0:1715206208.312227:0:11480:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798523503827456 00000100:00100000:1.0:1715206208.312231:0:11480:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798523503827456 00000100:00100000:1.0:1715206208.312250:0:11480:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.38@tcp, seq: 175 00000100:00100000:1.0:1715206208.312254:0:11480:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008eba8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:cbae74da-7571-45ad-b971-0e0378bbd4e4+19:21835:x1798523503827456:12345-192.168.202.38@tcp:59:lhsmtool_posix.0 00000100:00100000:1.0:1715206208.312305:0:11480:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008eba8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:cbae74da-7571-45ad-b971-0e0378bbd4e4+19:21835:x1798523503827456:12345-192.168.202.38@tcp:59:lhsmtool_posix.0 Request processed in 50us (116us total) trans 0 rc 0/0 00000100:00100000:1.0:1715206208.312309:0:11480:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.38@tcp, seq: 175 00000100:00100000:2.0:1715206208.321106:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.38@tcp (source: 12345-192.168.202.38@tcp) 00000100:00100000:1.0:1715206208.321178:0:11480:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798523503827776 00000100:00100000:1.0:1715206208.321185:0:11480:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798523503827776 00000100:00100000:1.0:1715206208.321220:0:11480:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.38@tcp, seq: 176 00000100:00100000:1.0:1715206208.321225:0:11480:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008eba8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:cbae74da-7571-45ad-b971-0e0378bbd4e4+19:21838:x1798523503827776:12345-192.168.202.38@tcp:101:rm.0 00010000:00010000:1.0:1715206208.321240:0:11480:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1715206208.321252:0:11480:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5262f40/0x8c55e4ad37f66165 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbbeffb005ec3dd8e expref: -99 pid: 11480 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715206208.321315:0:11480:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5263cc0/0x8c55e4ad37f6616c lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11480 initiator: MDT0 00010000:00010000:1.0:1715206208.321326:0:11480:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5263cc0/0x8c55e4ad37f6616c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11480 initiator: MDT0 00010000:00010000:1.0:1715206208.321336:0:11480:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5263cc0/0x8c55e4ad37f6616c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11480 initiator: MDT0 00010000:00010000:1.0:1715206208.321347:0:11480:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5263a80/0x8c55e4ad37f66173 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x97bd0ad7 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11480 initiator: MDT0 00010000:00010000:1.0:1715206208.321352:0:11480:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5263a80/0x8c55e4ad37f66173 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x97bd0ad7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11480 initiator: MDT0 00010000:00010000:1.0:1715206208.321357:0:11480:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5263a80/0x8c55e4ad37f66173 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x97bd0ad7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11480 initiator: MDT0 00010000:00010000:1.0:1715206208.321423:0:11480:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5263cc0/0x8c55e4ad37f6616c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11480 initiator: MDT0 00010000:00010000:1.0:1715206208.321427:0:11480:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5263cc0/0x8c55e4ad37f6616c lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 11480 initiator: MDT0 00010000:00010000:1.0:1715206208.321431:0:11480:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5263cc0/0x8c55e4ad37f6616c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11480 initiator: MDT0 00010000:00010000:1.0:1715206208.321442:0:11480:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800a5263cc0 already unused, calling callback (ffffffffa13a3730) 00010000:00010000:1.0:1715206208.321445:0:11480:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5263cc0/0x8c55e4ad37f6616c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11480 initiator: MDT0 00010000:00010000:1.0:1715206208.321449:0:11480:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5263cc0/0x8c55e4ad37f6616c lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 11480 initiator: MDT0 00010000:00010000:1.0:1715206208.321456:0:11480:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800a68d3200) 00010000:00010000:1.0:1715206208.321457:0:11480:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1715206208.321460:0:11480:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5263cc0/0x8c55e4ad37f6616c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11480 initiator: MDT0 00010000:00010000:1.0:1715206208.321462:0:11480:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5263cc0/0x8c55e4ad37f6616c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11480 initiator: MDT0 00010000:00010000:1.0:1715206208.321479:0:11480:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5263a80/0x8c55e4ad37f66173 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x97bd0ad7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11480 initiator: MDT0 00010000:00010000:1.0:1715206208.321483:0:11480:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5263a80/0x8c55e4ad37f66173 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x97bd0ad7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11480 initiator: MDT0 00010000:00010000:1.0:1715206208.321488:0:11480:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5263a80/0x8c55e4ad37f66173 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x97bd0ad7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11480 initiator: MDT0 00010000:00010000:1.0:1715206208.321492:0:11480:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800a5263a80 already unused, calling callback (ffffffffa13a3730) 00010000:00010000:1.0:1715206208.321494:0:11480:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5263a80/0x8c55e4ad37f66173 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x97bd0ad7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11480 initiator: MDT0 00010000:00010000:1.0:1715206208.321499:0:11480:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5263a80/0x8c55e4ad37f66173 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x97bd0ad7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11480 initiator: MDT0 00010000:00010000:1.0:1715206208.321505:0:11480:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x97bd0ad7 (ffff88008ef1ed00) 00010000:00010000:1.0:1715206208.321507:0:11480:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1715206208.321515:0:11480:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5263a80/0x8c55e4ad37f66173 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x97bd0ad7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11480 initiator: MDT0 00010000:00010000:1.0:1715206208.321519:0:11480:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5263a80/0x8c55e4ad37f66173 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x97bd0ad7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11480 initiator: MDT0 00010000:00010000:1.0:1715206208.321558:0:11480:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5262f40/0x8c55e4ad37f66165 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.38@tcp remote: 0xbbeffb005ec3dd8e expref: 20 pid: 11480 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715206208.321566:0:11480:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5262f40/0x8c55e4ad37f66165 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.38@tcp remote: 0xbbeffb005ec3dd8e expref: 20 pid: 11480 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715206208.321574:0:11480:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5262f40, rc 0) 00000100:00100000:1.0:1715206208.321624:0:11480:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008eba8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:cbae74da-7571-45ad-b971-0e0378bbd4e4+19:21838:x1798523503827776:12345-192.168.202.38@tcp:101:rm.0 Request processed in 397us (527us total) trans 0 rc 301/301 00000100:00100000:1.0:1715206208.321630:0:11480:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.38@tcp, seq: 176 00000001:02000400:1.0:1715206208.648009:0:16984:0:(debug.c:705:libcfs_debug_mark_buffer()) DEBUG MARKER: sanity-hsm test_8: @@@@@@ FAIL: cannot create /mnt/lustre2/d8.sanity-hsm/f8.sanity-hsm with cp, status=1 Debug log: 204 lines, 204 kept, 0 dropped, 0 bad.