00000100:00100000:2.0F:1715206904.267228:0:3209:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.38@tcp (source: 12345-192.168.202.38@tcp) 00000100:00100000:2.0:1715206904.267256:0:11480:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798523503869184 00000100:00100000:2.0:1715206904.267264:0:11480:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798523503869184 00000100:00100000:2.0:1715206904.267325:0:11480:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.38@tcp, seq: 222 00000100:00100000:2.0:1715206904.267332:0:11480:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e6a1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:cbae74da-7571-45ad-b971-0e0378bbd4e4+18:10314:x1798523503869184:12345-192.168.202.38@tcp:60:lhsmtool_posix.0 00000100:00100000:2.0:1715206904.267464:0:11480:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e6a1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:cbae74da-7571-45ad-b971-0e0378bbd4e4+18:10314:x1798523503869184:12345-192.168.202.38@tcp:60:lhsmtool_posix.0 Request processed in 132us (240us total) trans 0 rc 0/0 00000100:00100000:2.0:1715206904.267471:0:11480:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.38@tcp, seq: 222 00000100:00100000:3.0F:1715206904.268141:0:3208:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.38@tcp (source: 12345-192.168.202.38@tcp) 00000100:00100000:3.0:1715206904.268159:0:13448:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798523503869312 00000100:00100000:3.0:1715206904.268161:0:13448:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798523503869312 00000100:00100000:3.0:1715206904.268184:0:13448:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.38@tcp, seq: 48 00000100:00100000:3.0:1715206904.268188:0:13448:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880132a60a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:cbae74da-7571-45ad-b971-0e0378bbd4e4+18:10314:x1798523503869312:12345-192.168.202.38@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1715206904.268404:0:13448:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880132a60a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:cbae74da-7571-45ad-b971-0e0378bbd4e4+19:10314:x1798523503869312:12345-192.168.202.38@tcp:35:lhsmtool_posix.0 Request processed in 214us (264us total) trans 4294967420 rc 0/0 00000100:00100000:3.0:1715206904.268409:0:13448:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.38@tcp, seq: 48 00010000:00010000:2.0:1715206904.416393:0:10149:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1715206905.418353:0:18958:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1715206906.420376:0:6987:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0F:1715206907.224449:0:14992:0:(llog.c:735:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1715206907.224464:0:14992:0:(llog_cat.c:796:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1715206907.224994:0:14992:0:(llog.c:792:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 1 00000040:00080000:0.0:1715206907.225001:0:14992:0:(llog.c:792:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:2.0:1715206907.422391:0:6986:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1715206907.940517:0:7244:0:(tgt_lastrcvd.c:969:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967420 is committed 00000100:00100000:2.0:1715206908.156495:0:3215:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880132a61180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3215:1798523508104320:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1715206908.156567:0:3215:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1715206908.156665:0:10974:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798523508104320 00000100:00100000:0.0:1715206908.156674:0:10974:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798523508104320 00000100:00100000:0.0:1715206908.156724:0:10974:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 483 00000100:00080000:3.0:1715206908.156727:0:6994:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 older than 1715206878 00000100:00100000:0.0:1715206908.156730:0:10974:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e6a1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3215:x1798523508104320:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1715206908.156766:0:10974:0:(ofd_obd.c:743:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3857711104 avail 3855613952 00000100:00100000:0.0:1715206908.156816:0:10974:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e6a1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3215:x1798523508104320:12345-0@lo:13:osp-pre-0-0.0 Request processed in 85us (249us total) trans 0 rc 0/0 00000100:00100000:0.0:1715206908.156822:0:10974:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 483 00000100:00100000:2.0:1715206908.156845:0:3215:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff880132a61180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3215:1798523508104320:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1715206908.270146:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.38@tcp (source: 12345-192.168.202.38@tcp) 00000100:00100000:0.0:1715206908.270173:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.38@tcp (source: 12345-192.168.202.38@tcp) 00000100:00100000:2.0:1715206908.270197:0:11480:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798523503869440 00000100:00100000:2.0:1715206908.270205:0:11480:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798523503869440 00000100:00100000:0.0:1715206908.270206:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.38@tcp (source: 12345-192.168.202.38@tcp) 00000100:00100000:1.0F:1715206908.270217:0:14590:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798523503869504 00000100:00100000:1.0:1715206908.270227:0:14590:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798523503869504 00000100:00100000:3.0:1715206908.270249:0:6992:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798523503869376 00000100:00100000:3.0:1715206908.270253:0:6992:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798523503869376 00000100:00100000:2.0:1715206908.270253:0:11480:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.38@tcp, seq: 1051 00000100:00100000:1.0:1715206908.270255:0:14590:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.38@tcp, seq: 548 00000100:00100000:2.0:1715206908.270259:0:11480:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880132a49500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:cbae74da-7571-45ad-b971-0e0378bbd4e4+18:1956:x1798523503869440:12345-192.168.202.38@tcp:400:kworker.0 00000100:00100000:1.0:1715206908.270260:0:14590:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880132a49f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:cbae74da-7571-45ad-b971-0e0378bbd4e4+6:1957:x1798523503869504:12345-192.168.202.38@tcp:400:kworker.0 00000100:00100000:3.0:1715206908.270289:0:6992:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.38@tcp, seq: 843 00000100:00080000:0.0:1715206908.270289:0:6994:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd MGS older than 1715206878 00000100:00080000:0.0:1715206908.270292:0:6994:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 older than 1715206878 00000100:00100000:3.0:1715206908.270294:0:6992:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cb13850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ff645b43-0d7b-4a37-b9cc-6ac8f8d65c0d+12:1956:x1798523503869376:12345-192.168.202.38@tcp:400:kworker.0 00000100:00080000:0.0:1715206908.270294:0:6994:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 older than 1715206878 00000100:00100000:2.0:1715206908.270323:0:11480:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880132a49500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:cbae74da-7571-45ad-b971-0e0378bbd4e4+18:1956:x1798523503869440:12345-192.168.202.38@tcp:400:kworker.0 Request processed in 64us (183us total) trans 0 rc 0/0 00000100:00100000:1.0:1715206908.270325:0:14590:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880132a49f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:cbae74da-7571-45ad-b971-0e0378bbd4e4+6:1957:x1798523503869504:12345-192.168.202.38@tcp:400:kworker.0 Request processed in 64us (150us total) trans 0 rc 0/0 00000100:00100000:3.0:1715206908.270329:0:6992:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cb13850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ff645b43-0d7b-4a37-b9cc-6ac8f8d65c0d+12:1956:x1798523503869376:12345-192.168.202.38@tcp:400:kworker.0 Request processed in 34us (123us total) trans 0 rc 0/0 00000100:00100000:2.0:1715206908.270329:0:11480:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.38@tcp, seq: 1051 00000100:00100000:1.0:1715206908.270332:0:14590:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.38@tcp, seq: 548 00000100:00100000:3.0:1715206908.270335:0:6992:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.38@tcp, seq: 843 00000100:00100000:1.0:1715206908.364529:0:3217:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8801329d3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3217:1798523508104384:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1715206908.364543:0:3215:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008e6a0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3215:1798523508104576:0@lo:400:kworker.0 00000100:00100000:0.0:1715206908.364576:0:3216:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008e6a0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:47336e3e-5c2f-4892-9b72-90c87ec36b26:3216:1798523508104448:0@lo:400:kworker.0 00000100:00100000:3.0:1715206908.364588:0:3218:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008e6a1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3218:1798523508104512:0@lo:400:kworker.0 00000100:00100000:2.0:1715206908.364611:0:3215:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1715206908.364612:0:3217:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1715206908.364694:0:3217:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008e6a2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3217:1798523508104704:0@lo:400:kworker.0 00000100:00100000:3.0:1715206908.364702:0:3218:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1715206908.364707:0:3216:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1715206908.364728:0:3217:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1715206908.364741:0:11480:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798523508104576 00000100:00100000:2.0:1715206908.364750:0:11480:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798523508104576 00000100:00100000:0.0:1715206908.364751:0:3216:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008e6a0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3216:1798523508104640:0@lo:400:kworker.0 00000100:00100000:1.0:1715206908.364769:0:14590:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798523508104704 00000100:00100000:1.0:1715206908.364775:0:14590:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798523508104704 00000100:00100000:3.0:1715206908.364781:0:4437:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798523508104512 00000100:00100000:3.0:1715206908.364786:0:4437:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798523508104512 00000100:00100000:0.0:1715206908.364796:0:3216:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1715206908.364814:0:14590:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 549 00000100:00100000:2.0:1715206908.364818:0:11480:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798523508104640 00000100:00100000:2.0:1715206908.364823:0:11480:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798523508104640 00000100:00100000:1.0:1715206908.364825:0:14590:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801329d3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3217:x1798523508104704:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1715206908.364839:0:4437:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1052 00000100:00100000:3.0:1715206908.364846:0:4437:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e6a1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0000_UUID+5:3215:x1798523508104576:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1715206908.364848:0:10974:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798523508104384 00000100:00100000:2.0:1715206908.364849:0:11480:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1053 00000100:00100000:0.0:1715206908.364855:0:10974:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798523508104384 00000100:00100000:2.0:1715206908.364857:0:11480:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880132a60000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3218:x1798523508104512:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1715206908.364919:0:10974:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 484 00000100:00100000:0.0:1715206908.364927:0:10974:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801329d3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3217:x1798523508104384:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1715206908.364940:0:4437:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e6a1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0000_UUID+5:3215:x1798523508104576:12345-0@lo:400:kworker.0 Request processed in 93us (329us total) trans 0 rc 0/0 00000100:00100000:1.0:1715206908.364941:0:14590:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8801329d3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+6:3217:x1798523508104704:12345-0@lo:400:kworker.0 Request processed in 115us (210us total) trans 0 rc 0/0 00000100:00100000:3.0:1715206908.364947:0:4437:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1052 00000100:00100000:1.0:1715206908.364951:0:14590:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 549 00000100:00100000:2.0:1715206908.364955:0:11480:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880132a60000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3218:x1798523508104512:12345-0@lo:400:kworker.0 Request processed in 95us (251us total) trans 0 rc 0/0 00002000:00000024:0.0:1715206908.364967:0:10974:0:(ofd_obd.c:743:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3857711104 avail 3855613952 00000100:00100000:2.0:1715206908.364976:0:11480:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1053 00000100:00100000:3.0:1715206908.364990:0:4437:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1054 00000100:00100000:3.0:1715206908.364995:0:4437:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880132a49c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0001_UUID+5:3216:x1798523508104640:12345-0@lo:400:kworker.0 00000100:00080000:2.0:1715206908.365009:0:6994:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 older than 1715206878 00000100:00080000:2.0:1715206908.365015:0:6994:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 older than 1715206878 00000100:00100000:0.0:1715206908.365022:0:10974:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8801329d3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3217:x1798523508104384:12345-0@lo:13:osp-pre-1-0.0 Request processed in 94us (410us total) trans 0 rc 0/0 00000100:00100000:1.0:1715206908.365030:0:3217:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008e6a2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3217:1798523508104704:0@lo:400:kworker.0 00000100:00100000:2.0:1715206908.365044:0:3215:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008e6a0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3215:1798523508104576:0@lo:400:kworker.0 00000100:00100000:1.0:1715206908.365050:0:3217:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff8801329d3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3217:1798523508104384:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1715206908.365057:0:10974:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 484 00000100:00100000:3.0:1715206908.365059:0:4437:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880132a49c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0001_UUID+5:3216:x1798523508104640:12345-0@lo:400:kworker.0 Request processed in 63us (263us total) trans 0 rc 0/0 00000100:00100000:3.0:1715206908.365065:0:4437:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1054 00000100:00100000:2.0:1715206908.365111:0:6992:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798523508104448 00000100:00100000:2.0:1715206908.365115:0:6992:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798523508104448 00000100:00100000:3.0:1715206908.365116:0:3218:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008e6a1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3218:1798523508104512:0@lo:400:kworker.0 00000100:00100000:0.0:1715206908.365145:0:3216:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008e6a0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3216:1798523508104640:0@lo:400:kworker.0 00000100:00100000:2.0:1715206908.365172:0:6992:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 844 00000100:00100000:2.0:1715206908.365177:0:6992:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cb13450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:47336e3e-5c2f-4892-9b72-90c87ec36b26+18:3216:x1798523508104448:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1715206908.365215:0:6992:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cb13450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:47336e3e-5c2f-4892-9b72-90c87ec36b26+18:3216:x1798523508104448:12345-0@lo:400:kworker.0 Request processed in 37us (511us total) trans 0 rc 0/0 00000100:00100000:2.0:1715206908.365238:0:6992:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 844 00000100:00080000:2.0:1715206908.365260:0:6994:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd MGS older than 1715206878 00000100:00100000:0.0:1715206908.365262:0:3216:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008e6a0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:47336e3e-5c2f-4892-9b72-90c87ec36b26:3216:1798523508104448:0@lo:400:kworker.0 00010000:00010000:2.0:1715206908.424595:0:8591:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1715206908.773232:0:5574:0:(debug.c:705:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-hsm test 12g: Restore a released file implicitly ========================================================== 18:21:48 (1715206908) 00000100:00100000:0.0:1715206908.856084:0:3209:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.38@tcp (source: 12345-192.168.202.38@tcp) 00000100:00100000:2.0:1715206908.856149:0:6996:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798523503869696 00000100:00100000:2.0:1715206908.856160:0:6996:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798523503869696 00000100:00100000:2.0:1715206908.856209:0:6996:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.38@tcp, seq: 223 00000100:00100000:2.0:1715206908.856215:0:6996:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880132a4a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cbae74da-7571-45ad-b971-0e0378bbd4e4+18:13096:x1798523503869696:12345-192.168.202.38@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1715206908.856234:0:6996:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1715206908.856251:0:6996:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009bffeac0/0x8c55e4ad37f6657f lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbbeffb005ec3e0dd expref: -99 pid: 6996 timeout: 0 lvb_type: 0 00000004:00080000:3.0:1715206908.856802:0:6996:0:(mdt_identity.c:116:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 464us 00010000:00010000:3.0:1715206908.859596:0:6996:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012ffd6640/0x8c55e4ad37f66586 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6996 initiator: MDT0 00010000:00010000:3.0:1715206908.859610:0:6996:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012ffd6640/0x8c55e4ad37f66586 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6996 initiator: MDT0 00010000:00010000:3.0:1715206908.859620:0:6996:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012ffd6640/0x8c55e4ad37f66586 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6996 initiator: MDT0 00010000:00010000:3.0:1715206908.859630:0:6996:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012ffd7600/0x8c55e4ad37f6658d lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x646966 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6996 initiator: MDT0 00010000:00010000:3.0:1715206908.859635:0:6996:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012ffd7600/0x8c55e4ad37f6658d lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x646966 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6996 initiator: MDT0 00010000:00010000:3.0:1715206908.859639:0:6996:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012ffd7600/0x8c55e4ad37f6658d lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x646966 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6996 initiator: MDT0 00000004:00200000:3.0:1715206908.859707:0:6996:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 10752 00010000:00010000:3.0:1715206908.859825:0:6996:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012ffd6640/0x8c55e4ad37f66586 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6996 initiator: MDT0 00010000:00010000:3.0:1715206908.859834:0:6996:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012ffd6640/0x8c55e4ad37f66586 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6996 initiator: MDT0 00010000:00010000:3.0:1715206908.859841:0:6996:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012ffd6640/0x8c55e4ad37f66586 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6996 initiator: MDT0 00010000:00010000:3.0:1715206908.859861:0:6996:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88012ffd6640 already unused, calling callback (ffffffffa13a3730) 00010000:00010000:3.0:1715206908.859866:0:6996:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012ffd6640/0x8c55e4ad37f66586 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6996 initiator: MDT0 00010000:00010000:3.0:1715206908.859893:0:6996:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012ffd6640/0x8c55e4ad37f66586 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6996 initiator: MDT0 00010000:00010000:3.0:1715206908.859907:0:6996:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff88008e524300) 00010000:00010000:3.0:1715206908.859911:0:6996:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1715206908.859915:0:6996:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012ffd6640/0x8c55e4ad37f66586 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6996 initiator: MDT0 00010000:00010000:3.0:1715206908.859939:0:6996:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012ffd6640/0x8c55e4ad37f66586 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6996 initiator: MDT0 00010000:00010000:3.0:1715206908.859952:0:6996:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012ffd7600/0x8c55e4ad37f6658d lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x646966 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6996 initiator: MDT0 00010000:00010000:3.0:1715206908.859960:0:6996:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012ffd7600/0x8c55e4ad37f6658d lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x646966 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6996 initiator: MDT0 00010000:00010000:3.0:1715206908.859968:0:6996:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012ffd7600/0x8c55e4ad37f6658d lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x646966 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6996 initiator: MDT0 00010000:00010000:3.0:1715206908.859974:0:6996:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88012ffd7600 already unused, calling callback (ffffffffa13a3730) 00010000:00010000:3.0:1715206908.859978:0:6996:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012ffd7600/0x8c55e4ad37f6658d lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x646966 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6996 initiator: MDT0 00010000:00010000:3.0:1715206908.859985:0:6996:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012ffd7600/0x8c55e4ad37f6658d lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x646966 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6996 initiator: MDT0 00010000:00010000:3.0:1715206908.859994:0:6996:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x646966 (ffff880131522400) 00010000:00010000:3.0:1715206908.859997:0:6996:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1715206908.860006:0:6996:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012ffd7600/0x8c55e4ad37f6658d lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x646966 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6996 initiator: MDT0 00010000:00010000:3.0:1715206908.860011:0:6996:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012ffd7600/0x8c55e4ad37f6658d lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x646966 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6996 initiator: MDT0 00010000:00010000:3.0:1715206908.860046:0:6996:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009bffeac0/0x8c55e4ad37f6657f lrc: 1/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.38@tcp remote: 0xbbeffb005ec3e0dd expref: 20 pid: 6996 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715206908.860053:0:6996:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009bffeac0/0x8c55e4ad37f6657f lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.38@tcp remote: 0xbbeffb005ec3e0dd expref: 20 pid: 6996 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715206908.860077:0:6996:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009bffeac0, rc 0) 00000100:00100000:3.0:1715206908.860136:0:6996:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880132a4a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cbae74da-7571-45ad-b971-0e0378bbd4e4+19:13096:x1798523503869696:12345-192.168.202.38@tcp:101:lhsmtool_posix.0 Request processed in 3918us (4060us total) trans 4294967421 rc 301/301 00000100:00100000:3.0:1715206908.860146:0:6996:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.38@tcp, seq: 223 00000100:00100000:0.0:1715206908.861495:0:3208:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.38@tcp (source: 12345-192.168.202.38@tcp) 00000100:00100000:3.0:1715206908.861592:0:6996:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798523503869760 00000100:00100000:3.0:1715206908.861599:0:6996:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798523503869760 00000100:00100000:3.0:1715206908.861639:0:6996:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.38@tcp, seq: 224 00000100:00100000:3.0:1715206908.861646:0:6996:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880132a4ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cbae74da-7571-45ad-b971-0e0378bbd4e4+19:13096:x1798523503869760:12345-192.168.202.38@tcp:59:lhsmtool_posix.0 00000100:00100000:3.0:1715206908.861699:0:6996:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880132a4ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cbae74da-7571-45ad-b971-0e0378bbd4e4+19:13096:x1798523503869760:12345-192.168.202.38@tcp:59:lhsmtool_posix.0 Request processed in 53us (208us total) trans 0 rc 0/0 00000100:00100000:3.0:1715206908.861706:0:6996:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.38@tcp, seq: 224 00000100:00100000:0.0:1715206908.867612:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.38@tcp (source: 12345-192.168.202.38@tcp) 00000100:00100000:3.0:1715206908.867662:0:6996:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798523503870080 00000100:00100000:3.0:1715206908.867667:0:6996:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798523503870080 00000100:00100000:3.0:1715206908.867701:0:6996:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.38@tcp, seq: 225 00000100:00100000:3.0:1715206908.867708:0:6996:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880132a4bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cbae74da-7571-45ad-b971-0e0378bbd4e4+19:13099:x1798523503870080:12345-192.168.202.38@tcp:101:rm.0 00010000:00010000:3.0:1715206908.867719:0:6996:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1715206908.867736:0:6996:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012ffd73c0/0x8c55e4ad37f6659b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbbeffb005ec3e100 expref: -99 pid: 6996 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715206908.867772:0:6996:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012ffd7180/0x8c55e4ad37f665a2 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6996 initiator: MDT0 00010000:00010000:3.0:1715206908.867781:0:6996:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012ffd7180/0x8c55e4ad37f665a2 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6996 initiator: MDT0 00010000:00010000:3.0:1715206908.867791:0:6996:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012ffd7180/0x8c55e4ad37f665a2 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6996 initiator: MDT0 00010000:00010000:3.0:1715206908.867827:0:6996:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012ffd7a80/0x8c55e4ad37f665a9 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xb017b0f6 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6996 initiator: MDT0 00010000:00010000:3.0:1715206908.867836:0:6996:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012ffd7a80/0x8c55e4ad37f665a9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xb017b0f6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6996 initiator: MDT0 00010000:00010000:3.0:1715206908.867842:0:6996:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012ffd7a80/0x8c55e4ad37f665a9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xb017b0f6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6996 initiator: MDT0 00010000:00010000:3.0:1715206908.867907:0:6996:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012ffd7180/0x8c55e4ad37f665a2 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6996 initiator: MDT0 00010000:00010000:3.0:1715206908.867914:0:6996:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012ffd7180/0x8c55e4ad37f665a2 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6996 initiator: MDT0 00010000:00010000:3.0:1715206908.867919:0:6996:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012ffd7180/0x8c55e4ad37f665a2 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6996 initiator: MDT0 00010000:00010000:3.0:1715206908.867924:0:6996:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88012ffd7180 already unused, calling callback (ffffffffa13a3730) 00010000:00010000:3.0:1715206908.867927:0:6996:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012ffd7180/0x8c55e4ad37f665a2 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6996 initiator: MDT0 00010000:00010000:3.0:1715206908.867932:0:6996:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012ffd7180/0x8c55e4ad37f665a2 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6996 initiator: MDT0 00010000:00010000:3.0:1715206908.867945:0:6996:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800a68d3200) 00010000:00010000:3.0:1715206908.867947:0:6996:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1715206908.867951:0:6996:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012ffd7180/0x8c55e4ad37f665a2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6996 initiator: MDT0 00010000:00010000:3.0:1715206908.867956:0:6996:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012ffd7180/0x8c55e4ad37f665a2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6996 initiator: MDT0 00010000:00010000:3.0:1715206908.867964:0:6996:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012ffd7a80/0x8c55e4ad37f665a9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xb017b0f6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6996 initiator: MDT0 00010000:00010000:3.0:1715206908.867969:0:6996:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012ffd7a80/0x8c55e4ad37f665a9 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xb017b0f6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6996 initiator: MDT0 00010000:00010000:3.0:1715206908.867975:0:6996:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012ffd7a80/0x8c55e4ad37f665a9 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xb017b0f6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6996 initiator: MDT0 00010000:00010000:3.0:1715206908.867980:0:6996:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88012ffd7a80 already unused, calling callback (ffffffffa13a3730) 00010000:00010000:3.0:1715206908.867982:0:6996:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012ffd7a80/0x8c55e4ad37f665a9 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xb017b0f6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6996 initiator: MDT0 00010000:00010000:3.0:1715206908.867986:0:6996:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012ffd7a80/0x8c55e4ad37f665a9 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xb017b0f6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6996 initiator: MDT0 00010000:00010000:3.0:1715206908.867991:0:6996:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xb017b0f6 (ffff880131522000) 00010000:00010000:3.0:1715206908.867993:0:6996:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1715206908.867994:0:6996:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012ffd7a80/0x8c55e4ad37f665a9 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xb017b0f6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6996 initiator: MDT0 00010000:00010000:3.0:1715206908.867997:0:6996:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012ffd7a80/0x8c55e4ad37f665a9 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xb017b0f6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6996 initiator: MDT0 00010000:00010000:3.0:1715206908.868026:0:6996:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012ffd73c0/0x8c55e4ad37f6659b lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.38@tcp remote: 0xbbeffb005ec3e100 expref: 20 pid: 6996 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715206908.868035:0:6996:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012ffd73c0/0x8c55e4ad37f6659b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.38@tcp remote: 0xbbeffb005ec3e100 expref: 20 pid: 6996 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715206908.868041:0:6996:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012ffd73c0, rc 0) 00000100:00100000:3.0:1715206908.868071:0:6996:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880132a4bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cbae74da-7571-45ad-b971-0e0378bbd4e4+19:13099:x1798523503870080:12345-192.168.202.38@tcp:101:rm.0 Request processed in 364us (461us total) trans 0 rc 301/301 00000100:00100000:3.0:1715206908.868076:0:6996:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.38@tcp, seq: 225 00000040:00080000:0.0:1715206909.224402:0:14992:0:(llog.c:735:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1715206909.224411:0:14992:0:(llog_cat.c:796:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1715206909.224892:0:14992:0:(llog.c:792:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 1 00000040:00080000:0.0:1715206909.224900:0:14992:0:(llog.c:792:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000001:02000400:1.0:1715206909.312919:0:5640:0:(debug.c:705:libcfs_debug_mark_buffer()) DEBUG MARKER: sanity-hsm test_12g: @@@@@@ FAIL: cannot create /mnt/lustre2/d12g.sanity-hsm/f12g.sanity-hsm with cp, status=1 00010000:00010000:2.0:1715206909.426576:0:10149:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) Debug log: 209 lines, 209 kept, 0 dropped, 0 bad.