00010000:00010000:2.0F:1715207772.160521:0:6986:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1715207772.398828:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.38@tcp (source: 12345-192.168.202.38@tcp) 00000100:00100000:1.0F:1715207772.398921:0:6997:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798523503914880 00000100:00100000:1.0:1715207772.398942:0:6997:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798523503914880 00000100:00080000:2.0:1715207772.399002:0:6994:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 older than 1715207742 00000100:00100000:1.0:1715207772.399021:0:6997:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.38@tcp, seq: 269 00000100:00100000:1.0:1715207772.399035:0:6997:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d9c7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cbae74da-7571-45ad-b971-0e0378bbd4e4+21:27832:x1798523503914880:12345-192.168.202.38@tcp:60:lhsmtool_posix.0 00000100:00100000:1.0:1715207772.399179:0:6997:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d9c7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cbae74da-7571-45ad-b971-0e0378bbd4e4+21:27832:x1798523503914880:12345-192.168.202.38@tcp:60:lhsmtool_posix.0 Request processed in 143us (355us total) trans 0 rc 0/0 00000100:00100000:1.0:1715207772.399194:0:6997:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.38@tcp, seq: 269 00000100:00100000:0.0F:1715207772.400776:0:3208:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.38@tcp (source: 12345-192.168.202.38@tcp) 00000100:00100000:2.0:1715207772.400901:0:13448:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798523503915008 00000100:00100000:2.0:1715207772.400910:0:13448:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798523503915008 00000100:00100000:2.0:1715207772.400956:0:13448:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.38@tcp, seq: 58 00000100:00100000:2.0:1715207772.400964:0:13448:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012bddb450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:cbae74da-7571-45ad-b971-0e0378bbd4e4+21:27832:x1798523503915008:12345-192.168.202.38@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1715207772.401214:0:13448:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012bddb450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:cbae74da-7571-45ad-b971-0e0378bbd4e4+22:27832:x1798523503915008:12345-192.168.202.38@tcp:35:lhsmtool_posix.0 Request processed in 247us (441us total) trans 4294967439 rc 0/0 00000100:00100000:2.0:1715207772.401223:0:13448:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.38@tcp, seq: 58 00010000:00010000:2.0:1715207773.162451:0:10149:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1715207773.601778:0:7244:0:(tgt_lastrcvd.c:969:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967439 is committed 00000100:00100000:0.0:1715207773.709992:0:3209:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.38@tcp (source: 12345-192.168.202.38@tcp) 00000100:00100000:0.0:1715207773.710027:0:3209:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.38@tcp (source: 12345-192.168.202.38@tcp) 00000100:00100000:1.0:1715207773.710042:0:6997:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798523503915136 00000100:00100000:1.0:1715207773.710050:0:6997:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798523503915136 00000100:00100000:0.0:1715207773.710058:0:3209:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.38@tcp (source: 12345-192.168.202.38@tcp) 00000100:00100000:1.0:1715207773.710083:0:6997:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.38@tcp, seq: 1783 00000100:00100000:1.0:1715207773.710089:0:6997:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008db10a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cbae74da-7571-45ad-b971-0e0378bbd4e4+20:1956:x1798523503915136:12345-192.168.202.38@tcp:400:kworker.0 00000100:00100000:2.0:1715207773.710094:0:6993:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798523503915072 00000100:00100000:2.0:1715207773.710098:0:6993:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798523503915072 00000100:00100000:0.0:1715207773.710099:0:14590:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798523503915200 00000100:00100000:0.0:1715207773.710101:0:14590:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798523503915200 00000100:00100000:2.0:1715207773.710121:0:6993:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.38@tcp, seq: 1201 00000100:00100000:0.0:1715207773.710121:0:14590:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.38@tcp, seq: 920 00000100:00100000:2.0:1715207773.710124:0:6993:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012bdaa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ff645b43-0d7b-4a37-b9cc-6ac8f8d65c0d+12:1957:x1798523503915072:12345-192.168.202.38@tcp:400:kworker.0 00000100:00100000:0.0:1715207773.710125:0:14590:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008db10000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:cbae74da-7571-45ad-b971-0e0378bbd4e4+7:1957:x1798523503915200:12345-192.168.202.38@tcp:400:kworker.0 00000100:00100000:1.0:1715207773.710144:0:6997:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008db10a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cbae74da-7571-45ad-b971-0e0378bbd4e4+20:1956:x1798523503915136:12345-192.168.202.38@tcp:400:kworker.0 Request processed in 56us (158us total) trans 0 rc 0/0 00000100:00100000:0.0:1715207773.710144:0:14590:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008db10000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:cbae74da-7571-45ad-b971-0e0378bbd4e4+7:1957:x1798523503915200:12345-192.168.202.38@tcp:400:kworker.0 Request processed in 19us (86us total) trans 0 rc 0/0 00000100:00100000:2.0:1715207773.710147:0:6993:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012bdaa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ff645b43-0d7b-4a37-b9cc-6ac8f8d65c0d+12:1957:x1798523503915072:12345-192.168.202.38@tcp:400:kworker.0 Request processed in 23us (121us total) trans 0 rc 0/0 00000100:00100000:1.0:1715207773.710150:0:6997:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.38@tcp, seq: 1783 00000100:00100000:0.0:1715207773.710150:0:14590:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.38@tcp, seq: 920 00000100:00100000:2.0:1715207773.710151:0:6993:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.38@tcp, seq: 1201 00000100:00080000:2.0:1715207773.710168:0:6994:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 older than 1715207743 00000100:00080000:2.0:1715207773.710170:0:6994:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd MGS older than 1715207743 00010000:00010000:2.0:1715207774.164537:0:18958:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1715207774.540462:0:3217:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1715207774.540491:0:3217:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008e6e0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3217:1798523508183168:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1715207774.540569:0:3217:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1715207774.540626:0:8579:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798523508183168 00000100:00100000:0.0:1715207774.540638:0:8579:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798523508183168 00000100:00080000:3.0F:1715207774.540698:0:6994:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 older than 1715207744 00000100:00100000:0.0:1715207774.540704:0:8579:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 829 00000100:00100000:0.0:1715207774.540711:0:8579:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d9c7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3217:x1798523508183168:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1715207774.540744:0:8579:0:(ofd_obd.c:743:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3856662528 avail 3854565376 00000100:00100000:0.0:1715207774.540809:0:8579:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d9c7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3217:x1798523508183168:12345-0@lo:13:osp-pre-0-0.0 Request processed in 97us (242us total) trans 0 rc 0/0 00000100:00100000:0.0:1715207774.540817:0:8579:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 829 00000100:00100000:3.0:1715207774.540878:0:3217:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008e6e0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3217:1798523508183168:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1715207774.748352:0:3215:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008db10e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:47336e3e-5c2f-4892-9b72-90c87ec36b26:3215:1798523508183232:0@lo:400:kworker.0 00000100:00100000:2.0:1715207774.748359:0:3216:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008d9c6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3216:1798523508183296:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1715207774.748371:0:3217:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008db10380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3217:1798523508183360:0@lo:400:kworker.0 00000100:00100000:0.0:1715207774.748379:0:3218:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008db11f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3218:1798523508183424:0@lo:400:kworker.0 00000100:00100000:1.0:1715207774.748409:0:3215:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1715207774.748411:0:3216:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1715207774.748414:0:3217:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1715207774.748427:0:3215:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008db13b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3215:1798523508183488:0@lo:400:kworker.0 00000100:00100000:0.0:1715207774.748429:0:8579:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798523508183296 00000100:00100000:0.0:1715207774.748434:0:8579:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798523508183296 00000100:00100000:2.0:1715207774.748439:0:3216:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008e5bb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3216:1798523508183552:0@lo:400:kworker.0 00000100:00100000:1.0:1715207774.748440:0:3215:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1715207774.748444:0:6997:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798523508183360 00000100:00100000:3.0:1715207774.748447:0:6997:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798523508183360 00000100:00100000:2.0:1715207774.748453:0:3216:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1715207774.748458:0:11480:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798523508183488 00000100:00100000:0.0:1715207774.748459:0:8579:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 830 00000100:00100000:1.0:1715207774.748460:0:11480:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798523508183488 00000100:00100000:0.0:1715207774.748463:0:8579:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d9c5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3216:x1798523508183296:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1715207774.748464:0:6997:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1784 00000100:00100000:3.0:1715207774.748467:0:6997:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e6e0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3217:x1798523508183360:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1715207774.748471:0:8575:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798523508183552 00000100:00100000:2.0:1715207774.748474:0:8575:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798523508183552 00000100:00100000:1.0:1715207774.748475:0:11480:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1785 00000100:00100000:1.0:1715207774.748478:0:11480:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88013298dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3215:x1798523508183488:12345-0@lo:400:kworker.0 00002000:00000024:0.0:1715207774.748487:0:8579:0:(ofd_obd.c:743:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3857711104 avail 3855613952 00000100:00100000:2.0:1715207774.748488:0:8575:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 921 00000100:00100000:2.0:1715207774.748491:0:8575:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d9c5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3216:x1798523508183552:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1715207774.748493:0:6997:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e6e0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3217:x1798523508183360:12345-0@lo:400:kworker.0 Request processed in 26us (79us total) trans 0 rc 0/0 00000100:00100000:3.0:1715207774.748498:0:6997:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1784 00000100:00100000:1.0:1715207774.748498:0:11480:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88013298dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3215:x1798523508183488:12345-0@lo:400:kworker.0 Request processed in 20us (57us total) trans 0 rc 0/0 00000100:00100000:1.0:1715207774.748502:0:11480:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1785 00000100:00100000:0.0:1715207774.748508:0:8579:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d9c5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3216:x1798523508183296:12345-0@lo:13:osp-pre-1-0.0 Request processed in 45us (98us total) trans 0 rc 0/0 00000100:00080000:3.0:1715207774.748510:0:6994:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 older than 1715207744 00000100:00100000:2.0:1715207774.748510:0:8575:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d9c5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3216:x1798523508183552:12345-0@lo:400:kworker.0 Request processed in 18us (56us total) trans 0 rc 0/0 00000100:00080000:3.0:1715207774.748513:0:6994:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 older than 1715207744 00000100:00100000:2.0:1715207774.748513:0:8575:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 921 00000100:00100000:0.0:1715207774.748519:0:8579:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 830 00000100:00100000:1.0:1715207774.748521:0:3215:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008db13b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3215:1798523508183488:0@lo:400:kworker.0 00000100:00100000:3.0:1715207774.748524:0:3217:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008db10380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3217:1798523508183360:0@lo:400:kworker.0 00000100:00100000:2.0:1715207774.748534:0:3216:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008e5bb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3216:1798523508183552:0@lo:400:kworker.0 00000100:00100000:2.0:1715207774.748542:0:3216:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008d9c6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3216:1798523508183296:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1715207774.748583:0:6992:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798523508183232 00000100:00100000:0.0:1715207774.748586:0:6992:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798523508183232 00000100:00080000:3.0:1715207774.748597:0:6994:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd MGS older than 1715207744 00000100:00100000:0.0:1715207774.748608:0:6992:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1202 00000100:00100000:0.0:1715207774.748611:0:6992:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012bda9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:47336e3e-5c2f-4892-9b72-90c87ec36b26+18:3215:x1798523508183232:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1715207774.748631:0:6992:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012bda9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:47336e3e-5c2f-4892-9b72-90c87ec36b26+18:3215:x1798523508183232:12345-0@lo:400:kworker.0 Request processed in 20us (224us total) trans 0 rc 0/0 00000100:00100000:0.0:1715207774.748635:0:6992:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1202 00000100:00100000:2.0:1715207774.748642:0:3215:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008db10e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:47336e3e-5c2f-4892-9b72-90c87ec36b26:3215:1798523508183232:0@lo:400:kworker.0 00000100:00100000:0.0:1715207774.748649:0:3218:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1715207774.748658:0:4437:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798523508183424 00000100:00100000:3.0:1715207774.748660:0:4437:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798523508183424 00000100:00080000:2.0:1715207774.748670:0:6994:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 older than 1715207744 00000100:00100000:3.0:1715207774.748672:0:4437:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1786 00000100:00100000:3.0:1715207774.748674:0:4437:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e5bbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0000_UUID+5:3218:x1798523508183424:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1715207774.748692:0:4437:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e5bbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0000_UUID+5:3218:x1798523508183424:12345-0@lo:400:kworker.0 Request processed in 18us (43us total) trans 0 rc 0/0 00000100:00100000:3.0:1715207774.748696:0:4437:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1786 00000100:00100000:0.0:1715207774.748701:0:3218:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008db11f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3218:1798523508183424:0@lo:400:kworker.0 00010000:00010000:3.0:1715207775.166433:0:6987:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1715207776.168536:0:8591:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1715207777.170623:0:6986:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1715207777.234448:0:14992:0:(llog.c:735:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1715207777.234456:0:14992:0:(llog_cat.c:796:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1715207777.235048:0:14992:0:(llog.c:792:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 1 00000040:00080000:0.0:1715207777.235059:0:14992:0:(llog.c:792:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000001:02000400:3.0:1715207777.337944:0:26507:0:(debug.c:705:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-hsm test 12t: Multiple parallel reads for a HSM imported file ========================================================== 18:36:16 (1715207776) 00000100:00100000:0.0:1715207777.432333:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.38@tcp (source: 12345-192.168.202.38@tcp) 00000100:00100000:3.0:1715207777.432470:0:6996:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798523503915392 00000100:00100000:3.0:1715207777.432483:0:6996:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798523503915392 00000100:00100000:3.0:1715207777.432559:0:6996:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.38@tcp, seq: 270 00000100:00080000:2.0:1715207777.432563:0:6994:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 older than 1715207747 00000100:00100000:3.0:1715207777.432581:0:6996:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e5bb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cbae74da-7571-45ad-b971-0e0378bbd4e4+20:29197:x1798523503915392:12345-192.168.202.38@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1715207777.432603:0:6996:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1715207777.432623:0:6996:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012ffd7600/0x8c55e4ad37f667cb lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbbeffb005ec3e31b expref: -99 pid: 6996 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715207777.432744:0:6996:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012ffd6640/0x8c55e4ad37f667d2 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6996 initiator: MDT0 00010000:00010000:3.0:1715207777.432760:0:6996:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012ffd6640/0x8c55e4ad37f667d2 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6996 initiator: MDT0 00010000:00010000:3.0:1715207777.432771:0:6996:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012ffd6640/0x8c55e4ad37f667d2 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6996 initiator: MDT0 00010000:00010000:3.0:1715207777.432784:0:6996:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012ffd4d80/0x8c55e4ad37f667d9 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x646966 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6996 initiator: MDT0 00010000:00010000:3.0:1715207777.432791:0:6996:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012ffd4d80/0x8c55e4ad37f667d9 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x646966 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6996 initiator: MDT0 00010000:00010000:3.0:1715207777.432797:0:6996:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012ffd4d80/0x8c55e4ad37f667d9 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x646966 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6996 initiator: MDT0 00000004:00200000:3.0:1715207777.432882:0:6996:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 10752 00010000:00010000:3.0:1715207777.433028:0:6996:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012ffd6640/0x8c55e4ad37f667d2 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6996 initiator: MDT0 00010000:00010000:3.0:1715207777.433036:0:6996:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012ffd6640/0x8c55e4ad37f667d2 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6996 initiator: MDT0 00010000:00010000:3.0:1715207777.433043:0:6996:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012ffd6640/0x8c55e4ad37f667d2 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6996 initiator: MDT0 00010000:00010000:3.0:1715207777.433049:0:6996:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88012ffd6640 already unused, calling callback (ffffffffa13a3730) 00010000:00010000:3.0:1715207777.433062:0:6996:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012ffd6640/0x8c55e4ad37f667d2 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6996 initiator: MDT0 00010000:00010000:3.0:1715207777.433070:0:6996:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012ffd6640/0x8c55e4ad37f667d2 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6996 initiator: MDT0 00010000:00010000:3.0:1715207777.433082:0:6996:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff88008e524300) 00010000:00010000:3.0:1715207777.433085:0:6996:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1715207777.433089:0:6996:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012ffd6640/0x8c55e4ad37f667d2 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6996 initiator: MDT0 00010000:00010000:3.0:1715207777.433095:0:6996:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012ffd6640/0x8c55e4ad37f667d2 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6996 initiator: MDT0 00010000:00010000:3.0:1715207777.433125:0:6996:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012ffd4d80/0x8c55e4ad37f667d9 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x646966 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6996 initiator: MDT0 00010000:00010000:3.0:1715207777.433131:0:6996:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012ffd4d80/0x8c55e4ad37f667d9 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x646966 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6996 initiator: MDT0 00010000:00010000:3.0:1715207777.433137:0:6996:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012ffd4d80/0x8c55e4ad37f667d9 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x646966 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6996 initiator: MDT0 00010000:00010000:3.0:1715207777.433142:0:6996:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88012ffd4d80 already unused, calling callback (ffffffffa13a3730) 00010000:00010000:3.0:1715207777.433144:0:6996:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012ffd4d80/0x8c55e4ad37f667d9 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x646966 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6996 initiator: MDT0 00010000:00010000:3.0:1715207777.433150:0:6996:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012ffd4d80/0x8c55e4ad37f667d9 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x646966 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6996 initiator: MDT0 00010000:00010000:3.0:1715207777.433156:0:6996:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x646966 (ffff88008f277600) 00010000:00010000:3.0:1715207777.433158:0:6996:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1715207777.433161:0:6996:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012ffd4d80/0x8c55e4ad37f667d9 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x646966 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6996 initiator: MDT0 00010000:00010000:3.0:1715207777.433175:0:6996:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012ffd4d80/0x8c55e4ad37f667d9 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x646966 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6996 initiator: MDT0 00010000:00010000:3.0:1715207777.433216:0:6996:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012ffd7600/0x8c55e4ad37f667cb lrc: 1/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.38@tcp remote: 0xbbeffb005ec3e31b expref: 22 pid: 6996 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715207777.433225:0:6996:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012ffd7600/0x8c55e4ad37f667cb lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.38@tcp remote: 0xbbeffb005ec3e31b expref: 22 pid: 6996 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715207777.433234:0:6996:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012ffd7600, rc 0) 00000100:00100000:3.0:1715207777.433332:0:6996:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e5bb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cbae74da-7571-45ad-b971-0e0378bbd4e4+21:29197:x1798523503915392:12345-192.168.202.38@tcp:101:lhsmtool_posix.0 Request processed in 752us (1007us total) trans 4294967440 rc 301/301 00000100:00100000:3.0:1715207777.433342:0:6996:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.38@tcp, seq: 270 00000100:00100000:0.0:1715207777.435194:0:3208:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.38@tcp (source: 12345-192.168.202.38@tcp) 00000100:00100000:3.0:1715207777.435312:0:6996:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798523503915456 00000100:00100000:3.0:1715207777.435321:0:6996:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798523503915456 00000100:00100000:3.0:1715207777.435367:0:6996:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.38@tcp, seq: 271 00000100:00100000:3.0:1715207777.435400:0:6996:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e4db480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cbae74da-7571-45ad-b971-0e0378bbd4e4+21:29197:x1798523503915456:12345-192.168.202.38@tcp:59:lhsmtool_posix.0 00000100:00100000:3.0:1715207777.435468:0:6996:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e4db480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cbae74da-7571-45ad-b971-0e0378bbd4e4+21:29197:x1798523503915456:12345-192.168.202.38@tcp:59:lhsmtool_posix.0 Request processed in 93us (278us total) trans 0 rc 0/0 00000100:00100000:3.0:1715207777.435476:0:6996:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.38@tcp, seq: 271 00000100:00100000:0.0:1715207777.448153:0:3209:0:(events.c:359:request_in_callback()) peer: 12345-192.168.202.38@tcp (source: 12345-192.168.202.38@tcp) 00000100:00100000:3.0:1715207777.448254:0:6996:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798523503915776 00000100:00100000:3.0:1715207777.448265:0:6996:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798523503915776 00000100:00100000:3.0:1715207777.448363:0:6996:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.38@tcp, seq: 272 00000100:00100000:3.0:1715207777.448403:0:6996:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e4d8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cbae74da-7571-45ad-b971-0e0378bbd4e4+21:29200:x1798523503915776:12345-192.168.202.38@tcp:101:rm.0 00010000:00010000:3.0:1715207777.448424:0:6996:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1715207777.448444:0:6996:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012ffd4b40/0x8c55e4ad37f667e7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbbeffb005ec3e33e expref: -99 pid: 6996 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715207777.448520:0:6996:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012ffd58c0/0x8c55e4ad37f667ee lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6996 initiator: MDT0 00010000:00010000:3.0:1715207777.448536:0:6996:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012ffd58c0/0x8c55e4ad37f667ee lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6996 initiator: MDT0 00010000:00010000:3.0:1715207777.448551:0:6996:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012ffd58c0/0x8c55e4ad37f667ee lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6996 initiator: MDT0 00010000:00010000:3.0:1715207777.448570:0:6996:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012ffd61c0/0x8c55e4ad37f667f5 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x2517b0f7 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6996 initiator: MDT0 00010000:00010000:3.0:1715207777.448582:0:6996:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012ffd61c0/0x8c55e4ad37f667f5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2517b0f7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6996 initiator: MDT0 00010000:00010000:3.0:1715207777.448593:0:6996:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012ffd61c0/0x8c55e4ad37f667f5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2517b0f7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6996 initiator: MDT0 00010000:00010000:3.0:1715207777.448680:0:6996:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012ffd58c0/0x8c55e4ad37f667ee lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6996 initiator: MDT0 00010000:00010000:3.0:1715207777.448692:0:6996:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012ffd58c0/0x8c55e4ad37f667ee lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6996 initiator: MDT0 00010000:00010000:3.0:1715207777.448702:0:6996:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012ffd58c0/0x8c55e4ad37f667ee lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6996 initiator: MDT0 00010000:00010000:3.0:1715207777.448711:0:6996:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88012ffd58c0 already unused, calling callback (ffffffffa13a3730) 00010000:00010000:3.0:1715207777.448717:0:6996:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012ffd58c0/0x8c55e4ad37f667ee lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6996 initiator: MDT0 00010000:00010000:3.0:1715207777.448728:0:6996:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012ffd58c0/0x8c55e4ad37f667ee lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6996 initiator: MDT0 00010000:00010000:3.0:1715207777.448759:0:6996:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800a68d3500) 00010000:00010000:3.0:1715207777.448763:0:6996:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1715207777.448767:0:6996:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012ffd58c0/0x8c55e4ad37f667ee lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6996 initiator: MDT0 00010000:00010000:3.0:1715207777.448773:0:6996:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012ffd58c0/0x8c55e4ad37f667ee lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6996 initiator: MDT0 00010000:00010000:3.0:1715207777.448808:0:6996:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012ffd61c0/0x8c55e4ad37f667f5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2517b0f7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6996 initiator: MDT0 00010000:00010000:3.0:1715207777.448818:0:6996:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012ffd61c0/0x8c55e4ad37f667f5 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2517b0f7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6996 initiator: MDT0 00010000:00010000:3.0:1715207777.448827:0:6996:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012ffd61c0/0x8c55e4ad37f667f5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2517b0f7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6996 initiator: MDT0 00010000:00010000:3.0:1715207777.448835:0:6996:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88012ffd61c0 already unused, calling callback (ffffffffa13a3730) 00010000:00010000:3.0:1715207777.448840:0:6996:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012ffd61c0/0x8c55e4ad37f667f5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2517b0f7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6996 initiator: MDT0 00010000:00010000:3.0:1715207777.448849:0:6996:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012ffd61c0/0x8c55e4ad37f667f5 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2517b0f7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6996 initiator: MDT0 00010000:00010000:3.0:1715207777.448861:0:6996:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x2517b0f7 (ffff88008f277900) 00010000:00010000:3.0:1715207777.448865:0:6996:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1715207777.448870:0:6996:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012ffd61c0/0x8c55e4ad37f667f5 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x2517b0f7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6996 initiator: MDT0 00010000:00010000:3.0:1715207777.448878:0:6996:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012ffd61c0/0x8c55e4ad37f667f5 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x2517b0f7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6996 initiator: MDT0 00010000:00010000:3.0:1715207777.448947:0:6996:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012ffd4b40/0x8c55e4ad37f667e7 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.38@tcp remote: 0xbbeffb005ec3e33e expref: 22 pid: 6996 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715207777.448971:0:6996:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012ffd4b40/0x8c55e4ad37f667e7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.38@tcp remote: 0xbbeffb005ec3e33e expref: 22 pid: 6996 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715207777.448983:0:6996:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012ffd4b40, rc 0) 00000100:00100000:3.0:1715207777.449047:0:6996:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e4d8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cbae74da-7571-45ad-b971-0e0378bbd4e4+21:29200:x1798523503915776:12345-192.168.202.38@tcp:101:rm.0 Request processed in 672us (898us total) trans 0 rc 301/301 00000100:00100000:3.0:1715207777.449060:0:6996:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.38@tcp, seq: 272 00000001:02000400:1.0:1715207777.964000:0:26571:0:(debug.c:705:libcfs_debug_mark_buffer()) DEBUG MARKER: sanity-hsm test_12t: @@@@@@ FAIL: cannot create /mnt/lustre2/d12t.sanity-hsm/f12t.sanity-hsm with cp, status=1 00010000:00010000:2.0:1715207778.172648:0:10149:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1715207778.234479:0:14992:0:(llog.c:735:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1715207778.234487:0:14992:0:(llog_cat.c:796:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1715207778.235086:0:14992:0:(llog.c:792:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 1 00000040:00080000:0.0:1715207778.235097:0:14992:0:(llog.c:792:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 Debug log: 212 lines, 212 kept, 0 dropped, 0 bad.