00000100:00100000:0.0F:1715208022.016360:0:3677:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:2.0F:1715208022.016448:0:21028:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798523505050880 00000100:00100000:2.0:1715208022.016470:0:21028:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798523505050880 00000100:00080000:0.0:1715208022.016534:0:7120:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 older than 1715207992 00000100:00100000:2.0:1715208022.016546:0:21028:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 434 00000100:00100000:2.0:1715208022.016556:0:21028:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009de05180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:1bc50a3e-f07c-4b55-83c3-5f3c3d406528+30:8359:x1798523505050880:12345-192.168.201.23@tcp:60:lhsmtool_posix.0 00000100:00100000:2.0:1715208022.016674:0:21028:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009de05180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:1bc50a3e-f07c-4b55-83c3-5f3c3d406528+30:8359:x1798523505050880:12345-192.168.201.23@tcp:60:lhsmtool_posix.0 Request processed in 118us (322us total) trans 0 rc 0/0 00000100:00100000:2.0:1715208022.016683:0:21028:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 434 00000100:00100000:1.0F:1715208022.018236:0:3678:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:2.0:1715208022.018380:0:21028:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798523505050944 00000100:00100000:2.0:1715208022.018389:0:21028:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798523505050944 00000100:00080000:0.0:1715208022.018435:0:7120:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 older than 1715207992 00000100:00100000:2.0:1715208022.018444:0:21028:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 435 00000100:00100000:2.0:1715208022.018452:0:21028:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007e4efb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:1bc50a3e-f07c-4b55-83c3-5f3c3d406528+15:8359:x1798523505050944:12345-192.168.201.23@tcp:60:lhsmtool_posix.0 00000100:00100000:2.0:1715208022.018520:0:21028:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007e4efb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:1bc50a3e-f07c-4b55-83c3-5f3c3d406528+15:8359:x1798523505050944:12345-192.168.201.23@tcp:60:lhsmtool_posix.0 Request processed in 67us (287us total) trans 0 rc 0/0 00000100:00100000:2.0:1715208022.018528:0:21028:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 435 00000100:00100000:0.0:1715208022.019930:0:3676:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:3.0F:1715208022.020053:0:7125:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798523505051072 00000100:00100000:3.0:1715208022.020071:0:7125:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798523505051072 00000100:00100000:3.0:1715208022.020121:0:7125:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 74 00000100:00100000:3.0:1715208022.020129:0:7125:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009de06a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1bc50a3e-f07c-4b55-83c3-5f3c3d406528+30:8359:x1798523505051072:12345-192.168.201.23@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1715208022.020378:0:7125:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009de06a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1bc50a3e-f07c-4b55-83c3-5f3c3d406528+31:8359:x1798523505051072:12345-192.168.201.23@tcp:35:lhsmtool_posix.0 Request processed in 248us (450us total) trans 4294967451 rc 0/0 00000100:00100000:3.0:1715208022.020387:0:7125:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 74 00000100:00100000:3.0:1715208022.100067:0:3684:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007e4ee680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3684:1798523510671936:0@lo:400:kworker.0 00000100:00100000:3.0:1715208022.100118:0:3684:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1715208022.100129:0:3685:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007e4ece00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3685:1798523510672000:0@lo:400:kworker.0 00000100:00100000:3.0:1715208022.100138:0:3684:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007e4ed180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3684:1798523510672192:0@lo:400:kworker.0 00000100:00100000:2.0:1715208022.100146:0:3683:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88009dd17b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3683:1798523510671872:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1715208022.100147:0:3686:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007e4ef100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:24597633-7c6c-43cc-a7e8-ad821c1018c0:3686:1798523510671808:0@lo:400:kworker.0 00000100:00100000:3.0:1715208022.100155:0:3684:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1715208022.100173:0:3684:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88012bdf6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3684:1798523510672448:0@lo:400:kworker.0 00000100:00100000:1.0:1715208022.100176:0:3685:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1715208022.100209:0:3685:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007e4eed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3685:1798523510672256:0@lo:400:kworker.0 00000100:00100000:2.0:1715208022.100210:0:3683:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1715208022.100212:0:3684:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1715208022.100213:0:3686:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1715208022.100233:0:3685:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1715208022.100237:0:3683:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007e4eca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3683:1798523510672128:0@lo:400:kworker.0 00000100:00100000:0.0:1715208022.100240:0:3686:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007e4eea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3686:1798523510672064:0@lo:400:kworker.0 00000100:00100000:1.0:1715208022.100247:0:3685:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88012bdf7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3685:1798523510672512:0@lo:400:kworker.0 00000100:00100000:3.0:1715208022.100251:0:10664:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798523510671936 00000100:00100000:3.0:1715208022.100257:0:10664:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798523510671936 00000100:00100000:2.0:1715208022.100263:0:3683:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1715208022.100266:0:3686:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1715208022.100278:0:8276:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798523510672000 00000100:00100000:2.0:1715208022.100279:0:3683:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88012bdf4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3683:1798523510672384:0@lo:400:kworker.0 00000100:00100000:3.0:1715208022.100282:0:10664:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798523510672192 00000100:00100000:1.0:1715208022.100283:0:8276:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798523510672000 00000100:00100000:3.0:1715208022.100285:0:10664:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798523510672192 00000100:00100000:0.0:1715208022.100285:0:3686:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007e4edf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3686:1798523510672320:0@lo:400:kworker.0 00000100:00100000:2.0:1715208022.100298:0:3683:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1715208022.100303:0:10664:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798523510672448 00000100:00100000:3.0:1715208022.100306:0:10664:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798523510672448 00000100:00100000:1.0:1715208022.100309:0:8276:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798523510672128 00000100:00100000:1.0:1715208022.100311:0:8276:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798523510672128 00000100:00100000:2.0:1715208022.100315:0:3683:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88012bdf5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3683:1798523510672640:0@lo:400:kworker.0 00000100:00100000:0.0:1715208022.100315:0:7123:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798523510672256 00000100:00100000:3.0:1715208022.100316:0:10664:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798523510672064 00000100:00100000:3.0:1715208022.100318:0:10664:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798523510672064 00000100:00100000:0.0:1715208022.100320:0:7123:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798523510672256 00000100:00100000:1.0:1715208022.100323:0:8276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1943 00000100:00100000:3.0:1715208022.100329:0:10664:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4287 00000100:00100000:2.0:1715208022.100331:0:3683:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1715208022.100331:0:8276:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012bdf7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3685:x1798523510672000:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1715208022.100335:0:10664:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009dd16680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3684:x1798523510671936:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1715208022.100347:0:7123:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4288 00000100:00100000:0.0:1715208022.100353:0:7123:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009dd15180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3684:x1798523510672192:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1715208022.100364:0:7127:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1944 00000100:00100000:2.0:1715208022.100372:0:7127:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ef8e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3683:x1798523510672128:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1715208022.100374:0:8276:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012bdf7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3685:x1798523510672000:12345-0@lo:400:kworker.0 Request processed in 43us (198us total) trans 0 rc 0/0 00000100:00100000:3.0:1715208022.100379:0:10664:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009dd16680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3684:x1798523510671936:12345-0@lo:400:kworker.0 Request processed in 43us (260us total) trans 0 rc 0/0 00000100:00100000:1.0:1715208022.100382:0:8276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1943 00000100:00100000:3.0:1715208022.100387:0:10664:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4287 00000100:00100000:0.0:1715208022.100390:0:7123:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009dd15180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3684:x1798523510672192:12345-0@lo:400:kworker.0 Request processed in 37us (234us total) trans 0 rc 0/0 00000100:00100000:0.0:1715208022.100398:0:7123:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4288 00000100:00100000:3.0:1715208022.100403:0:10664:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4289 00000100:00100000:3.0:1715208022.100407:0:10664:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009dd16300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3684:x1798523510672448:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1715208022.100408:0:7124:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4290 00000100:00100000:2.0:1715208022.100410:0:7127:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ef8e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3683:x1798523510672128:12345-0@lo:400:kworker.0 Request processed in 38us (145us total) trans 0 rc 0/0 00000100:00100000:1.0:1715208022.100415:0:7124:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009de04380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3686:x1798523510672064:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1715208022.100415:0:7123:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4291 00000100:00100000:0.0:1715208022.100419:0:7123:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012bdf4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3685:x1798523510672256:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1715208022.100427:0:7127:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1944 00000100:00100000:1.0:1715208022.100447:0:7124:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009de04380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3686:x1798523510672064:12345-0@lo:400:kworker.0 Request processed in 33us (180us total) trans 0 rc 0/0 00000100:00100000:0.0:1715208022.100448:0:7123:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012bdf4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3685:x1798523510672256:12345-0@lo:400:kworker.0 Request processed in 28us (215us total) trans 0 rc 0/0 00000100:00100000:3.0:1715208022.100451:0:10664:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009dd16300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3684:x1798523510672448:12345-0@lo:400:kworker.0 Request processed in 43us (239us total) trans 0 rc 0/0 00000100:00100000:1.0:1715208022.100453:0:7124:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4290 00000100:00100000:2.0:1715208022.100456:0:9385:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798523510672384 00000100:00100000:0.0:1715208022.100457:0:7123:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4291 00000100:00100000:2.0:1715208022.100461:0:9385:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798523510672384 00000100:00100000:3.0:1715208022.100462:0:10664:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4289 00000100:00080000:0.0:1715208022.100475:0:7120:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 older than 1715207992 00000100:00080000:0.0:1715208022.100479:0:7120:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 older than 1715207992 00000100:00100000:1.0:1715208022.100480:0:3685:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1715208022.100482:0:7120:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 older than 1715207992 00000100:00100000:2.0:1715208022.100483:0:9385:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798523510672640 00000100:00100000:2.0:1715208022.100485:0:9385:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798523510672640 00000100:00100000:3.0:1715208022.100486:0:9389:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798523510671872 00000100:00100000:3.0:1715208022.100489:0:9389:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798523510671872 00000100:00100000:0.0:1715208022.100495:0:17150:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2294 00000100:00100000:0.0:1715208022.100500:0:17150:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ef8e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+5:3683:x1798523510672384:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1715208022.100508:0:9389:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1842 00000100:00100000:2.0:1715208022.100508:0:9385:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2295 00000100:00100000:1.0:1715208022.100508:0:3685:0:(client.c:2956:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 4294967446 gen 2 00000004:00080000:1.0:1715208022.100514:0:3685:0:(osp_trans.c:1052:osp_request_commit_cb()) trans no 4294967446 committed transno 4294967446 00000100:00100000:3.0:1715208022.100515:0:9389:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ef8c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3683:x1798523510671872:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1715208022.100515:0:9385:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012efc6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3683:x1798523510672640:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1715208022.100537:0:3685:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88007e4ece00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3685:1798523510672000:0@lo:400:kworker.0 00002000:00000024:3.0:1715208022.100543:0:9389:0:(ofd_obd.c:743:ofd_statfs()) blocks cached 0 granted 38174400 pending 0 free 3918307328 avail 3686785024 00000100:00100000:0.0:1715208022.100545:0:17150:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ef8e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+5:3683:x1798523510672384:12345-0@lo:400:kworker.0 Request processed in 44us (246us total) trans 0 rc 0/0 00000100:00100000:2.0:1715208022.100547:0:3683:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88007e4eca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3683:1798523510672128:0@lo:400:kworker.0 00000100:00100000:1.0:1715208022.100550:0:3685:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88007e4eed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3685:1798523510672256:0@lo:400:kworker.0 00000100:00100000:0.0:1715208022.100553:0:17150:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2294 00000100:00100000:2.0:1715208022.100559:0:3683:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88012bdf4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3683:1798523510672384:0@lo:400:kworker.0 00000100:00100000:3.0:1715208022.100570:0:9389:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ef8c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3683:x1798523510671872:12345-0@lo:13:osp-pre-1-0.0 Request processed in 56us (361us total) trans 0 rc 0/0 00000100:00080000:0.0:1715208022.100570:0:7120:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 older than 1715207992 00000100:00100000:1.0:1715208022.100574:0:21028:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798523510672512 00000100:00100000:3.0:1715208022.100577:0:9389:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1842 00000100:00100000:0.0:1715208022.100580:0:3686:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1715208022.100585:0:3683:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88009dd17b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3683:1798523510671872:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1715208022.100586:0:21028:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798523510672512 00000100:00100000:3.0:1715208022.100594:0:7118:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798523510671808 00000100:00100000:3.0:1715208022.100596:0:7118:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798523510671808 00000100:00100000:0.0:1715208022.100597:0:3686:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88012bdf4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3686:1798523510672576:0@lo:400:kworker.0 00000100:00100000:1.0:1715208022.100614:0:21028:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4292 00000100:00100000:3.0:1715208022.100618:0:7118:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1438 00000100:00100000:1.0:1715208022.100620:0:21028:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e109f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:3685:x1798523510672512:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1715208022.100620:0:3686:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1715208022.100622:0:7118:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a78d2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:24597633-7c6c-43cc-a7e8-ad821c1018c0+23:3686:x1798523510671808:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1715208022.100625:0:9385:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012efc6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3683:x1798523510672640:12345-0@lo:400:kworker.0 Request processed in 111us (294us total) trans 0 rc 0/0 00000100:00100000:2.0:1715208022.100632:0:9385:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2295 00000100:00100000:2.0:1715208022.100644:0:9385:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798523510672320 00000100:00100000:2.0:1715208022.100647:0:9385:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798523510672320 00000100:00100000:0.0:1715208022.100648:0:3686:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88007e4eea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3686:1798523510672064:0@lo:400:kworker.0 00000100:00100000:3.0:1715208022.100650:0:7118:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a78d2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:24597633-7c6c-43cc-a7e8-ad821c1018c0+23:3686:x1798523510671808:12345-0@lo:400:kworker.0 Request processed in 27us (437us total) trans 0 rc 0/0 00000100:00100000:3.0:1715208022.100656:0:7118:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1438 00000100:00100000:2.0:1715208022.100659:0:9385:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798523510672576 00000100:00100000:1.0:1715208022.100659:0:21028:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e109f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:3685:x1798523510672512:12345-0@lo:400:kworker.0 Request processed in 39us (178us total) trans 0 rc 0/0 00000100:00100000:2.0:1715208022.100661:0:9385:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798523510672576 00000100:00100000:1.0:1715208022.100664:0:21028:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4292 00000100:00100000:0.0:1715208022.100665:0:3686:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88007e4ef100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:24597633-7c6c-43cc-a7e8-ad821c1018c0:3686:1798523510671808:0@lo:400:kworker.0 00000100:00100000:2.0:1715208022.100676:0:9385:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2296 00000100:00100000:2.0:1715208022.100680:0:9385:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88006ee7a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3686:x1798523510672320:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1715208022.100683:0:9387:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2297 00000100:00100000:1.0:1715208022.100688:0:9387:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88006ee78380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3686:x1798523510672576:12345-0@lo:400:kworker.0 00000100:00080000:0.0:1715208022.100691:0:7120:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 older than 1715207992 00000100:00100000:3.0:1715208022.100692:0:3684:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88007e4ed180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3684:1798523510672192:0@lo:400:kworker.0 00000100:00080000:0.0:1715208022.100694:0:7120:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 older than 1715207992 00000100:00080000:0.0:1715208022.100696:0:7120:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd MGS older than 1715207992 00000100:00080000:0.0:1715208022.100699:0:7120:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 older than 1715207992 00000100:00100000:3.0:1715208022.100703:0:3684:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88012bdf6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3684:1798523510672448:0@lo:400:kworker.0 00000100:00100000:2.0:1715208022.100709:0:9385:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88006ee7a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3686:x1798523510672320:12345-0@lo:400:kworker.0 Request processed in 28us (127us total) trans 0 rc 0/0 00000100:00100000:0.0:1715208022.100713:0:3686:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88007e4edf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3686:1798523510672320:0@lo:400:kworker.0 00000100:00100000:3.0:1715208022.100714:0:3684:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88007e4ee680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3684:1798523510671936:0@lo:400:kworker.0 00000100:00100000:2.0:1715208022.100716:0:9385:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2296 00000100:00100000:1.0:1715208022.100716:0:9387:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88006ee78380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3686:x1798523510672576:12345-0@lo:400:kworker.0 Request processed in 27us (95us total) trans 0 rc 0/0 00000100:00100000:1.0:1715208022.100722:0:9387:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2297 00000100:00100000:0.0:1715208022.100724:0:3686:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88012bdf4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3686:1798523510672576:0@lo:400:kworker.0 00000100:00100000:2.0:1715208022.100775:0:3683:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88012bdf5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3683:1798523510672640:0@lo:400:kworker.0 00000100:00100000:1.0:1715208022.100825:0:3685:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88012bdf7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3685:1798523510672512:0@lo:400:kworker.0 00000100:00100000:0.0:1715208022.116116:0:3684:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88009dd15f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3684:1798523510672704:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1715208022.116155:0:3684:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1715208022.116222:0:9919:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798523510672704 00000100:00100000:3.0:1715208022.116232:0:9919:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798523510672704 00000100:00100000:3.0:1715208022.116280:0:9919:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1843 00000100:00100000:3.0:1715208022.116290:0:9919:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88006ee78000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3684:x1798523510672704:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1715208022.116323:0:9919:0:(ofd_obd.c:743:ofd_statfs()) blocks cached 0 granted 38174400 pending 0 free 3918307328 avail 3686785024 00000100:00100000:3.0:1715208022.116397:0:9919:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88006ee78000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3684:x1798523510672704:12345-0@lo:13:osp-pre-1-1.0 Request processed in 104us (237us total) trans 0 rc 0/0 00000100:00100000:3.0:1715208022.116409:0:9919:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1843 00000100:00100000:0.0:1715208022.116429:0:3684:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88009dd15f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3684:1798523510672704:0@lo:13:osp-pre-1-1.0 00010000:00010000:2.0:1715208022.278130:0:14811:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1715208022.734013:0:15215:0:(llog.c:735:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1715208022.734021:0:15215:0:(llog_cat.c:796:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1715208022.734573:0:15215:0:(llog.c:792:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 1 00000040:00080000:1.0:1715208022.734580:0:15215:0:(llog.c:792:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000040:00080000:0.0:1715208022.775543:0:15218:0:(llog.c:792:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1715208023.280119:0:9401:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1715208023.380029:0:3685:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88006ee78a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3685:1798523510672768:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1715208023.380103:0:3685:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1715208023.380157:0:7128:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798523510672768 00000100:00100000:0.0:1715208023.380168:0:7128:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798523510672768 00000100:00100000:0.0:1715208023.380221:0:7128:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1945 00000100:00100000:0.0:1715208023.380229:0:7128:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e10b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3685:x1798523510672768:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1715208023.380265:0:7128:0:(mdt_handler.c:569:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445019648 avail 1315557376 00000100:00100000:0.0:1715208023.380338:0:7128:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e10b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3685:x1798523510672768:12345-0@lo:41:osp-pre-0-1.0 Request processed in 109us (235us total) trans 0 rc 0/0 00000100:00100000:0.0:1715208023.380347:0:7128:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1945 00000100:00100000:1.0:1715208023.380365:0:3685:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88006ee78a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3685:1798523510672768:0@lo:41:osp-pre-0-1.0 00010000:00010000:1.0:1715208024.282127:0:7112:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1715208024.453475:0:7105:0:(tgt_lastrcvd.c:969:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967451 is committed 00000100:00100000:0.0:1715208024.506319:0:3677:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:0.0:1715208024.506367:0:3677:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:0.0:1715208024.506395:0:3677:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:3.0:1715208024.506404:0:10664:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798523505051200 00000100:00100000:0.0:1715208024.506412:0:3677:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:3.0:1715208024.506417:0:10664:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798523505051200 00000100:00100000:0.0:1715208024.506448:0:3677:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:3.0:1715208024.506483:0:10664:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798523505051328 00000100:00100000:3.0:1715208024.506486:0:10664:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798523505051328 00000100:00100000:1.0:1715208024.506488:0:7119:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798523505051136 00000100:00100000:0.0:1715208024.506495:0:9407:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798523505051264 00000100:00100000:1.0:1715208024.506497:0:7119:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798523505051136 00000100:00100000:0.0:1715208024.506502:0:9407:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798523505051264 00000100:00100000:3.0:1715208024.506508:0:10664:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 4293 00000100:00080000:2.0:1715208024.506516:0:7120:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 older than 1715207994 00000100:00100000:3.0:1715208024.506517:0:10664:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88006ee7bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:04532c2b-e5e9-420d-abb0-4480aab1e378+8:2003:x1798523505051200:12345-192.168.201.23@tcp:400:kworker.0 00000100:00080000:2.0:1715208024.506523:0:7120:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd MGS older than 1715207994 00000100:00080000:2.0:1715208024.506527:0:7120:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 older than 1715207994 00000100:00100000:1.0:1715208024.506539:0:7119:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 1439 00000100:00100000:0.0:1715208024.506546:0:9407:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 4294 00000100:00100000:1.0:1715208024.506547:0:7119:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a78d2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7e7a1b67-d841-4c3c-9f35-ded8f965b8dd+12:2002:x1798523505051136:12345-192.168.201.23@tcp:400:kworker.0 00000100:00100000:0.0:1715208024.506557:0:9407:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88006ee7b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1bc50a3e-f07c-4b55-83c3-5f3c3d406528+15:2003:x1798523505051328:12345-192.168.201.23@tcp:400:kworker.0 00000100:00100000:2.0:1715208024.506564:0:7123:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 4295 00000100:00100000:2.0:1715208024.506572:0:7123:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88006ee79500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1bc50a3e-f07c-4b55-83c3-5f3c3d406528+29:2002:x1798523505051264:12345-192.168.201.23@tcp:400:kworker.0 00000100:00100000:3.0:1715208024.506600:0:10664:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88006ee7bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:04532c2b-e5e9-420d-abb0-4480aab1e378+8:2003:x1798523505051200:12345-192.168.201.23@tcp:400:kworker.0 Request processed in 83us (291us total) trans 0 rc 0/0 00000100:00100000:1.0:1715208024.506601:0:7119:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a78d2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7e7a1b67-d841-4c3c-9f35-ded8f965b8dd+12:2002:x1798523505051136:12345-192.168.201.23@tcp:400:kworker.0 Request processed in 54us (233us total) trans 0 rc 0/0 00000100:00100000:3.0:1715208024.506609:0:10664:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 4293 00000100:00100000:2.0:1715208024.506613:0:7123:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88006ee79500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1bc50a3e-f07c-4b55-83c3-5f3c3d406528+29:2002:x1798523505051264:12345-192.168.201.23@tcp:400:kworker.0 Request processed in 41us (198us total) trans 0 rc 0/0 00000100:00100000:0.0:1715208024.506613:0:9407:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88006ee7b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1bc50a3e-f07c-4b55-83c3-5f3c3d406528+15:2003:x1798523505051328:12345-192.168.201.23@tcp:400:kworker.0 Request processed in 55us (214us total) trans 0 rc 0/0 00000100:00100000:1.0:1715208024.506620:0:7119:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 1439 00000100:00100000:0.0:1715208024.506625:0:9407:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 4294 00000100:00100000:2.0:1715208024.506639:0:7123:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 4295 00000100:00100000:1.0:1715208024.506659:0:9387:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798523505051392 00000100:00100000:1.0:1715208024.506663:0:9387:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798523505051392 00000100:00100000:1.0:1715208024.506721:0:9387:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 2298 00000100:00100000:1.0:1715208024.506727:0:9387:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88006ee7aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1bc50a3e-f07c-4b55-83c3-5f3c3d406528+10:2002:x1798523505051392:12345-192.168.201.23@tcp:400:kworker.0 00000100:00080000:2.0:1715208024.506738:0:7120:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 older than 1715207994 00000100:00100000:1.0:1715208024.506760:0:9387:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88006ee7aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1bc50a3e-f07c-4b55-83c3-5f3c3d406528+10:2002:x1798523505051392:12345-192.168.201.23@tcp:400:kworker.0 Request processed in 32us (313us total) trans 0 rc 0/0 00000100:00100000:1.0:1715208024.506767:0:9387:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 2298 00000001:02000400:1.0:1715208024.841195:0:1212:0:(debug.c:705:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-hsm test 24b: root can archive, release, and restore user files ========================================================== 18:40:24 (1715208024) 00000100:00100000:0.0:1715208024.944830:0:3678:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:2.0:1715208024.944930:0:7123:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798523505051584 00000100:00100000:2.0:1715208024.944944:0:7123:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798523505051584 00000100:00100000:2.0:1715208024.945015:0:7123:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 436 00000100:00100000:2.0:1715208024.945029:0:7123:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88006ee79880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1bc50a3e-f07c-4b55-83c3-5f3c3d406528+29:9636:x1798523505051584:12345-192.168.201.23@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1715208024.945061:0:7123:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1715208024.945088:0:7123:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012ed4fcc0/0xfa8b5bed878924aa lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7561918bd55703c2 expref: -99 pid: 7123 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715208024.945183:0:7123:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012ed4ef40/0xfa8b5bed878924b1 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7123 initiator: MDT0 00010000:00010000:2.0:1715208024.945202:0:7123:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012ed4ef40/0xfa8b5bed878924b1 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7123 initiator: MDT0 00010000:00010000:2.0:1715208024.945218:0:7123:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012ed4ef40/0xfa8b5bed878924b1 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7123 initiator: MDT0 00010000:00010000:2.0:1715208024.945231:0:7123:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012ed4db00/0xfa8b5bed878924b8 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x646966 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7123 initiator: MDT0 00010000:00010000:2.0:1715208024.945239:0:7123:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012ed4db00/0xfa8b5bed878924b8 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x646966 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7123 initiator: MDT0 00010000:00010000:2.0:1715208024.945255:0:7123:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012ed4db00/0xfa8b5bed878924b8 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x646966 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7123 initiator: MDT0 00000004:00200000:2.0:1715208024.945330:0:7123:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 4096 00010000:00010000:2.0:1715208024.945410:0:7123:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012ed4ef40/0xfa8b5bed878924b1 lrc: 4/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7123 initiator: MDT0 00010000:00010000:2.0:1715208024.945418:0:7123:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012ed4ef40/0xfa8b5bed878924b1 lrc: 4/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7123 initiator: MDT0 00010000:00010000:2.0:1715208024.945424:0:7123:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012ed4ef40/0xfa8b5bed878924b1 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7123 initiator: MDT0 00010000:00010000:2.0:1715208024.945431:0:7123:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012ed4ef40/0xfa8b5bed878924b1 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7123 initiator: MDT0 00010000:00010000:2.0:1715208024.945437:0:7123:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88012ed4ef40 already unused, calling callback (ffffffffa0eef730) 00010000:00010000:2.0:1715208024.945441:0:7123:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012ed4ef40/0xfa8b5bed878924b1 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7123 initiator: MDT0 00010000:00010000:2.0:1715208024.945449:0:7123:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012ed4ef40/0xfa8b5bed878924b1 lrc: 5/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7123 initiator: MDT0 00010000:00010000:2.0:1715208024.945463:0:7123:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff8801303a6000) 00010000:00010000:2.0:1715208024.945467:0:7123:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1715208024.945471:0:7123:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012ed4ef40/0xfa8b5bed878924b1 lrc: 3/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7123 initiator: MDT0 00010000:00010000:2.0:1715208024.945477:0:7123:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012ed4ef40/0xfa8b5bed878924b1 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7123 initiator: MDT0 00010000:00010000:2.0:1715208024.945512:0:7123:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012ed4db00/0xfa8b5bed878924b8 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x646966 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7123 initiator: MDT0 00010000:00010000:2.0:1715208024.945536:0:7123:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012ed4db00/0xfa8b5bed878924b8 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x646966 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7123 initiator: MDT0 00010000:00010000:2.0:1715208024.945545:0:7123:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012ed4db00/0xfa8b5bed878924b8 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x646966 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7123 initiator: MDT0 00010000:00010000:2.0:1715208024.945553:0:7123:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88012ed4db00 already unused, calling callback (ffffffffa0eef730) 00010000:00010000:2.0:1715208024.945558:0:7123:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012ed4db00/0xfa8b5bed878924b8 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x646966 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7123 initiator: MDT0 00010000:00010000:2.0:1715208024.945568:0:7123:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012ed4db00/0xfa8b5bed878924b8 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x646966 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7123 initiator: MDT0 00010000:00010000:2.0:1715208024.945582:0:7123:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x646966 (ffff88012feb9800) 00010000:00010000:2.0:1715208024.945587:0:7123:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1715208024.945590:0:7123:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012ed4db00/0xfa8b5bed878924b8 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x646966 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7123 initiator: MDT0 00010000:00010000:2.0:1715208024.945600:0:7123:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012ed4db00/0xfa8b5bed878924b8 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x646966 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7123 initiator: MDT0 00010000:00010000:2.0:1715208024.945654:0:7123:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012ed4fcc0/0xfa8b5bed878924aa lrc: 1/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.23@tcp remote: 0x7561918bd55703c2 expref: 31 pid: 7123 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715208024.945664:0:7123:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012ed4fcc0/0xfa8b5bed878924aa lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.23@tcp remote: 0x7561918bd55703c2 expref: 31 pid: 7123 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715208024.945673:0:7123:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012ed4fcc0, rc 0) 00000100:00100000:2.0:1715208024.945771:0:7123:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88006ee79880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1bc50a3e-f07c-4b55-83c3-5f3c3d406528+30:9636:x1798523505051584:12345-192.168.201.23@tcp:101:lhsmtool_posix.0 Request processed in 742us (948us total) trans 4294967452 rc 301/301 00000100:00100000:2.0:1715208024.945783:0:7123:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 436 00000100:00100000:0.0:1715208024.947773:0:3676:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:2.0:1715208024.947860:0:7123:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798523505051648 00000100:00100000:2.0:1715208024.947869:0:7123:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798523505051648 00000100:00100000:2.0:1715208024.947950:0:7123:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 437 00000100:00100000:2.0:1715208024.947960:0:7123:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88006ee78700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1bc50a3e-f07c-4b55-83c3-5f3c3d406528+30:9636:x1798523505051648:12345-192.168.201.23@tcp:59:lhsmtool_posix.0 00000100:00100000:2.0:1715208024.948037:0:7123:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88006ee78700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1bc50a3e-f07c-4b55-83c3-5f3c3d406528+30:9636:x1798523505051648:12345-192.168.201.23@tcp:59:lhsmtool_posix.0 Request processed in 76us (267us total) trans 0 rc 0/0 00000100:00100000:2.0:1715208024.948050:0:7123:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 437 00000100:00100000:0.0:1715208024.949572:0:3677:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:2.0:1715208024.949647:0:7123:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798523505051712 00000100:00100000:2.0:1715208024.949656:0:7123:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798523505051712 00000100:00100000:2.0:1715208024.949725:0:7123:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 438 00000100:00100000:2.0:1715208024.949736:0:7123:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88006ee7ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1bc50a3e-f07c-4b55-83c3-5f3c3d406528+15:9636:x1798523505051712:12345-192.168.201.23@tcp:59:lhsmtool_posix.0 00000100:00100000:2.0:1715208024.949806:0:7123:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88006ee7ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1bc50a3e-f07c-4b55-83c3-5f3c3d406528+15:9636:x1798523505051712:12345-192.168.201.23@tcp:59:lhsmtool_posix.0 Request processed in 69us (236us total) trans 0 rc 0/0 00000100:00100000:2.0:1715208024.949817:0:7123:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 438 00000100:00100000:0.0:1715208024.970036:0:3678:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:2.0:1715208024.970122:0:7123:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798523505052032 00000100:00100000:2.0:1715208024.970131:0:7123:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798523505052032 00000100:00100000:2.0:1715208024.970183:0:7123:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 439 00000100:00100000:2.0:1715208024.970194:0:7123:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88006ee78e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1bc50a3e-f07c-4b55-83c3-5f3c3d406528+15:9641:x1798523505052032:12345-192.168.201.23@tcp:36:mkdir.0 00000100:00100000:2.0:1715208024.970296:0:7123:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88012efc6d80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:7123:1798523510672832:0@lo:1000:mdt00_001.0 00000100:00100000:2.0:1715208024.970349:0:7123:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1715208024.970386:0:7123:0:(client.c:2542:ptlrpc_set_wait()) set ffff88009e190480 going to sleep for 11 seconds 00000100:00100000:0.0:1715208024.970417:0:7128:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798523510672832 00000100:00100000:0.0:1715208024.970424:0:7128:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798523510672832 00000100:00100000:0.0:1715208024.970476:0:7128:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1946 00000100:00100000:0.0:1715208024.970483:0:7128:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012efc4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:7123:x1798523510672832:12345-0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1715208024.970568:0:7128:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012efc4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:7123:x1798523510672832:12345-0@lo:1000:mdt00_001.0 Request processed in 82us (216us total) trans 0 rc 0/0 00000100:00100000:0.0:1715208024.970580:0:7128:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1946 00000100:00100000:2.0:1715208024.970633:0:7123:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88012efc6d80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:7123:1798523510672832:0@lo:1000:mdt00_001.0 00000100:00100000:2.0:1715208024.970722:0:7123:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88012efc6d80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:7123:1798523510672896:0@lo:1000:mdt00_001.0 00000100:00100000:2.0:1715208024.970757:0:7123:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1715208024.970787:0:7123:0:(client.c:2542:ptlrpc_set_wait()) set ffff88009e190480 going to sleep for 11 seconds 00000100:00100000:0.0:1715208024.970821:0:7128:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798523510672896 00000100:00100000:0.0:1715208024.970836:0:7128:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798523510672896 00000100:00100000:0.0:1715208024.970875:0:7128:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1947 00000100:00100000:0.0:1715208024.970918:0:7128:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012efc5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:7123:x1798523510672896:12345-0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1715208024.971008:0:7128:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012efc5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:7123:x1798523510672896:12345-0@lo:1000:mdt00_001.0 Request processed in 88us (248us total) trans 0 rc -2/-2 00000100:00100000:0.0:1715208024.971019:0:7128:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1947 00000100:00100000:2.0:1715208024.971063:0:7123:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88012efc6d80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:7123:1798523510672896:0@lo:1000:mdt00_001.0 00010000:00010000:2.0:1715208024.971113:0:7123:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff88012ed4eac0/0xfa8b5bed878924c6 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 7123 initiator: MDT0 00010000:00010000:2.0:1715208024.971127:0:7123:0:(ldlm_request.c:1038:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff88012ed4eac0/0xfa8b5bed878924c6 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 7123 initiator: MDT1 00010000:00010000:2.0:1715208024.971142:0:7123:0:(ldlm_request.c:1125:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff88012ed4eac0/0xfa8b5bed878924c6 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x1000000000000 pid: 7123 initiator: MDT1 00000100:00100000:2.0:1715208024.971158:0:7123:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88012efc6d80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:7123:1798523510672960:0@lo:101:mdt00_001.0 00000100:00100000:2.0:1715208024.971192:0:7123:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1715208024.971223:0:7123:0:(client.c:2542:ptlrpc_set_wait()) set ffff88009e190780 going to sleep for 11 seconds 00000100:00100000:0.0:1715208024.971259:0:7128:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798523510672960 00000100:00100000:0.0:1715208024.971265:0:7128:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798523510672960 00000100:00100000:0.0:1715208024.971300:0:7128:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1948 00000100:00100000:0.0:1715208024.971307:0:7128:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012efc6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:7123:x1798523510672960:12345-0@lo:101:mdt00_001.0 00010000:00010000:0.0:1715208024.971320:0:7128:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1715208024.971336:0:7128:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a8fdfcc0/0xfa8b5bed878924cd lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfa8b5bed878924c6 expref: -99 pid: 7128 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715208024.971363:0:7128:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012ed4c900/0xfa8b5bed87892433 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.23@tcp remote: 0x7561918bd557038a expref: 29 pid: 21028 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715208024.971379:0:7128:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a8fdfcc0/0xfa8b5bed878924cd lrc: 4/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xfa8b5bed878924c6 expref: 7 pid: 7128 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715208024.971411:0:7128:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88012ed4c900/0xfa8b5bed87892433 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.23@tcp remote: 0x7561918bd557038a expref: 29 pid: 21028 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715208024.971426:0:7128:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88012ed4c900/0xfa8b5bed87892433 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.23@tcp remote: 0x7561918bd557038a expref: 29 pid: 21028 timeout: 2477 lvb_type: 0 00000100:00100000:0.0:1715208024.971439:0:7128:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88006ee79180 pname:cluuid:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000_UUID:7128:1798523510673024:192.168.201.23@tcp:104: 00000100:00100000:0.0:1715208024.971497:0:7128:0:(client.c:2542:ptlrpc_set_wait()) set ffff88009e3ba0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1715208024.973148:0:7128:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88006ee79180 pname:cluuid:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000_UUID:7128:1798523510673024:192.168.201.23@tcp:104: 00010000:00010000:2.0:1715208024.973178:0:7128:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a8fdfcc0/0xfa8b5bed878924cd lrc: 3/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xfa8b5bed878924c6 expref: 7 pid: 7128 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715208024.973193:0:7128:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88012e8ee500) 00010000:00010000:2.0:1715208024.973196:0:7128:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1715208024.973200:0:7128:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a8fdfcc0/0xfa8b5bed878924cd lrc: 3/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xfa8b5bed878924c6 expref: 7 pid: 7128 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715208024.973210:0:7128:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a8fdfcc0, rc 0) 00000100:00100000:2.0:1715208024.973268:0:7128:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012efc6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+7:7123:x1798523510672960:12345-0@lo:101:mdt00_001.0 Request processed in 1957us (2073us total) trans 0 rc 0/0 00000100:00100000:2.0:1715208024.973279:0:7128:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1948 00000100:00100000:0.0:1715208024.973423:0:7123:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88012efc6d80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:7123:1798523510672960:0@lo:101:mdt00_001.0 00010000:00010000:0.0:1715208024.973444:0:7123:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff88012ed4eac0/0xfa8b5bed878924c6 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xfa8b5bed878924cd expref: -99 pid: 7123 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715208024.973458:0:7123:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: lustre-MDT0000-osp-MDT0001 lock: ffff88012ed4eac0/0xfa8b5bed878924c6 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xfa8b5bed878924cd expref: -99 pid: 7123 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1715208024.973499:0:3678:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:3.0:1715208024.973626:0:8263:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798523505052096 00000100:00100000:3.0:1715208024.973635:0:8263:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798523505052096 00010000:00010000:3.0:1715208024.973663:0:8263:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012ed4c900/0xfa8b5bed87892433 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.23@tcp remote: 0x7561918bd557038a expref: 30 pid: 21028 timeout: 2477 lvb_type: 0 00000100:00100000:3.0:1715208024.973732:0:8263:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 127 00000100:00100000:3.0:1715208024.973741:0:8263:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012efc4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1bc50a3e-f07c-4b55-83c3-5f3c3d406528+30:2002:x1798523505052096:12345-192.168.201.23@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1715208024.973754:0:8263:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1715208024.973761:0:8263:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88012ed4c900/0xfa8b5bed87892433 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.23@tcp remote: 0x7561918bd557038a expref: 30 pid: 21028 timeout: 2477 lvb_type: 0 00010000:00010000:3.0:1715208024.973774:0:8263:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88012ed4c900/0xfa8b5bed87892433 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.23@tcp remote: 0x7561918bd557038a expref: 30 pid: 21028 timeout: 2477 lvb_type: 0 00010000:00010000:3.0:1715208024.973806:0:8263:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012ed4c900/0xfa8b5bed87892433 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.23@tcp remote: 0x7561918bd557038a expref: 30 pid: 21028 timeout: 2477 lvb_type: 0 00010000:00010000:3.0:1715208024.973824:0:8263:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88012e8ee500) 00010000:00010000:3.0:1715208024.973831:0:8263:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a8fdfcc0/0xfa8b5bed878924cd lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xfa8b5bed878924c6 expref: 6 pid: 7128 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715208024.973841:0:8263:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a8fdfcc0/0xfa8b5bed878924cd lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40080000000000 nid: 0@lo remote: 0xfa8b5bed878924c6 expref: 6 pid: 7128 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715208024.973850:0:8263:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a8fdfcc0/0xfa8b5bed878924cd lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40080000000000 nid: 0@lo remote: 0xfa8b5bed878924c6 expref: 6 pid: 7128 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715208024.973875:0:8263:0:(ldlm_lockd.c:1135:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800a8fdfcc0/0xfa8b5bed878924cd lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xfa8b5bed878924c6 expref: 6 pid: 7128 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1715208024.973927:0:8263:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88009dd15c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-MDT0000_UUID:8263:1798523510673088:0@lo:105: 00000100:00100000:3.0:1715208024.973966:0:8263:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1715208024.973982:0:8263:0:(client.c:2542:ptlrpc_set_wait()) set ffff8800a0224d80 going to sleep for 11 seconds 00000100:00100000:0.0:1715208024.973998:0:8262:0:(service.c:168:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:0.0:1715208024.974011:0:8262:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798523510673088 00000100:00100000:0.0:1715208024.974017:0:8262:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798523510673088 00000100:00100000:0.0:1715208024.974075:0:8262:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:0.0:1715208024.974085:0:8262:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88013039d850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:lustre-MDT0001-mdtlov_UUID+4:8263:x1798523510673088:12345-0@lo:105: 00000100:00080000:2.0:1715208024.974087:0:7120:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000-osp-MDT0001 older than 1715207994 00010000:00010000:0.0:1715208024.974100:0:8262:0:(ldlm_lockd.c:2548:ldlm_callback_handler()) ### completion ast ns: lustre-MDT0000-osp-MDT0001 lock: ffff88012ed4eac0/0xfa8b5bed878924c6 lrc: 5/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xfa8b5bed878924cd expref: -99 pid: 7123 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715208024.974115:0:8262:0:(ldlm_lockd.c:2006:ldlm_handle_cp_callback()) ### client completion callback handler START ns: lustre-MDT0000-osp-MDT0001 lock: ffff88012ed4eac0/0xfa8b5bed878924c6 lrc: 5/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xfa8b5bed878924cd expref: -99 pid: 7123 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715208024.974129:0:8262:0:(ldlm_lockd.c:2083:ldlm_handle_cp_callback()) ### completion AST, new policy data ns: lustre-MDT0000-osp-MDT0001 lock: ffff88012ed4eac0/0xfa8b5bed878924c6 lrc: 5/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xfa8b5bed878924cd expref: -99 pid: 7123 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715208024.974139:0:8262:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: lustre-MDT0000-osp-MDT0001 lock: ffff88012ed4eac0/0xfa8b5bed878924c6 lrc: 5/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0xfa8b5bed878924cd expref: -99 pid: 7123 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715208024.974151:0:8262:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff88012ed4eac0/0xfa8b5bed878924c6 lrc: 6/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0xfa8b5bed878924cd expref: -99 pid: 7123 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715208024.974162:0:8262:0:(ldlm_lockd.c:2111:ldlm_handle_cp_callback()) ### callback handler finished, about to run_ast_work ns: lustre-MDT0000-osp-MDT0001 lock: ffff88012ed4eac0/0xfa8b5bed878924c6 lrc: 6/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1080000000000 nid: local remote: 0xfa8b5bed878924cd expref: -99 pid: 7123 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715208024.974215:0:8262:0:(ldlm_lockd.c:2122:ldlm_handle_cp_callback()) ### client completion callback handler END (lock ffff88012ed4eac0) 00010000:00010000:2.0:1715208024.974255:0:7123:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: lustre-MDT0000-osp-MDT0001 lock: ffff88012ed4eac0/0xfa8b5bed878924c6 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xfa8b5bed878924cd expref: -99 pid: 7123 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1715208024.974276:0:8262:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88013039d850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:lustre-MDT0001-mdtlov_UUID+4:8263:x1798523510673088:12345-0@lo:105: Request processed in 190us (307us total) trans 0 rc 0/0 00010000:00010000:2.0:1715208024.974278:0:7123:0:(ldlm_request.c:808:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff88012ed4eac0/0xfa8b5bed878924c6 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xfa8b5bed878924cd expref: -99 pid: 7123 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1715208024.974287:0:8262:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000004:00080000:2.0:1715208024.974300:0:7123:0:(osp_object.c:1397:osp_invalidate()) Invalidate osp_object [0x200000007:0x1:0x0] 00000100:00100000:3.0:1715208024.974302:0:8263:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88009dd15c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-MDT0000_UUID:8263:1798523510673088:0@lo:105: 00010000:00010000:3.0:1715208024.974315:0:8263:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1715208024.974327:0:7123:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff88012ed4fcc0/0xfa8b5bed878924d4 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x8329b9f6 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 7123 initiator: MDT0 00010000:00010000:2.0:1715208024.974338:0:7123:0:(ldlm_request.c:1038:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff88012ed4fcc0/0xfa8b5bed878924d4 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x8329b9f6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 7123 initiator: MDT1 00000100:00100000:3.0:1715208024.974347:0:8263:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012efc4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1bc50a3e-f07c-4b55-83c3-5f3c3d406528+29:2002:x1798523505052096:12345-192.168.201.23@tcp:103:ldlm_bl.0 Request processed in 606us (850us total) trans 0 rc 0/0 00010000:00010000:2.0:1715208024.974350:0:7123:0:(ldlm_request.c:1125:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff88012ed4fcc0/0xfa8b5bed878924d4 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x8329b9f6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 7123 initiator: MDT1 00000100:00100000:3.0:1715208024.974356:0:8263:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 127 00000100:00100000:2.0:1715208024.974370:0:7123:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88012efc6d80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:7123:1798523510673152:0@lo:101:mdt00_001.0 00000100:00100000:2.0:1715208024.974405:0:7123:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1715208024.974422:0:7123:0:(client.c:2542:ptlrpc_set_wait()) set ffff88009e190480 going to sleep for 11 seconds 00000100:00100000:0.0:1715208024.974434:0:7128:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798523510673152 00000100:00100000:0.0:1715208024.974440:0:7128:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798523510673152 00000100:00100000:0.0:1715208024.974480:0:7128:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1949 00000100:00100000:0.0:1715208024.974488:0:7128:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012efc5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+7:7123:x1798523510673152:12345-0@lo:101:mdt00_001.0 00010000:00010000:0.0:1715208024.974503:0:7128:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1715208024.974519:0:7128:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a8fdf600/0xfa8b5bed878924db lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x8329b9f6 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfa8b5bed878924d4 expref: -99 pid: 7128 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715208024.974542:0:7128:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a8fdf600/0xfa8b5bed878924db lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x8329b9f6 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xfa8b5bed878924d4 expref: 8 pid: 7128 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715208024.974557:0:7128:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a8fdf600/0xfa8b5bed878924db lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x8329b9f6 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xfa8b5bed878924d4 expref: 8 pid: 7128 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715208024.974568:0:7128:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x8329b9f6 (ffff88012d095800) 00010000:00010000:0.0:1715208024.974573:0:7128:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1715208024.974577:0:7128:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a8fdf600, rc 0) 00000100:00100000:0.0:1715208024.974632:0:7128:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012efc5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+8:7123:x1798523510673152:12345-0@lo:101:mdt00_001.0 Request processed in 142us (225us total) trans 0 rc 0/0 00000100:00100000:0.0:1715208024.974642:0:7128:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1949 00000100:00100000:2.0:1715208024.974711:0:7123:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88012efc6d80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:7123:1798523510673152:0@lo:101:mdt00_001.0 00010000:00010000:2.0:1715208024.974727:0:7123:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff88012ed4fcc0/0xfa8b5bed878924d4 lrc: 4/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x8329b9f6 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xfa8b5bed878924db expref: -99 pid: 7123 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715208024.974741:0:7123:0:(ldlm_request.c:808:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff88012ed4fcc0/0xfa8b5bed878924d4 lrc: 4/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x8329b9f6 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xfa8b5bed878924db expref: -99 pid: 7123 timeout: 0 lvb_type: 0 00000004:00080000:2.0:1715208024.974758:0:7123:0:(osp_object.c:1397:osp_invalidate()) Invalidate osp_object [0x200000007:0x1:0x0] 00000100:00100000:2.0:1715208024.974787:0:7123:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88012efc6d80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:7123:1798523510673216:0@lo:1000:mdt00_001.0 00000100:00100000:2.0:1715208024.974819:0:7123:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1715208024.974834:0:7123:0:(client.c:2542:ptlrpc_set_wait()) set ffff88009e190a80 going to sleep for 11 seconds 00000100:00100000:0.0:1715208024.974852:0:7128:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798523510673216 00000100:00100000:0.0:1715208024.974858:0:7128:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798523510673216 00000100:00100000:0.0:1715208024.974922:0:7128:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1950 00000100:00100000:0.0:1715208024.974939:0:7128:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012efc5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+8:7123:x1798523510673216:12345-0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1715208024.975023:0:7128:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012efc5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+8:7123:x1798523510673216:12345-0@lo:1000:mdt00_001.0 Request processed in 83us (202us total) trans 0 rc 0/0 00000100:00100000:0.0:1715208024.975034:0:7128:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1950 00000100:00100000:2.0:1715208024.975071:0:7123:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88012efc6d80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:7123:1798523510673216:0@lo:1000:mdt00_001.0 00000100:00100000:2.0:1715208024.975128:0:7123:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88012efc6d80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:7123:1798523510673280:0@lo:1000:mdt00_001.0 00000100:00100000:2.0:1715208024.975158:0:7123:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1715208024.975173:0:7123:0:(client.c:2542:ptlrpc_set_wait()) set ffff88009e190a80 going to sleep for 11 seconds 00000100:00100000:0.0:1715208024.975188:0:7128:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798523510673280 00000100:00100000:0.0:1715208024.975195:0:7128:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798523510673280 00000100:00100000:0.0:1715208024.975232:0:7128:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1951 00000100:00100000:0.0:1715208024.975238:0:7128:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012efc4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+8:7123:x1798523510673280:12345-0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1715208024.975305:0:7128:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012efc4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+8:7123:x1798523510673280:12345-0@lo:1000:mdt00_001.0 Request processed in 65us (145us total) trans 0 rc -2/-2 00000100:00100000:0.0:1715208024.975317:0:7128:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1951 00000100:00100000:2.0:1715208024.975333:0:7123:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88012efc6d80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:7123:1798523510673280:0@lo:1000:mdt00_001.0 00000100:00100000:2.0:1715208024.975406:0:7123:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88012efc6d80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:7123:1798523510673344:0@lo:1000:mdt00_001.0 00000100:00100000:2.0:1715208024.975435:0:7123:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1715208024.975449:0:7123:0:(client.c:2542:ptlrpc_set_wait()) set ffff88009e190a80 going to sleep for 11 seconds 00000100:00100000:0.0:1715208024.975466:0:7128:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798523510673344 00000100:00100000:0.0:1715208024.975472:0:7128:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798523510673344 00000100:00100000:0.0:1715208024.975507:0:7128:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1952 00000100:00100000:0.0:1715208024.975514:0:7128:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012efc5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+8:7123:x1798523510673344:12345-0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1715208024.975579:0:7128:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012efc5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+8:7123:x1798523510673344:12345-0@lo:1000:mdt00_001.0 Request processed in 63us (142us total) trans 0 rc -2/-2 00000100:00100000:0.0:1715208024.975589:0:7128:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1952 00000100:00100000:2.0:1715208024.975604:0:7123:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88012efc6d80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:7123:1798523510673344:0@lo:1000:mdt00_001.0 00000100:00100000:2.0:1715208024.975660:0:7123:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88012efc6d80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:7123:1798523510673408:0@lo:1000:mdt00_001.0 00000100:00100000:2.0:1715208024.975715:0:7123:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1715208024.975731:0:7123:0:(client.c:2542:ptlrpc_set_wait()) set ffff88009e190a80 going to sleep for 11 seconds 00000100:00100000:0.0:1715208024.975747:0:7128:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798523510673408 00000100:00100000:0.0:1715208024.975753:0:7128:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798523510673408 00000100:00100000:0.0:1715208024.975788:0:7128:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1953 00000100:00100000:0.0:1715208024.975795:0:7128:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012efc4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+8:7123:x1798523510673408:12345-0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1715208024.975854:0:7128:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012efc4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+8:7123:x1798523510673408:12345-0@lo:1000:mdt00_001.0 Request processed in 57us (138us total) trans 0 rc 0/0 00000100:00100000:0.0:1715208024.975864:0:7128:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1953 00000100:00100000:2.0:1715208024.975910:0:7123:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88012efc6d80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:7123:1798523510673408:0@lo:1000:mdt00_001.0 00000100:00100000:2.0:1715208024.975964:0:7123:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88012efc6d80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:7123:1798523510673472:0@lo:1000:mdt00_001.0 00000100:00100000:2.0:1715208024.975994:0:7123:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1715208024.976008:0:7123:0:(client.c:2542:ptlrpc_set_wait()) set ffff88009e190a80 going to sleep for 11 seconds 00000100:00100000:0.0:1715208024.976023:0:7128:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798523510673472 00000100:00100000:0.0:1715208024.976038:0:7128:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798523510673472 00000100:00100000:0.0:1715208024.976076:0:7128:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1954 00000100:00100000:0.0:1715208024.976082:0:7128:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012efc5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+8:7123:x1798523510673472:12345-0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1715208024.976141:0:7128:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012efc5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+8:7123:x1798523510673472:12345-0@lo:1000:mdt00_001.0 Request processed in 57us (145us total) trans 0 rc 0/0 00000100:00100000:0.0:1715208024.976151:0:7128:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1954 00000100:00100000:2.0:1715208024.976167:0:7123:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88012efc6d80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:7123:1798523510673472:0@lo:1000:mdt00_001.0 00000040:00080000:2.0:1715208024.976742:0:7123:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x240000400:0x2:0x0].7, 992 off39672 00000040:00080000:2.0:1715208024.976794:0:7123:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x200000401:0x2:0x0].7, 1144 off40736 00000004:00080000:2.0:1715208024.976799:0:7123:0:(osp_trans.c:1606:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff88009e190480 with version 16 00000004:00080000:0.0:1715208024.976865:0:8266:0:(osp_trans.c:1351:osp_get_next_request()) ou ffff88006fdd4480 version 16 rpc_version 16 00000020:00100000:0.0:1715208024.976917:0:8266:0:(genops.c:2297:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:0.0:1715208024.976927:0:8266:0:(client.c:765:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff88006ee7b480 x1798523510673600/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 2168/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 00000100:00100000:0.0:1715208024.976950:0:8266:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88006ee7b480 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:8266:1798523510673600:0@lo:1000:osp_up0-1.0 00000100:00100000:0.0:1715208024.977005:0:8266:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1715208024.977025:0:8266:0:(client.c:2542:ptlrpc_set_wait()) set ffff88009e3ba0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1715208024.977034:0:7128:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798523510673600 00000100:00100000:1.0:1715208024.977043:0:7128:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798523510673600 00000100:00100000:1.0:1715208024.977078:0:7128:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1955 00000100:00100000:1.0:1715208024.977086:0:7128:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88006ee79180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+8:8266:x1798523510673600:12345-0@lo:1000:osp_up0-1.0 00000100:00100000:1.0:1715208024.977412:0:7128:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88006ee79180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+9:8266:x1798523510673600:12345-0@lo:1000:osp_up0-1.0 Request processed in 324us (405us total) trans 4294967453 rc 0/0 00000100:00100000:1.0:1715208024.977421:0:7128:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1955 00000100:00100000:0.0:1715208024.977471:0:8266:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88006ee7b480 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:8266:1798523510673600:0@lo:1000:osp_up0-1.0 00010000:00010000:2.0:1715208024.977541:0:7123:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff88012ed4c900/0xfa8b5bed878924e2 lrc: 3/0,1 mode: --/PW res: [0x240000403:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7123 initiator: MDT0 00010000:00010000:2.0:1715208024.977556:0:7123:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88012ed4c900/0xfa8b5bed878924e2 lrc: 3/0,1 mode: PW/PW res: [0x240000403:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7123 initiator: MDT1 00010000:00010000:2.0:1715208024.977573:0:7123:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88012ed4c900/0xfa8b5bed878924e2 lrc: 3/0,1 mode: PW/PW res: [0x240000403:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7123 initiator: MDT1 00000004:00010000:2.0:1715208024.977601:0:7123:0:(mdt_handler.c:4256:mdt_save_lock()) ### save lock request ffff88006ee78e00 reply state ffff88009e119000 transno 4294967342 ns: mdt-lustre-MDT0001_UUID lock: ffff88012ed4c900/0xfa8b5bed878924e2 lrc: 3/0,1 mode: PW/PW res: [0x240000403:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7123 initiator: MDT1 00010000:00010000:2.0:1715208024.977612:0:7123:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88012ed4c900/0xfa8b5bed878924e2 lrc: 3/0,1 mode: TXN/TXN res: [0x240000403:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7123 initiator: MDT1 00010000:00010000:2.0:1715208024.977619:0:7123:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0xb:0x0].0x0 (ffff88012feb9f00) 00010000:00010000:2.0:1715208024.977622:0:7123:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1715208024.977625:0:7123:0:(service.c:188:ptlrpc_save_lock()) nlocks 0 00000004:00200000:2.0:1715208024.977628:0:7123:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x240000403:0xb:0x0]: returning size 4096 00000004:00080000:2.0:1715208024.977634:0:7123:0:(osp_object.c:1397:osp_invalidate()) Invalidate osp_object [0x200000007:0x1:0x0] 00010000:00010000:2.0:1715208024.977640:0:7123:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff88012ed4eac0/0xfa8b5bed878924c6 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xfa8b5bed878924cd expref: -99 pid: 7123 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715208024.977648:0:7123:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff88012ed4eac0/0xfa8b5bed878924c6 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xfa8b5bed878924cd expref: -99 pid: 7123 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715208024.977655:0:7123:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff88012ed4eac0/0xfa8b5bed878924c6 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xfa8b5bed878924cd expref: -99 pid: 7123 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715208024.977702:0:7123:0:(ldlm_lockd.c:2227:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00080000:2.0:1715208024.977707:0:7123:0:(osp_object.c:1397:osp_invalidate()) Invalidate osp_object [0x200000007:0x1:0x0] 00010000:00010000:2.0:1715208024.977711:0:7123:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff88012ed4fcc0/0xfa8b5bed878924d4 lrc: 4/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x8329b9f6 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xfa8b5bed878924db expref: -99 pid: 7123 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715208024.977719:0:7123:0:(ldlm_lock.c:936:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-osp-MDT0001 lock: ffff88012ed4fcc0/0xfa8b5bed878924d4 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x8329b9f6 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xfa8b5bed878924db expref: -99 pid: 7123 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715208024.977776:0:11642:0:(ldlm_lockd.c:2857:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000100:00100000:2.0:1715208024.977786:0:7123:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88006ee78e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1bc50a3e-f07c-4b55-83c3-5f3c3d406528+17:9641:x1798523505052032:12345-192.168.201.23@tcp:36:mkdir.0 Request processed in 7591us (7751us total) trans 4294967342 rc 0/0 00010000:00010000:3.0:1715208024.977788:0:11642:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff88012ed4eac0/0xfa8b5bed878924c6 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0xfa8b5bed878924cd expref: -99 pid: 7123 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715208024.977814:0:11642:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88012ed4eac0 already unused, calling callback (ffffffffa0ef0520) 00000100:00100000:2.0:1715208024.977815:0:7123:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 439 00010000:00010000:3.0:1715208024.977821:0:11642:0:(ldlm_request.c:1300:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff88012ed4eac0/0xfa8b5bed878924c6 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0xfa8b5bed878924cd expref: -99 pid: 7123 timeout: 0 lvb_type: 0 00000004:00010000:3.0:1715208024.977829:0:11642:0:(mdt_handler.c:3748:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff88012ed4eac0/0xfa8b5bed878924c6 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0xfa8b5bed878924cd expref: -99 pid: 7123 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715208024.977857:0:11642:0:(ldlm_request.c:1347:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff88012ed4eac0/0xfa8b5bed878924c6 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xfa8b5bed878924cd expref: -99 pid: 7123 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715208024.977864:0:11642:0:(ldlm_request.c:1389:_ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1715208024.977930:0:11642:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff88012ed4eac0/0xfa8b5bed878924c6 lrc: 1/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xfa8b5bed878924cd expref: -99 pid: 7123 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715208024.977939:0:11642:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff88012ed4eac0/0xfa8b5bed878924c6 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xfa8b5bed878924cd expref: -99 pid: 7123 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1715208024.977949:0:3685:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00010000:00010000:3.0:1715208024.977959:0:11642:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1715208024.977961:0:11642:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1715208024.977963:0:11642:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1715208024.977966:0:3685:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88009dd15c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3685:1798523510673664:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1715208024.978008:0:3685:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1715208024.978032:0:8263:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798523510673664 00000100:00100000:3.0:1715208024.978038:0:8263:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798523510673664 00000100:00100000:3.0:1715208024.978065:0:8263:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1715208024.978071:0:8263:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800843b8850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:lustre-MDT0001-mdtlov_UUID+9:3685:x1798523510673664:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1715208024.978080:0:8263:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1715208024.978093:0:8263:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a8fdfcc0/0xfa8b5bed878924cd lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0xfa8b5bed878924c6 expref: 9 pid: 7128 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715208024.978107:0:8263:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88012e8ee500) 00010000:00010000:3.0:1715208024.978118:0:8263:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1715208024.978169:0:8263:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800843b8850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:lustre-MDT0001-mdtlov_UUID+8:3685:x1798523510673664:12345-0@lo:103:ldlm_bl.0 Request processed in 97us (161us total) trans 0 rc 0/0 00000100:00100000:3.0:1715208024.978178:0:8263:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1715208024.978206:0:3685:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88009dd15c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3685:1798523510673664:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1715208024.982929:0:3678:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:2.0:1715208024.983013:0:7123:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798523505052160 00000100:00100000:2.0:1715208024.983022:0:7123:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798523505052160 00000100:00100000:2.0:1715208024.983072:0:7123:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 440 00000100:00100000:2.0:1715208024.983082:0:7123:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88006ee78a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1bc50a3e-f07c-4b55-83c3-5f3c3d406528+29:9642:x1798523505052160:12345-192.168.201.23@tcp:101:rm.0 00010000:00010000:2.0:1715208024.983100:0:7123:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1715208024.983116:0:7123:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012ed4eac0/0xfa8b5bed878924e9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7561918bd55703de expref: -99 pid: 7123 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715208024.983165:0:7123:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012ed4db00/0xfa8b5bed878924f0 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7123 initiator: MDT0 00010000:00010000:2.0:1715208024.983180:0:7123:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012ed4db00/0xfa8b5bed878924f0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7123 initiator: MDT0 00010000:00010000:2.0:1715208024.983193:0:7123:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012ed4db00/0xfa8b5bed878924f0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7123 initiator: MDT0 00000004:00200000:2.0:1715208024.983223:0:7123:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1715208024.983227:0:7123:0:(mdt_handler.c:1570:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1715208024.983240:0:7123:0:(mdt_handler.c:2451:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88012ed4db00/0xfa8b5bed878924f0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7123 initiator: MDT0 00010000:00010000:2.0:1715208024.983260:0:7123:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012ed4eac0/0xfa8b5bed878924e9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.23@tcp remote: 0x7561918bd55703de expref: 31 pid: 7123 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715208024.983297:0:7123:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012ed4db00/0xfa8b5bed878924f0 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.23@tcp remote: 0x7561918bd55703de expref: 30 pid: 7123 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715208024.983309:0:7123:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88012e8ee500) 00010000:00010000:2.0:1715208024.983323:0:7123:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1715208024.983328:0:7123:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012ed4db00, rc 0) 00000100:00100000:2.0:1715208024.983382:0:7123:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88006ee78a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1bc50a3e-f07c-4b55-83c3-5f3c3d406528+30:9642:x1798523505052160:12345-192.168.201.23@tcp:101:rm.0 Request processed in 299us (455us total) trans 0 rc 0/0 00000100:00100000:2.0:1715208024.983394:0:7123:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 440 00000100:00100000:0.0:1715208024.985181:0:3676:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:2.0:1715208024.985263:0:7123:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798523505052224 00000100:00100000:2.0:1715208024.985271:0:7123:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798523505052224 00000100:00100000:2.0:1715208024.985331:0:7123:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 441 00000100:00100000:2.0:1715208024.985342:0:7123:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e189180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1bc50a3e-f07c-4b55-83c3-5f3c3d406528+30:9642:x1798523505052224:12345-192.168.201.23@tcp:101:rm.0 00010000:00010000:2.0:1715208024.985360:0:7123:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1715208024.985376:0:7123:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012ed4ef40/0xfa8b5bed878924f7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7561918bd55703e5 expref: -99 pid: 7123 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715208024.985422:0:7123:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012ed4c6c0/0xfa8b5bed878924fe lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7123 initiator: MDT0 00010000:00010000:2.0:1715208024.985438:0:7123:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012ed4c6c0/0xfa8b5bed878924fe lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7123 initiator: MDT0 00010000:00010000:2.0:1715208024.985450:0:7123:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012ed4c6c0/0xfa8b5bed878924fe lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7123 initiator: MDT0 00010000:00010000:2.0:1715208024.985460:0:7123:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012ed4e400/0xfa8b5bed87892505 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x8329b9f6 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7123 initiator: MDT0 00010000:00010000:2.0:1715208024.985469:0:7123:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a8fdf600/0xfa8b5bed878924db lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x8329b9f6 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xfa8b5bed878924d4 expref: 7 pid: 7128 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715208024.985476:0:7123:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012ed4e400/0xfa8b5bed87892505 lrc: 4/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x8329b9f6 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7123 initiator: MDT0 00010000:00010000:2.0:1715208024.985497:0:7123:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800a8fdf600/0xfa8b5bed878924db lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x8329b9f6 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 0@lo remote: 0xfa8b5bed878924d4 expref: 7 pid: 7128 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1715208024.985518:0:7123:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88012efc6d80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:7123:1798523510673728:0@lo:104: 00000100:00100000:2.0:1715208024.985548:0:7123:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1715208024.985583:0:7123:0:(client.c:2542:ptlrpc_set_wait()) set ffff88009e190b40 going to sleep for 11 seconds 00000100:00100000:0.0:1715208024.985618:0:8262:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798523510673728 00000100:00100000:0.0:1715208024.985626:0:8262:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798523510673728 00000100:00100000:0.0:1715208024.985669:0:8262:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:0.0:1715208024.985676:0:8262:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012efc7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:lustre-MDT0001-mdtlov_UUID+4:7123:x1798523510673728:12345-0@lo:104: 00010000:00010000:0.0:1715208024.985710:0:8262:0:(ldlm_lockd.c:2536:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0000-osp-MDT0001 lock: ffff88012ed4fcc0/0xfa8b5bed878924d4 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x8329b9f6 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1400000000000 nid: local remote: 0xfa8b5bed878924db expref: -99 pid: 7123 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715208024.985784:0:8262:0:(ldlm_lockd.c:2227:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1715208024.985793:0:8262:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012efc7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:lustre-MDT0001-mdtlov_UUID+4:7123:x1798523510673728:12345-0@lo:104: Request processed in 115us (243us total) trans 0 rc 0/0 00010000:00010000:3.0:1715208024.985796:0:7113:0:(ldlm_lockd.c:2857:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1715208024.985806:0:7113:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff88012ed4fcc0/0xfa8b5bed878924d4 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x8329b9f6 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1400000000000 nid: local remote: 0xfa8b5bed878924db expref: -99 pid: 7123 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1715208024.985806:0:8262:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00010000:00010000:3.0:1715208024.985818:0:7113:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88012ed4fcc0 already unused, calling callback (ffffffffa0ef0520) 00010000:00010000:3.0:1715208024.985823:0:7113:0:(ldlm_request.c:1300:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff88012ed4fcc0/0xfa8b5bed878924d4 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x8329b9f6 bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x1408400000000 nid: local remote: 0xfa8b5bed878924db expref: -99 pid: 7123 timeout: 0 lvb_type: 0 00000004:00010000:3.0:1715208024.985832:0:7113:0:(mdt_handler.c:3748:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff88012ed4fcc0/0xfa8b5bed878924d4 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x8329b9f6 bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x1409400000000 nid: local remote: 0xfa8b5bed878924db expref: -99 pid: 7123 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1715208024.985839:0:7123:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88012efc6d80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:7123:1798523510673728:0@lo:104: 00010000:00010000:2.0:1715208024.985858:0:7123:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88012ed4e400/0xfa8b5bed87892505 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x8329b9f6 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7123 initiator: MDT0 00010000:00010000:3.0:1715208024.985859:0:7113:0:(ldlm_request.c:1347:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff88012ed4fcc0/0xfa8b5bed878924d4 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x8329b9f6 bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0xfa8b5bed878924db expref: -99 pid: 7123 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715208024.985865:0:7113:0:(ldlm_request.c:1389:_ldlm_cancel_pack()) 1 locks packed 00000100:00100000:2.0:1715208024.985907:0:3683:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88009dd14700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3683:1798523510673792:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1715208024.985910:0:7113:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff88012ed4fcc0/0xfa8b5bed878924d4 lrc: 1/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x8329b9f6 bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0xfa8b5bed878924db expref: -99 pid: 7123 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715208024.985918:0:7113:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff88012ed4fcc0/0xfa8b5bed878924d4 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x8329b9f6 bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0xfa8b5bed878924db expref: -99 pid: 7123 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715208024.985937:0:7113:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1715208024.985939:0:7113:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1715208024.985941:0:7113:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1715208024.985942:0:3683:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1715208024.985968:0:8263:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798523510673792 00000100:00100000:3.0:1715208024.985973:0:8263:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798523510673792 00010000:00010000:3.0:1715208024.985991:0:8263:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a8fdf600/0xfa8b5bed878924db lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x8329b9f6 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000400000020 nid: 0@lo remote: 0xfa8b5bed878924d4 expref: 8 pid: 7128 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1715208024.986023:0:8263:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:3.0:1715208024.986029:0:8263:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012efc6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:lustre-MDT0001-mdtlov_UUID+8:3683:x1798523510673792:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1715208024.986039:0:8263:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000001:00080000:0.0:1715208024.987504:0:7105:0:(tgt_lastrcvd.c:969:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967453 is committed 00000001:00080000:0.0:1715208024.987513:0:7105:0:(tgt_lastrcvd.c:969:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967452 is committed 00010000:00010000:3.0:1715208024.987669:0:8263:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a8fdf600/0xfa8b5bed878924db lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x8329b9f6 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 0@lo remote: 0xfa8b5bed878924d4 expref: 7 pid: 7128 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715208024.987716:0:8263:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x8329b9f6 (ffff88012d095800) 00010000:00010000:3.0:1715208024.987722:0:8263:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff88012ed4e400/0xfa8b5bed87892505 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x8329b9f6 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7123 initiator: MDT0 00010000:00010000:3.0:1715208024.987731:0:8263:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012ed4e400/0xfa8b5bed87892505 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x8329b9f6 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 7123 initiator: MDT0 00010000:00010000:3.0:1715208024.987737:0:8263:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012ed4e400/0xfa8b5bed87892505 lrc: 4/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x8329b9f6 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 7123 initiator: MDT0 00010000:00010000:3.0:1715208024.987767:0:8263:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1715208024.987815:0:8263:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012efc6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:lustre-MDT0001-mdtlov_UUID+6:3683:x1798523510673792:12345-0@lo:103:ldlm_bl.0 Request processed in 1783us (1872us total) trans 0 rc 0/0 00010000:00010000:2.0:1715208024.987821:0:7123:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88012ed4e400/0xfa8b5bed87892505 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x8329b9f6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7123 initiator: MDT0 00000100:00100000:3.0:1715208024.987824:0:8263:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00010000:00010000:2.0:1715208024.987837:0:7123:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012ed4e400/0xfa8b5bed87892505 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x8329b9f6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7123 initiator: MDT0 00000100:00100000:0.0:1715208024.987867:0:3683:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88009dd14700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3683:1798523510673792:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1715208024.987962:0:7123:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88012efc7100 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:7123:1798523510673856:0@lo:1000:mdt00_001.0 00000100:00100000:2.0:1715208024.988005:0:7123:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1715208024.988026:0:7123:0:(client.c:2542:ptlrpc_set_wait()) set ffff88009e1900c0 going to sleep for 11 seconds 00000100:00100000:0.0:1715208024.988047:0:7128:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798523510673856 00000100:00100000:0.0:1715208024.988054:0:7128:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798523510673856 00000100:00100000:0.0:1715208024.988098:0:7128:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1956 00000100:00100000:0.0:1715208024.988107:0:7128:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012efc6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:7123:x1798523510673856:12345-0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1715208024.988193:0:7128:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012efc6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:7123:x1798523510673856:12345-0@lo:1000:mdt00_001.0 Request processed in 84us (185us total) trans 0 rc 0/0 00000100:00100000:0.0:1715208024.988205:0:7128:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1956 00000100:00100000:2.0:1715208024.988247:0:7123:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88012efc7100 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:7123:1798523510673856:0@lo:1000:mdt00_001.0 00010000:00010000:2.0:1715208024.988290:0:7123:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012ed4d200/0xfa8b5bed8789250c lrc: 3/1,0 mode: --/PR res: [0x240000403:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7123 initiator: MDT0 00010000:00010000:2.0:1715208024.988304:0:7123:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012ed4d200/0xfa8b5bed8789250c lrc: 3/1,0 mode: PR/PR res: [0x240000403:0xb:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7123 initiator: MDT0 00010000:00010000:2.0:1715208024.988315:0:7123:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012ed4d200/0xfa8b5bed8789250c lrc: 3/1,0 mode: PR/PR res: [0x240000403:0xb:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7123 initiator: MDT0 00000004:00010000:2.0:1715208024.988334:0:7123:0:(mdt_handler.c:2451:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88012ed4d200/0xfa8b5bed8789250c lrc: 3/1,0 mode: PR/PR res: [0x240000403:0xb:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7123 initiator: MDT0 00010000:00010000:2.0:1715208024.988355:0:7123:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012ed4c6c0/0xfa8b5bed878924fe lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7123 initiator: MDT0 00010000:00010000:2.0:1715208024.988364:0:7123:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012ed4c6c0/0xfa8b5bed878924fe lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7123 initiator: MDT0 00010000:00010000:2.0:1715208024.988373:0:7123:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012ed4c6c0/0xfa8b5bed878924fe lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7123 initiator: MDT0 00010000:00010000:2.0:1715208024.988382:0:7123:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012ed4c6c0/0xfa8b5bed878924fe lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7123 initiator: MDT0 00010000:00010000:2.0:1715208024.988390:0:7123:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88012ed4c6c0 already unused, calling callback (ffffffffa0eef730) 00010000:00010000:2.0:1715208024.988394:0:7123:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012ed4c6c0/0xfa8b5bed878924fe lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7123 initiator: MDT0 00010000:00010000:2.0:1715208024.988403:0:7123:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012ed4c6c0/0xfa8b5bed878924fe lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7123 initiator: MDT0 00010000:00010000:2.0:1715208024.988415:0:7123:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88012e8ee500) 00010000:00010000:2.0:1715208024.988419:0:7123:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1715208024.988424:0:7123:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012ed4c6c0/0xfa8b5bed878924fe lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7123 initiator: MDT0 00010000:00010000:2.0:1715208024.988432:0:7123:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012ed4c6c0/0xfa8b5bed878924fe lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7123 initiator: MDT0 00010000:00010000:2.0:1715208024.988460:0:7123:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012ed4e400/0xfa8b5bed87892505 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x8329b9f6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7123 initiator: MDT0 00010000:00010000:2.0:1715208024.988470:0:7123:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012ed4e400/0xfa8b5bed87892505 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x8329b9f6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7123 initiator: MDT0 00010000:00010000:2.0:1715208024.988479:0:7123:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012ed4e400/0xfa8b5bed87892505 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x8329b9f6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7123 initiator: MDT0 00010000:00010000:2.0:1715208024.988495:0:7123:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88012ed4e400 already unused, calling callback (ffffffffa0eef730) 00010000:00010000:2.0:1715208024.988500:0:7123:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012ed4e400/0xfa8b5bed87892505 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x8329b9f6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7123 initiator: MDT0 00010000:00010000:2.0:1715208024.988509:0:7123:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012ed4e400/0xfa8b5bed87892505 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x8329b9f6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7123 initiator: MDT0 00010000:00010000:2.0:1715208024.988520:0:7123:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x8329b9f6 (ffff88012d095800) 00010000:00010000:2.0:1715208024.988523:0:7123:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1715208024.988527:0:7123:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012ed4e400/0xfa8b5bed87892505 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x8329b9f6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7123 initiator: MDT0 00010000:00010000:2.0:1715208024.988536:0:7123:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012ed4e400/0xfa8b5bed87892505 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x8329b9f6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7123 initiator: MDT0 00010000:00010000:2.0:1715208024.988571:0:7123:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012ed4ef40/0xfa8b5bed878924f7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.23@tcp remote: 0x7561918bd55703e5 expref: 31 pid: 7123 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715208024.988586:0:7123:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012ed4d200/0xfa8b5bed8789250c lrc: 3/0,0 mode: PR/PR res: [0x240000403:0xb:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.23@tcp remote: 0x7561918bd55703e5 expref: 30 pid: 7123 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715208024.988597:0:7123:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0xb:0x0].0x0 (ffff88012feb9600) 00010000:00010000:2.0:1715208024.988600:0:7123:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1715208024.988603:0:7123:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012ed4d200, rc 0) 00000100:00100000:2.0:1715208024.988640:0:7123:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e189180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1bc50a3e-f07c-4b55-83c3-5f3c3d406528+30:9642:x1798523505052224:12345-192.168.201.23@tcp:101:rm.0 Request processed in 3297us (3462us total) trans 0 rc 0/0 00000100:00100000:2.0:1715208024.988652:0:7123:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 441 00000100:00100000:3.0:1715208024.990418:0:3677:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:2.0:1715208024.990496:0:7123:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798523505052288 00000100:00100000:2.0:1715208024.990504:0:7123:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798523505052288 00000100:00100000:2.0:1715208024.990562:0:7123:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 442 00000100:00100000:2.0:1715208024.990572:0:7123:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009dd14380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1bc50a3e-f07c-4b55-83c3-5f3c3d406528+17:9642:x1798523505052288:12345-192.168.201.23@tcp:101:rm.0 00010000:00010000:2.0:1715208024.990594:0:7123:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1715208024.990611:0:7123:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88012ed4d8c0/0xfa8b5bed87892513 lrc: 2/0,0 mode: --/CR res: [0x240000403:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7561918bd55703ec expref: -99 pid: 7123 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715208024.990653:0:7123:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88012ed4dd40/0xfa8b5bed8789251a lrc: 3/1,0 mode: --/PR res: [0x240000403:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7123 initiator: MDT0 00010000:00010000:2.0:1715208024.990667:0:7123:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88012ed4dd40/0xfa8b5bed8789251a lrc: 3/1,0 mode: PR/PR res: [0x240000403:0xb:0x0].0x0 bits 0x10/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7123 initiator: MDT1 00010000:00010000:2.0:1715208024.990708:0:7123:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88012ed4dd40/0xfa8b5bed8789251a lrc: 3/1,0 mode: PR/PR res: [0x240000403:0xb:0x0].0x0 bits 0x10/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7123 initiator: MDT1 00000004:00200000:2.0:1715208024.990741:0:7123:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x240000403:0xb:0x0]: returning size 4096 00000004:00200000:2.0:1715208024.990746:0:7123:0:(mdt_handler.c:1570:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00010000:00010000:2.0:1715208024.990777:0:7123:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88012ed4d8c0/0xfa8b5bed87892513 lrc: 0/0,0 mode: --/CR res: [0x240000403:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.23@tcp remote: 0x7561918bd55703ec expref: 19 pid: 7123 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715208024.990797:0:7123:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88012ed4dd40/0xfa8b5bed8789251a lrc: 3/0,0 mode: PR/PR res: [0x240000403:0xb:0x0].0x0 bits 0x10/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.23@tcp remote: 0x7561918bd55703ec expref: 18 pid: 7123 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715208024.990808:0:7123:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0xb:0x0].0x0 (ffff88012feb9f00) 00010000:00010000:2.0:1715208024.990812:0:7123:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 10 00010000:00010000:2.0:1715208024.990816:0:7123:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012ed4dd40, rc 0) 00000100:00100000:2.0:1715208024.990873:0:7123:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009dd14380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1bc50a3e-f07c-4b55-83c3-5f3c3d406528+18:9642:x1798523505052288:12345-192.168.201.23@tcp:101:rm.0 Request processed in 299us (456us total) trans 0 rc 0/0 00000100:00100000:2.0:1715208024.990914:0:7123:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 442 00000100:00100000:0.0:1715208024.992588:0:3678:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:2.0:1715208024.992671:0:7123:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798523505052352 00000100:00100000:2.0:1715208024.992716:0:7123:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798523505052352 00000100:00100000:2.0:1715208024.992753:0:7123:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 443 00000100:00100000:2.0:1715208024.992764:0:7123:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e188700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1bc50a3e-f07c-4b55-83c3-5f3c3d406528+18:9642:x1798523505052352:12345-192.168.201.23@tcp:101:rm.0 00010000:00010000:2.0:1715208024.992782:0:7123:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1715208024.992797:0:7123:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88012ed4e880/0xfa8b5bed87892521 lrc: 2/0,0 mode: --/CR res: [0x240000403:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7561918bd55703f3 expref: -99 pid: 7123 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715208024.992841:0:7123:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88012ed4f3c0/0xfa8b5bed87892528 lrc: 3/1,0 mode: --/CR res: [0x240000403:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7123 initiator: MDT0 00010000:00010000:2.0:1715208024.992855:0:7123:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88012ed4f3c0/0xfa8b5bed87892528 lrc: 3/1,0 mode: CR/CR res: [0x240000403:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7123 initiator: MDT1 00010000:00010000:2.0:1715208024.992867:0:7123:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88012ed4f3c0/0xfa8b5bed87892528 lrc: 3/1,0 mode: CR/CR res: [0x240000403:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7123 initiator: MDT1 00010000:00010000:2.0:1715208024.992960:0:7123:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88012ed4c240/0xfa8b5bed8789252f lrc: 3/1,0 mode: --/PR res: [0x240000403:0xb:0x0].0x8329ba08 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7123 initiator: MDT0 00010000:00010000:2.0:1715208024.992970:0:7123:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88012ed4c240/0xfa8b5bed8789252f lrc: 3/1,0 mode: PR/PR res: [0x240000403:0xb:0x0].0x8329ba08 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7123 initiator: MDT1 00010000:00010000:2.0:1715208024.992985:0:7123:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88012ed4c240/0xfa8b5bed8789252f lrc: 3/1,0 mode: PR/PR res: [0x240000403:0xb:0x0].0x8329ba08 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7123 initiator: MDT1 00010000:00010000:2.0:1715208024.993008:0:7123:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88012ed4f3c0/0xfa8b5bed87892528 lrc: 4/1,0 mode: CR/CR res: [0x240000403:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7123 initiator: MDT1 00010000:00010000:2.0:1715208024.993014:0:7123:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88012ed4f3c0/0xfa8b5bed87892528 lrc: 4/1,0 mode: CR/CR res: [0x240000403:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7123 initiator: MDT1 00010000:00010000:2.0:1715208024.993020:0:7123:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88012ed4f3c0/0xfa8b5bed87892528 lrc: 3/0,0 mode: CR/CR res: [0x240000403:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7123 initiator: MDT1 00010000:00010000:2.0:1715208024.993037:0:7123:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88012ed4f3c0/0xfa8b5bed87892528 lrc: 4/0,0 mode: CR/CR res: [0x240000403:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7123 initiator: MDT1 00010000:00010000:2.0:1715208024.993042:0:7123:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88012ed4f3c0 already unused, calling callback (ffffffffa0eef730) 00010000:00010000:2.0:1715208024.993045:0:7123:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88012ed4f3c0/0xfa8b5bed87892528 lrc: 4/0,0 mode: CR/CR res: [0x240000403:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7123 initiator: MDT1 00010000:00010000:2.0:1715208024.993051:0:7123:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88012ed4f3c0/0xfa8b5bed87892528 lrc: 5/0,0 mode: CR/CR res: [0x240000403:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7123 initiator: MDT1 00010000:00010000:2.0:1715208024.993061:0:7123:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0xb:0x0].0x0 (ffff88012feb9f00) 00010000:00010000:2.0:1715208024.993064:0:7123:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1715208024.993067:0:7123:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88012ed4f3c0/0xfa8b5bed87892528 lrc: 3/0,0 mode: --/CR res: [0x240000403:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7123 initiator: MDT1 00010000:00010000:2.0:1715208024.993073:0:7123:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88012ed4f3c0/0xfa8b5bed87892528 lrc: 0/0,0 mode: --/CR res: [0x240000403:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7123 initiator: MDT1 00010000:00010000:2.0:1715208024.993084:0:7123:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88012ed4c240/0xfa8b5bed8789252f lrc: 3/1,0 mode: PR/PR res: [0x240000403:0xb:0x0].0x8329ba08 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7123 initiator: MDT1 00010000:00010000:2.0:1715208024.993089:0:7123:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88012ed4c240/0xfa8b5bed8789252f lrc: 2/0,0 mode: PR/PR res: [0x240000403:0xb:0x0].0x8329ba08 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7123 initiator: MDT1 00010000:00010000:2.0:1715208024.993095:0:7123:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88012ed4c240/0xfa8b5bed8789252f lrc: 3/0,0 mode: PR/PR res: [0x240000403:0xb:0x0].0x8329ba08 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7123 initiator: MDT1 00010000:00010000:2.0:1715208024.993100:0:7123:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88012ed4c240 already unused, calling callback (ffffffffa0eef730) 00010000:00010000:2.0:1715208024.993102:0:7123:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88012ed4c240/0xfa8b5bed8789252f lrc: 3/0,0 mode: PR/PR res: [0x240000403:0xb:0x0].0x8329ba08 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7123 initiator: MDT1 00010000:00010000:2.0:1715208024.993107:0:7123:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88012ed4c240/0xfa8b5bed8789252f lrc: 4/0,0 mode: PR/PR res: [0x240000403:0xb:0x0].0x8329ba08 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7123 initiator: MDT1 00010000:00010000:2.0:1715208024.993124:0:7123:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0xb:0x0].0x8329ba08 (ffff88012feb9800) 00010000:00010000:2.0:1715208024.993126:0:7123:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1715208024.993129:0:7123:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88012ed4c240/0xfa8b5bed8789252f lrc: 2/0,0 mode: --/PR res: [0x240000403:0xb:0x0].0x8329ba08 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7123 initiator: MDT1 00010000:00010000:2.0:1715208024.993134:0:7123:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88012ed4c240/0xfa8b5bed8789252f lrc: 0/0,0 mode: --/PR res: [0x240000403:0xb:0x0].0x8329ba08 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7123 initiator: MDT1 00010000:00010000:2.0:1715208024.993162:0:7123:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88012ed4e880/0xfa8b5bed87892521 lrc: 1/0,0 mode: --/CR res: [0x240000403:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.23@tcp remote: 0x7561918bd55703f3 expref: 19 pid: 7123 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715208024.993171:0:7123:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88012ed4e880/0xfa8b5bed87892521 lrc: 0/0,0 mode: --/CR res: [0x240000403:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.23@tcp remote: 0x7561918bd55703f3 expref: 19 pid: 7123 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715208024.993178:0:7123:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012ed4e880, rc 0) 00000100:00100000:2.0:1715208024.993227:0:7123:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e188700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1bc50a3e-f07c-4b55-83c3-5f3c3d406528+18:9642:x1798523505052352:12345-192.168.201.23@tcp:101:rm.0 Request processed in 464us (643us total) trans 0 rc 301/301 00000100:00100000:2.0:1715208024.993236:0:7123:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 443 00000100:00100000:0.0:1715208024.995145:0:3676:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:2.0:1715208024.995228:0:7123:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798523505052416 00000100:00100000:2.0:1715208024.995236:0:7123:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798523505052416 00000100:00100000:2.0:1715208024.995287:0:7123:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 444 00000100:00100000:2.0:1715208024.995297:0:7123:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009dc6e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1bc50a3e-f07c-4b55-83c3-5f3c3d406528+18:9642:x1798523505052416:12345-192.168.201.23@tcp:101:rm.0 00010000:00010000:2.0:1715208024.995315:0:7123:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1715208024.995331:0:7123:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88012ed4fcc0/0xfa8b5bed87892536 lrc: 2/0,0 mode: --/CR res: [0x240000403:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7561918bd55703fa expref: -99 pid: 7123 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715208024.995376:0:7123:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88012ed4eac0/0xfa8b5bed8789253d lrc: 3/1,0 mode: --/CR res: [0x240000403:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7123 initiator: MDT0 00010000:00010000:2.0:1715208024.995407:0:7123:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88012ed4eac0/0xfa8b5bed8789253d lrc: 3/1,0 mode: CR/CR res: [0x240000403:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7123 initiator: MDT1 00010000:00010000:2.0:1715208024.995419:0:7123:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88012ed4eac0/0xfa8b5bed8789253d lrc: 3/1,0 mode: CR/CR res: [0x240000403:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7123 initiator: MDT1 00010000:00010000:2.0:1715208024.995434:0:7123:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff880072194480/0xfa8b5bed87892544 lrc: 3/1,0 mode: --/PR res: [0x240000403:0xb:0x0].0x8329ba08 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7123 initiator: MDT0 00010000:00010000:2.0:1715208024.995441:0:7123:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880072194480/0xfa8b5bed87892544 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0xb:0x0].0x8329ba08 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7123 initiator: MDT1 00010000:00010000:2.0:1715208024.995448:0:7123:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880072194480/0xfa8b5bed87892544 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0xb:0x0].0x8329ba08 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7123 initiator: MDT1 00010000:00010000:2.0:1715208024.995468:0:7123:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88012ed4eac0/0xfa8b5bed8789253d lrc: 4/1,0 mode: CR/CR res: [0x240000403:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7123 initiator: MDT1 00010000:00010000:2.0:1715208024.995474:0:7123:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88012ed4eac0/0xfa8b5bed8789253d lrc: 4/1,0 mode: CR/CR res: [0x240000403:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7123 initiator: MDT1 00010000:00010000:2.0:1715208024.995479:0:7123:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88012ed4eac0/0xfa8b5bed8789253d lrc: 3/0,0 mode: CR/CR res: [0x240000403:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7123 initiator: MDT1 00010000:00010000:2.0:1715208024.995485:0:7123:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88012ed4eac0/0xfa8b5bed8789253d lrc: 4/0,0 mode: CR/CR res: [0x240000403:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7123 initiator: MDT1 00010000:00010000:2.0:1715208024.995491:0:7123:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88012ed4eac0 already unused, calling callback (ffffffffa0eef730) 00010000:00010000:2.0:1715208024.995494:0:7123:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88012ed4eac0/0xfa8b5bed8789253d lrc: 4/0,0 mode: CR/CR res: [0x240000403:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7123 initiator: MDT1 00010000:00010000:2.0:1715208024.995500:0:7123:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88012ed4eac0/0xfa8b5bed8789253d lrc: 5/0,0 mode: CR/CR res: [0x240000403:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7123 initiator: MDT1 00010000:00010000:2.0:1715208024.995519:0:7123:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0xb:0x0].0x0 (ffff88012feb9f00) 00010000:00010000:2.0:1715208024.995522:0:7123:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1715208024.995526:0:7123:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88012ed4eac0/0xfa8b5bed8789253d lrc: 3/0,0 mode: --/CR res: [0x240000403:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7123 initiator: MDT1 00010000:00010000:2.0:1715208024.995532:0:7123:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88012ed4eac0/0xfa8b5bed8789253d lrc: 0/0,0 mode: --/CR res: [0x240000403:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7123 initiator: MDT1 00010000:00010000:2.0:1715208024.995543:0:7123:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff880072194480/0xfa8b5bed87892544 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0xb:0x0].0x8329ba08 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7123 initiator: MDT1 00010000:00010000:2.0:1715208024.995549:0:7123:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880072194480/0xfa8b5bed87892544 lrc: 2/0,0 mode: PR/PR res: [0x240000403:0xb:0x0].0x8329ba08 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7123 initiator: MDT1 00010000:00010000:2.0:1715208024.995554:0:7123:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880072194480/0xfa8b5bed87892544 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0xb:0x0].0x8329ba08 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7123 initiator: MDT1 00010000:00010000:2.0:1715208024.995559:0:7123:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880072194480 already unused, calling callback (ffffffffa0eef730) 00010000:00010000:2.0:1715208024.995562:0:7123:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880072194480/0xfa8b5bed87892544 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0xb:0x0].0x8329ba08 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7123 initiator: MDT1 00010000:00010000:2.0:1715208024.995567:0:7123:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880072194480/0xfa8b5bed87892544 lrc: 4/0,0 mode: PR/PR res: [0x240000403:0xb:0x0].0x8329ba08 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7123 initiator: MDT1 00010000:00010000:2.0:1715208024.995574:0:7123:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0xb:0x0].0x8329ba08 (ffff88012feb9000) 00010000:00010000:2.0:1715208024.995576:0:7123:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1715208024.995579:0:7123:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880072194480/0xfa8b5bed87892544 lrc: 2/0,0 mode: --/PR res: [0x240000403:0xb:0x0].0x8329ba08 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7123 initiator: MDT1 00010000:00010000:2.0:1715208024.995584:0:7123:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880072194480/0xfa8b5bed87892544 lrc: 0/0,0 mode: --/PR res: [0x240000403:0xb:0x0].0x8329ba08 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7123 initiator: MDT1 00010000:00010000:2.0:1715208024.995610:0:7123:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88012ed4fcc0/0xfa8b5bed87892536 lrc: 1/0,0 mode: --/CR res: [0x240000403:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.23@tcp remote: 0x7561918bd55703fa expref: 19 pid: 7123 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715208024.995625:0:7123:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88012ed4fcc0/0xfa8b5bed87892536 lrc: 0/0,0 mode: --/CR res: [0x240000403:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.23@tcp remote: 0x7561918bd55703fa expref: 19 pid: 7123 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715208024.995635:0:7123:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012ed4fcc0, rc 0) 00000100:00100000:2.0:1715208024.995709:0:7123:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009dc6e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1bc50a3e-f07c-4b55-83c3-5f3c3d406528+18:9642:x1798523505052416:12345-192.168.201.23@tcp:101:rm.0 Request processed in 410us (565us total) trans 0 rc 301/301 00000100:00100000:2.0:1715208024.995721:0:7123:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 444 00000100:00100000:3.0:1715208025.001195:0:3677:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:2.0:1715208025.001266:0:7123:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798523505052544 00000100:00100000:2.0:1715208025.001275:0:7123:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798523505052544 00000100:00100000:2.0:1715208025.001322:0:7123:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 445 00000100:00100000:2.0:1715208025.001333:0:7123:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009dd14700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1bc50a3e-f07c-4b55-83c3-5f3c3d406528+18:9643:x1798523505052544:12345-192.168.201.23@tcp:101:dd.0 00010000:00010000:2.0:1715208025.001351:0:7123:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1715208025.001367:0:7123:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880072197180/0xfa8b5bed8789254b lrc: 2/0,0 mode: --/CW res: [0x240000403:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7561918bd5570401 expref: -99 pid: 7123 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715208025.001436:0:7123:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff880072197600/0xfa8b5bed87892552 lrc: 3/0,1 mode: --/CW res: [0x240000403:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7123 initiator: MDT0 00010000:00010000:2.0:1715208025.001448:0:7123:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880072197600/0xfa8b5bed87892552 lrc: 3/0,1 mode: CW/CW res: [0x240000403:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7123 initiator: MDT1 00010000:00010000:2.0:1715208025.001457:0:7123:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880072197600/0xfa8b5bed87892552 lrc: 3/0,1 mode: CW/CW res: [0x240000403:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7123 initiator: MDT1 00010000:00010000:2.0:1715208025.001468:0:7123:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff880072197cc0/0xfa8b5bed87892559 lrc: 3/0,1 mode: --/PW res: [0x240000403:0xb:0x0].0x8329ba08 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7123 initiator: MDT0 00010000:00010000:2.0:1715208025.001475:0:7123:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880072197cc0/0xfa8b5bed87892559 lrc: 3/0,1 mode: PW/PW res: [0x240000403:0xb:0x0].0x8329ba08 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7123 initiator: MDT1 00010000:00010000:2.0:1715208025.001496:0:7123:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880072197cc0/0xfa8b5bed87892559 lrc: 3/0,1 mode: PW/PW res: [0x240000403:0xb:0x0].0x8329ba08 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7123 initiator: MDT1 00000100:00100000:2.0:1715208025.001569:0:7123:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88012efc7100 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:7123:1798523510673920:0@lo:1000:mdt00_001.0 00000100:00100000:2.0:1715208025.001603:0:7123:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1715208025.001638:0:7123:0:(client.c:2542:ptlrpc_set_wait()) set ffff88009e1900c0 going to sleep for 11 seconds 00000100:00100000:0.0:1715208025.001697:0:7128:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798523510673920 00000100:00100000:0.0:1715208025.001705:0:7128:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798523510673920 00000100:00100000:0.0:1715208025.001752:0:7128:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1957 00000100:00100000:0.0:1715208025.001758:0:7128:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012efc4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:7123:x1798523510673920:12345-0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1715208025.001836:0:7128:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012efc4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:7123:x1798523510673920:12345-0@lo:1000:mdt00_001.0 Request processed in 75us (230us total) trans 0 rc 0/0 00000100:00100000:0.0:1715208025.001848:0:7128:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1957 00000100:00100000:2.0:1715208025.001918:0:7123:0:(client.c:2956:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 4294967453 gen 2 00000004:00080000:2.0:1715208025.001926:0:7123:0:(osp_trans.c:1052:osp_request_commit_cb()) trans no 4294967453 committed transno 4294967453 00000100:00100000:2.0:1715208025.001947:0:7123:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88012efc7100 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:7123:1798523510673920:0@lo:1000:mdt00_001.0 00000004:00080000:2.0:1715208025.002159:0:7123:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000400:0x5:0x0], index 0: 0 00010000:00010000:2.0:1715208025.002264:0:7123:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff880072195f80/0xfa8b5bed87892560 lrc: 3/1,0 mode: --/PR res: [0x240000403:0xc:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7123 initiator: MDT0 00010000:00010000:2.0:1715208025.002275:0:7123:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880072195f80/0xfa8b5bed87892560 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7123 initiator: MDT1 00010000:00010000:2.0:1715208025.002284:0:7123:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff880072195f80/0xfa8b5bed87892560 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7123 initiator: MDT1 00010000:00010000:2.0:1715208025.002309:0:7123:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff880072197600/0xfa8b5bed87892552 lrc: 4/0,1 mode: CW/CW res: [0x240000403:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7123 initiator: MDT1 00010000:00010000:2.0:1715208025.002315:0:7123:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff880072197600/0xfa8b5bed87892552 lrc: 4/0,1 mode: CW/CW res: [0x240000403:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7123 initiator: MDT1 00010000:00010000:2.0:1715208025.002321:0:7123:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff880072197600/0xfa8b5bed87892552 lrc: 3/0,0 mode: CW/CW res: [0x240000403:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7123 initiator: MDT1 00010000:00010000:2.0:1715208025.002327:0:7123:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff880072197600/0xfa8b5bed87892552 lrc: 4/0,0 mode: CW/CW res: [0x240000403:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7123 initiator: MDT1 00010000:00010000:2.0:1715208025.002332:0:7123:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880072197600 already unused, calling callback (ffffffffa0eef730) 00010000:00010000:2.0:1715208025.002343:0:7123:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880072197600/0xfa8b5bed87892552 lrc: 4/0,0 mode: CW/CW res: [0x240000403:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7123 initiator: MDT1 00010000:00010000:2.0:1715208025.002350:0:7123:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff880072197600/0xfa8b5bed87892552 lrc: 5/0,0 mode: CW/CW res: [0x240000403:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7123 initiator: MDT1 00010000:00010000:2.0:1715208025.002360:0:7123:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0xb:0x0].0x0 (ffff88012feb9f00) 00010000:00010000:2.0:1715208025.002363:0:7123:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1715208025.002366:0:7123:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff880072197600/0xfa8b5bed87892552 lrc: 3/0,0 mode: --/CW res: [0x240000403:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7123 initiator: MDT1 00010000:00010000:2.0:1715208025.002372:0:7123:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880072197600/0xfa8b5bed87892552 lrc: 0/0,0 mode: --/CW res: [0x240000403:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7123 initiator: MDT1 00000004:00010000:2.0:1715208025.002383:0:7123:0:(mdt_handler.c:4256:mdt_save_lock()) ### save lock request ffff88009dd14700 reply state ffff8800a0181000 transno 4294967343 ns: mdt-lustre-MDT0001_UUID lock: ffff880072197cc0/0xfa8b5bed87892559 lrc: 3/0,1 mode: PW/PW res: [0x240000403:0xb:0x0].0x8329ba08 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7123 initiator: MDT1 00010000:00010000:2.0:1715208025.002391:0:7123:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff880072197cc0/0xfa8b5bed87892559 lrc: 3/0,1 mode: TXN/TXN res: [0x240000403:0xb:0x0].0x8329ba08 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7123 initiator: MDT1 00010000:00010000:2.0:1715208025.002397:0:7123:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0xb:0x0].0x8329ba08 (ffff88012feb9300) 00010000:00010000:2.0:1715208025.002400:0:7123:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1715208025.002402:0:7123:0:(service.c:188:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1715208025.002426:0:7123:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff880072197180/0xfa8b5bed8789254b lrc: 0/0,0 mode: --/CW res: [0x240000403:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.23@tcp remote: 0x7561918bd5570401 expref: 21 pid: 7123 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715208025.002437:0:7123:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff880072195f80/0xfa8b5bed87892560 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.23@tcp remote: 0x7561918bd5570401 expref: 20 pid: 7123 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715208025.002445:0:7123:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0xc:0x0].0x0 (ffff88012fe96000) 00010000:00010000:2.0:1715208025.002447:0:7123:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1715208025.002450:0:7123:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880072195f80, rc 0) 00000100:00100000:2.0:1715208025.002502:0:7123:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009dd14700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1bc50a3e-f07c-4b55-83c3-5f3c3d406528+21:9643:x1798523505052544:12345-192.168.201.23@tcp:101:dd.0 Request processed in 1168us (1309us total) trans 4294967343 rc 0/0 00000100:00100000:2.0:1715208025.002522:0:7123:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 445 00000100:00100000:0.0:1715208025.022112:0:3678:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:3.0:1715208025.022244:0:7125:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798523505052672 00000100:00100000:3.0:1715208025.022255:0:7125:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798523505052672 00000100:00100000:3.0:1715208025.022320:0:7125:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 75 00000100:00100000:3.0:1715208025.022332:0:7125:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009dc6ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1bc50a3e-f07c-4b55-83c3-5f3c3d406528+21:9643:x1798523505052672:12345-192.168.201.23@tcp:35:dd.0 00000100:00100000:3.0:1715208025.022558:0:7125:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009dc6ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1bc50a3e-f07c-4b55-83c3-5f3c3d406528+22:9643:x1798523505052672:12345-192.168.201.23@tcp:35:dd.0 Request processed in 225us (448us total) trans 4294967344 rc 0/0 00000100:00100000:3.0:1715208025.022577:0:7125:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 75 00000100:00100000:0.0:1715208025.252194:0:3684:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88009dd15c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3684:1798523510674048:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1715208025.252302:0:3684:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1715208025.252348:0:3684:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88012efc7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3684:1798523510673984:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1715208025.252369:0:9919:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798523510674048 00000100:00100000:0.0:1715208025.252370:0:3684:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1715208025.252380:0:9919:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798523510674048 00000100:00100000:1.0:1715208025.252422:0:7128:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798523510673984 00000100:00100000:1.0:1715208025.252432:0:7128:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798523510673984 00000100:00080000:2.0:1715208025.252448:0:7120:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 older than 1715207995 00000100:00100000:3.0:1715208025.252449:0:9919:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1844 00000100:00100000:3.0:1715208025.252462:0:9919:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009dc6f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3684:x1798523510674048:12345-0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1715208025.252471:0:7128:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1958 00000100:00100000:1.0:1715208025.252479:0:7128:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009dc6f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3684:x1798523510673984:12345-0@lo:41:osp-pre-1-0.0 00002000:00000024:3.0:1715208025.252508:0:9919:0:(ofd_obd.c:743:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3922501632 avail 3690979328 00000004:00000024:1.0:1715208025.252512:0:7128:0:(mdt_handler.c:569:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446289408 avail 1316827136 00000100:00100000:1.0:1715208025.252585:0:7128:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009dc6f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3684:x1798523510673984:12345-0@lo:41:osp-pre-1-0.0 Request processed in 106us (213us total) trans 0 rc 0/0 00000100:00100000:3.0:1715208025.252593:0:9919:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009dc6f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3684:x1798523510674048:12345-0@lo:13:osp-pre-0-0.0 Request processed in 133us (291us total) trans 0 rc 0/0 00000100:00100000:1.0:1715208025.252594:0:7128:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1958 00000100:00100000:3.0:1715208025.252602:0:9919:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1844 00000100:00100000:0.0:1715208025.252637:0:3684:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88009dd15c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3684:1798523510674048:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1715208025.252651:0:3684:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88012efc7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3684:1798523510673984:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1715208025.268133:0:3685:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88009e108000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3685:1798523510674112:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1715208025.268173:0:3685:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1715208025.268242:0:9919:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798523510674112 00000100:00100000:3.0:1715208025.268251:0:9919:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798523510674112 00000100:00100000:3.0:1715208025.268314:0:9919:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1845 00000100:00080000:2.0:1715208025.268314:0:7120:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 older than 1715207995 00000100:00100000:3.0:1715208025.268325:0:9919:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009dc6c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3685:x1798523510674112:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1715208025.268349:0:9919:0:(ofd_obd.c:743:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3922501632 avail 3690979328 00000100:00100000:3.0:1715208025.268399:0:9919:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009dc6c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3685:x1798523510674112:12345-0@lo:13:osp-pre-0-1.0 Request processed in 74us (224us total) trans 0 rc 0/0 00000100:00100000:3.0:1715208025.268411:0:9919:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1845 00000100:00100000:0.0:1715208025.268420:0:3685:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88009e108000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3685:1798523510674112:0@lo:13:osp-pre-0-1.0 00010000:00010000:2.0:1715208025.284103:0:14811:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1715208025.549306:0:1277:0:(debug.c:705:libcfs_debug_mark_buffer()) DEBUG MARKER: sanity-hsm test_24b: @@@@@@ FAIL: cannot create /mnt/lustre2/d24b.sanity-hsm/f24b.sanity-hsm with dd, status=1 00000040:00080000:1.0:1715208025.734033:0:15215:0:(llog.c:735:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1715208025.734051:0:15215:0:(llog_cat.c:796:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1715208025.734613:0:15215:0:(llog.c:792:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 1 00000040:00080000:1.0:1715208025.734621:0:15215:0:(llog.c:792:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000040:00080000:0.0:1715208025.775592:0:15218:0:(llog.c:792:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 Debug log: 828 lines, 828 kept, 0 dropped, 0 bad.