00010000:00010000:3.0F:1715209529.309485:0:9401:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0F:1715209529.508100:0:3684:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88009d865180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3684:1798523511041984:0@lo:400:kworker.0 00000100:00100000:1.0F:1715209529.508121:0:3685:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88009d865c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3685:1798523511042048:0@lo:400:kworker.0 00000100:00100000:2.0F:1715209529.508156:0:3686:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88009d866d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:24597633-7c6c-43cc-a7e8-ad821c1018c0:3686:1798523511041856:0@lo:400:kworker.0 00000100:00100000:3.0:1715209529.508162:0:3683:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88012f5dd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3683:1798523511041920:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1715209529.508238:0:3686:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1715209529.508241:0:3684:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1715209529.508242:0:3685:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1715209529.508260:0:3683:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1715209529.508275:0:3686:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88009d867b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3686:1798523511042112:0@lo:400:kworker.0 00000100:00100000:3.0:1715209529.508288:0:3683:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88009d865500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3683:1798523511042176:0@lo:400:kworker.0 00000100:00100000:1.0:1715209529.508290:0:3685:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88009d867800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3685:1798523511042304:0@lo:400:kworker.0 00000100:00100000:0.0:1715209529.508294:0:3684:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88009d864e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3684:1798523511042240:0@lo:400:kworker.0 00000100:00100000:2.0:1715209529.508299:0:3686:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1715209529.508317:0:3683:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1715209529.508321:0:3686:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88009d866680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3686:1798523511042368:0@lo:400:kworker.0 00000100:00100000:3.0:1715209529.508338:0:3683:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88009d866300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3683:1798523511042432:0@lo:400:kworker.0 00000100:00100000:1.0:1715209529.508342:0:3685:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1715209529.508351:0:3686:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1715209529.508371:0:6554:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798523511041984 00000100:00100000:0.0:1715209529.508374:0:7127:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798523511042048 00000100:00100000:2.0:1715209529.508377:0:3686:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88009dfb9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3686:1798523511042624:0@lo:400:kworker.0 00000100:00100000:3.0:1715209529.508381:0:6554:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798523511041984 00000100:00100000:0.0:1715209529.508384:0:7127:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798523511042048 00000100:00100000:1.0:1715209529.508387:0:3685:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88009dfba680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3685:1798523511042560:0@lo:400:kworker.0 00000100:00100000:2.0:1715209529.508396:0:3686:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1715209529.508419:0:3685:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1715209529.508420:0:6554:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798523511042112 00000100:00100000:3.0:1715209529.508423:0:6554:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798523511042112 00000100:00100000:2.0:1715209529.508432:0:7118:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798523511041856 00000100:00100000:0.0:1715209529.508432:0:7127:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798523511042176 00000100:00100000:2.0:1715209529.508437:0:7118:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798523511041856 00000100:00100000:0.0:1715209529.508437:0:7127:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798523511042176 00000100:00100000:3.0:1715209529.508441:0:6554:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798523511042304 00000100:00100000:3.0:1715209529.508444:0:6554:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798523511042304 00000100:00100000:1.0:1715209529.508461:0:21028:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798523511042560 00000100:00100000:0.0:1715209529.508462:0:7127:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3199 00000100:00100000:1.0:1715209529.508468:0:21028:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798523511042560 00000100:00100000:3.0:1715209529.508471:0:6554:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6984 00000100:00100000:0.0:1715209529.508474:0:7127:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801247d9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3685:x1798523511042048:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1715209529.508479:0:6554:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e03d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000-lwp-MDT0000_UUID+5:3684:x1798523511041984:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1715209529.508480:0:7118:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2052 00000100:00100000:2.0:1715209529.508486:0:7118:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880072199450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:24597633-7c6c-43cc-a7e8-ad821c1018c0+23:3686:x1798523511041856:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1715209529.508504:0:21028:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6985 00000100:00100000:1.0:1715209529.508515:0:21028:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009da59880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0001_UUID+5:3686:x1798523511042112:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1715209529.508538:0:6554:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e03d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000-lwp-MDT0000_UUID+5:3684:x1798523511041984:12345-0@lo:400:kworker.0 Request processed in 58us (301us total) trans 0 rc 0/0 00000100:00100000:2.0:1715209529.508541:0:7118:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880072199450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:24597633-7c6c-43cc-a7e8-ad821c1018c0+23:3686:x1798523511041856:12345-0@lo:400:kworker.0 Request processed in 53us (305us total) trans 0 rc 0/0 00000100:00100000:3.0:1715209529.508547:0:6554:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6984 00000100:00100000:2.0:1715209529.508549:0:7118:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2052 00000100:00100000:0.0:1715209529.508562:0:7127:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8801247d9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3685:x1798523511042048:12345-0@lo:400:kworker.0 Request processed in 87us (323us total) trans 0 rc 0/0 00000100:00100000:3.0:1715209529.508566:0:6554:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6986 00000100:00100000:3.0:1715209529.508571:0:6554:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801247db100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:lustre-MDT0001-lwp-OST0000_UUID+5:3685:x1798523511042304:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1715209529.508575:0:7127:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3199 00000100:00100000:1.0:1715209529.508580:0:21028:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009da59880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0001_UUID+5:3686:x1798523511042112:12345-0@lo:400:kworker.0 Request processed in 64us (276us total) trans 0 rc 0/0 00000100:00100000:2.0:1715209529.508588:0:7124:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6987 00000100:00100000:2.0:1715209529.508596:0:7124:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801247d9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3685:x1798523511042560:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1715209529.508596:0:21028:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6985 00000100:00100000:3.0:1715209529.508597:0:6554:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8801247db100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:lustre-MDT0001-lwp-OST0000_UUID+5:3685:x1798523511042304:12345-0@lo:400:kworker.0 Request processed in 25us (256us total) trans 0 rc 0/0 00000100:00100000:0.0:1715209529.508598:0:7127:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3200 00000100:00100000:3.0:1715209529.508604:0:6554:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6986 00000100:00100000:0.0:1715209529.508607:0:7127:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009dfbaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3683:x1798523511042176:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1715209529.508625:0:7124:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8801247d9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3685:x1798523511042560:12345-0@lo:400:kworker.0 Request processed in 31us (206us total) trans 0 rc 0/0 00000100:00100000:3.0:1715209529.508628:0:9919:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798523511041920 00000100:00100000:3.0:1715209529.508631:0:9919:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798523511041920 00000100:00100000:2.0:1715209529.508633:0:7124:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6987 00000100:00100000:1.0:1715209529.508637:0:9918:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798523511042368 00000100:00100000:1.0:1715209529.508643:0:9918:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798523511042368 00000100:00100000:0.0:1715209529.508653:0:7127:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009dfbaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3683:x1798523511042176:12345-0@lo:400:kworker.0 Request processed in 45us (333us total) trans 0 rc 0/0 00000100:00100000:3.0:1715209529.508654:0:9919:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3046 00000100:00100000:3.0:1715209529.508658:0:9919:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009dfbb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3683:x1798523511041920:12345-0@lo:13:osp-pre-1-0.0 00000100:00080000:2.0:1715209529.508658:0:7120:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 older than 1715209499 00000100:00080000:2.0:1715209529.508662:0:7120:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 older than 1715209499 00000100:00100000:0.0:1715209529.508664:0:7127:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3200 00000100:00080000:2.0:1715209529.508665:0:7120:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 older than 1715209499 00000100:00080000:2.0:1715209529.508668:0:7120:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd MGS older than 1715209499 00000100:00100000:1.0:1715209529.508678:0:9918:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798523511042624 00002000:00000024:3.0:1715209529.508680:0:9919:0:(ofd_obd.c:743:ofd_statfs()) blocks cached 0 granted 52903616 pending 0 free 3916210176 avail 3684687872 00000100:00100000:1.0:1715209529.508682:0:9918:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798523511042624 00000100:00100000:2.0:1715209529.508694:0:3686:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88009d866d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:24597633-7c6c-43cc-a7e8-ad821c1018c0:3686:1798523511041856:0@lo:400:kworker.0 00000100:00100000:3.0:1715209529.508708:0:9919:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009dfbb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3683:x1798523511041920:12345-0@lo:13:osp-pre-1-0.0 Request processed in 49us (450us total) trans 0 rc 0/0 00000100:00100000:1.0:1715209529.508711:0:9918:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3781 00000100:00100000:2.0:1715209529.508712:0:3686:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88009d867b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3686:1798523511042112:0@lo:400:kworker.0 00000100:00100000:0.0:1715209529.508714:0:3684:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1715209529.508720:0:9918:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801300b3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3686:x1798523511042368:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1715209529.508726:0:9919:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3046 00000100:00100000:0.0:1715209529.508740:0:3684:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88009dfbb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3684:1798523511042496:0@lo:400:kworker.0 00000100:00100000:3.0:1715209529.508747:0:9407:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798523511042240 00000100:00100000:3.0:1715209529.508751:0:9407:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798523511042240 00000100:00100000:2.0:1715209529.508753:0:11685:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3782 00000100:00100000:2.0:1715209529.508759:0:11685:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cd9c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3686:x1798523511042624:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1715209529.508776:0:9407:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6988 00000100:00100000:1.0:1715209529.508776:0:9918:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8801300b3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3686:x1798523511042368:12345-0@lo:400:kworker.0 Request processed in 56us (422us total) trans 0 rc 0/0 00000100:00100000:0.0:1715209529.508778:0:3684:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1715209529.508781:0:9407:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e03e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3684:x1798523511042240:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1715209529.508788:0:9918:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3781 00000100:00100000:2.0:1715209529.508792:0:11685:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cd9c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3686:x1798523511042624:12345-0@lo:400:kworker.0 Request processed in 33us (395us total) trans 0 rc 0/0 00000100:00100000:2.0:1715209529.508799:0:11685:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3782 00000100:00100000:3.0:1715209529.508815:0:9407:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e03e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3684:x1798523511042240:12345-0@lo:400:kworker.0 Request processed in 33us (104us total) trans 0 rc 0/0 00000100:00080000:2.0:1715209529.508817:0:7120:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 older than 1715209499 00000100:00100000:0.0:1715209529.508819:0:3684:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88009d865180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3684:1798523511041984:0@lo:400:kworker.0 00000100:00080000:2.0:1715209529.508820:0:7120:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 older than 1715209499 00000100:00100000:3.0:1715209529.508821:0:9407:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6988 00000100:00100000:1.0:1715209529.508823:0:7122:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798523511042496 00000100:00100000:1.0:1715209529.508829:0:7122:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798523511042496 00000100:00100000:2.0:1715209529.508841:0:3686:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88009d866680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3686:1798523511042368:0@lo:400:kworker.0 00000100:00100000:3.0:1715209529.508850:0:3683:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1715209529.508851:0:3686:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88009dfb9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3686:1798523511042624:0@lo:400:kworker.0 00000100:00100000:0.0:1715209529.508853:0:3684:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88009d864e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3684:1798523511042240:0@lo:400:kworker.0 00000100:00080000:2.0:1715209529.508867:0:7120:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 older than 1715209499 00000100:00100000:1.0:1715209529.508869:0:7122:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6989 00000100:00100000:3.0:1715209529.508872:0:3683:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88009dfbb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3683:1798523511042688:0@lo:400:kworker.0 00000100:00100000:1.0:1715209529.508936:0:7122:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e03f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3684:x1798523511042496:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1715209529.508949:0:11685:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798523511042432 00000100:00100000:2.0:1715209529.508954:0:11685:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798523511042432 00000100:00100000:3.0:1715209529.508961:0:3683:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1715209529.508978:0:11685:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798523511042688 00000100:00100000:2.0:1715209529.508981:0:11685:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798523511042688 00000100:00100000:0.0:1715209529.508992:0:3685:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88009dfba680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3685:1798523511042560:0@lo:400:kworker.0 00000100:00100000:2.0:1715209529.508994:0:11685:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3783 00000100:00100000:2.0:1715209529.508999:0:11685:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009dfb9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3683:x1798523511042432:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1715209529.509014:0:7122:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e03f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3684:x1798523511042496:12345-0@lo:400:kworker.0 Request processed in 134us (234us total) trans 0 rc 0/0 00000100:00100000:0.0:1715209529.509015:0:3685:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88009d865c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3685:1798523511042048:0@lo:400:kworker.0 00000100:00100000:3.0:1715209529.509023:0:3683:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88012f5dd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3683:1798523511041920:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1715209529.509036:0:3685:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88009d867800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3685:1798523511042304:0@lo:400:kworker.0 00000100:00100000:3.0:1715209529.509038:0:3683:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88009d865500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3683:1798523511042176:0@lo:400:kworker.0 00000100:00100000:2.0:1715209529.509038:0:11685:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009dfb9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3683:x1798523511042432:12345-0@lo:400:kworker.0 Request processed in 38us (187us total) trans 0 rc 0/0 00000100:00100000:1.0:1715209529.509040:0:7122:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6989 00000100:00100000:2.0:1715209529.509044:0:11685:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3783 00000100:00100000:3.0:1715209529.509050:0:3683:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88009d866300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3683:1798523511042432:0@lo:400:kworker.0 00000100:00100000:2.0:1715209529.509055:0:11685:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3784 00000100:00100000:2.0:1715209529.509059:0:11685:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009dfb8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3683:x1798523511042688:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1715209529.509089:0:11685:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009dfb8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3683:x1798523511042688:12345-0@lo:400:kworker.0 Request processed in 29us (128us total) trans 0 rc 0/0 00000100:00100000:2.0:1715209529.509094:0:11685:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3784 00000100:00100000:3.0:1715209529.509104:0:3683:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88009dfbb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3683:1798523511042688:0@lo:400:kworker.0 00000100:00080000:2.0:1715209529.509105:0:7120:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 older than 1715209499 00000100:00100000:0.0:1715209529.509109:0:3684:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88009dfbb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3684:1798523511042496:0@lo:400:kworker.0 00000100:00100000:0.0:1715209529.524119:0:3684:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88009dfbb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3684:1798523511042752:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1715209529.524175:0:3684:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1715209529.524248:0:9389:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798523511042752 00000100:00100000:3.0:1715209529.524257:0:9389:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798523511042752 00000100:00100000:3.0:1715209529.524315:0:9389:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3047 00000100:00100000:3.0:1715209529.524322:0:9389:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e03ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3684:x1798523511042752:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1715209529.524340:0:9389:0:(ofd_obd.c:743:ofd_statfs()) blocks cached 0 granted 52903616 pending 0 free 3916210176 avail 3684687872 00000100:00100000:3.0:1715209529.524387:0:9389:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e03ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3684:x1798523511042752:12345-0@lo:13:osp-pre-1-1.0 Request processed in 64us (213us total) trans 0 rc 0/0 00000100:00100000:3.0:1715209529.524395:0:9389:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3047 00000100:00100000:0.0:1715209529.524441:0:3684:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88009dfbb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3684:1798523511042752:0@lo:13:osp-pre-1-1.0 00010000:00010000:2.0:1715209530.312105:0:7112:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1715209530.454103:0:7105:0:(tgt_lastrcvd.c:969:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967503 is committed 00000100:00100000:0.0:1715209530.788146:0:3685:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88012cd9ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3685:1798523511042816:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1715209530.788236:0:3685:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1715209530.788305:0:7128:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798523511042816 00000100:00100000:1.0:1715209530.788319:0:7128:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798523511042816 00000100:00100000:1.0:1715209530.788371:0:7128:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3201 00000100:00100000:1.0:1715209530.788379:0:7128:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e03dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3685:x1798523511042816:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1715209530.788423:0:7128:0:(mdt_handler.c:569:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1444982784 avail 1315520512 00000100:00100000:1.0:1715209530.788498:0:7128:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e03dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3685:x1798523511042816:12345-0@lo:41:osp-pre-0-1.0 Request processed in 119us (262us total) trans 0 rc 0/0 00000100:00100000:1.0:1715209530.788508:0:7128:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3201 00000100:00100000:0.0:1715209530.788529:0:3685:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88012cd9ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3685:1798523511042816:0@lo:41:osp-pre-0-1.0 00010000:00010000:2.0:1715209531.314034:0:11642:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1715209531.386120:0:3676:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:0.0:1715209531.386174:0:3676:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:0.0:1715209531.386206:0:3676:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:3.0:1715209531.386211:0:7119:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798523505171264 00000100:00100000:0.0:1715209531.386230:0:3676:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:3.0:1715209531.386232:0:7119:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798523505171264 00000100:00100000:2.0:1715209531.386249:0:9407:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798523505171328 00000100:00100000:2.0:1715209531.386258:0:9407:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798523505171328 00000100:00100000:0.0:1715209531.386261:0:3676:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:0.0:1715209531.386288:0:10664:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798523505171456 00000100:00100000:0.0:1715209531.386294:0:10664:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798523505171456 00000100:00100000:3.0:1715209531.386296:0:7119:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 2053 00000100:00100000:2.0:1715209531.386300:0:9407:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798523505171392 00000100:00100000:2.0:1715209531.386303:0:9407:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798523505171392 00000100:00100000:3.0:1715209531.386305:0:7119:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880072199050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7e7a1b67-d841-4c3c-9f35-ded8f965b8dd+12:2001:x1798523505171264:12345-192.168.201.23@tcp:400:kworker.0 00000100:00100000:1.0:1715209531.386329:0:7122:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 6990 00000100:00100000:1.0:1715209531.386339:0:7122:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e03d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:04532c2b-e5e9-420d-abb0-4480aab1e378+8:2000:x1798523505171328:12345-192.168.201.23@tcp:400:kworker.0 00000100:00100000:0.0:1715209531.386340:0:10664:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 6991 00000100:00100000:0.0:1715209531.386347:0:10664:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d955c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1bc50a3e-f07c-4b55-83c3-5f3c3d406528+24:2000:x1798523505171456:12345-192.168.201.23@tcp:400:kworker.0 00000100:00100000:2.0:1715209531.386349:0:9407:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 6992 00000100:00100000:2.0:1715209531.386355:0:9407:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d954000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1bc50a3e-f07c-4b55-83c3-5f3c3d406528+41:2001:x1798523505171392:12345-192.168.201.23@tcp:400:kworker.0 00000100:00100000:3.0:1715209531.386387:0:7119:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880072199050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7e7a1b67-d841-4c3c-9f35-ded8f965b8dd+12:2001:x1798523505171264:12345-192.168.201.23@tcp:400:kworker.0 Request processed in 84us (212us total) trans 0 rc 0/0 00000100:00100000:1.0:1715209531.386391:0:7122:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e03d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:04532c2b-e5e9-420d-abb0-4480aab1e378+8:2000:x1798523505171328:12345-192.168.201.23@tcp:400:kworker.0 Request processed in 54us (282us total) trans 0 rc 0/0 00000100:00100000:3.0:1715209531.386396:0:7119:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 2053 00000100:00100000:1.0:1715209531.386400:0:7122:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 6990 00000100:00100000:0.0:1715209531.386402:0:10664:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d955c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1bc50a3e-f07c-4b55-83c3-5f3c3d406528+24:2000:x1798523505171456:12345-192.168.201.23@tcp:400:kworker.0 Request processed in 55us (196us total) trans 0 rc 0/0 00000100:00100000:2.0:1715209531.386408:0:9407:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d954000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1bc50a3e-f07c-4b55-83c3-5f3c3d406528+41:2001:x1798523505171392:12345-192.168.201.23@tcp:400:kworker.0 Request processed in 52us (178us total) trans 0 rc 0/0 00000100:00100000:0.0:1715209531.386410:0:10664:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 6991 00000100:00100000:2.0:1715209531.386416:0:9407:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 6992 00000100:00080000:2.0:1715209531.386440:0:7120:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 older than 1715209501 00000100:00080000:2.0:1715209531.386444:0:7120:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 older than 1715209501 00000100:00080000:2.0:1715209531.386446:0:7120:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd MGS older than 1715209501 00000100:00100000:0.0:1715209531.386460:0:11685:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798523505171520 00000100:00100000:0.0:1715209531.386463:0:11685:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798523505171520 00000100:00080000:2.0:1715209531.386482:0:7120:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 older than 1715209501 00000100:00100000:0.0:1715209531.386492:0:11685:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 3785 00000100:00100000:0.0:1715209531.386497:0:11685:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d955180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:1bc50a3e-f07c-4b55-83c3-5f3c3d406528+12:2001:x1798523505171520:12345-192.168.201.23@tcp:400:kworker.0 00000100:00100000:0.0:1715209531.386547:0:11685:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d955180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:1bc50a3e-f07c-4b55-83c3-5f3c3d406528+12:2001:x1798523505171520:12345-192.168.201.23@tcp:400:kworker.0 Request processed in 49us (286us total) trans 0 rc 0/0 00000100:00100000:0.0:1715209531.386554:0:11685:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 3785 00010000:00010000:0.0:1715209532.316092:0:7113:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1715209532.367802:0:24905:0:(debug.c:705:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-hsm test 29b: Archive/delete/remove by FID from the archive. ========================================================== 19:05:31 (1715209531) 00000100:00100000:0.0:1715209532.474679:0:3676:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:2.0:1715209532.474788:0:7124:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798523505171712 00000100:00100000:2.0:1715209532.474806:0:7124:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798523505171712 00000100:00100000:0.0:1715209532.474952:0:9407:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 605 00000100:00100000:0.0:1715209532.474967:0:9407:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d944700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1bc50a3e-f07c-4b55-83c3-5f3c3d406528+41:5175:x1798523505171712:12345-192.168.201.23@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1715209532.474998:0:9407:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1715209532.476252:0:9407:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a8fdf180/0xfa8b5bed87892c7c lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7561918bd55708ca expref: -99 pid: 9407 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715209532.476359:0:9407:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a8fdf600/0xfa8b5bed87892c83 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9407 initiator: MDT0 00010000:00010000:0.0:1715209532.476376:0:9407:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a8fdf600/0xfa8b5bed87892c83 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9407 initiator: MDT0 00010000:00010000:0.0:1715209532.476390:0:9407:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a8fdf600/0xfa8b5bed87892c83 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9407 initiator: MDT0 00010000:00010000:0.0:1715209532.476406:0:9407:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a8fdfcc0/0xfa8b5bed87892c8a lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x646966 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9407 initiator: MDT0 00010000:00010000:0.0:1715209532.476414:0:9407:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a8fdfcc0/0xfa8b5bed87892c8a lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x646966 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9407 initiator: MDT0 00010000:00010000:0.0:1715209532.476420:0:9407:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a8fdfcc0/0xfa8b5bed87892c8a lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x646966 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9407 initiator: MDT0 00000004:00200000:0.0:1715209532.476515:0:9407:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 4096 00010000:00010000:0.0:1715209532.476614:0:9407:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a8fdf600/0xfa8b5bed87892c83 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9407 initiator: MDT0 00010000:00010000:0.0:1715209532.476630:0:9407:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a8fdf600/0xfa8b5bed87892c83 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9407 initiator: MDT0 00010000:00010000:0.0:1715209532.476637:0:9407:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a8fdf600/0xfa8b5bed87892c83 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9407 initiator: MDT0 00010000:00010000:0.0:1715209532.476643:0:9407:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800a8fdf600 already unused, calling callback (ffffffffa0eef730) 00010000:00010000:0.0:1715209532.476648:0:9407:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a8fdf600/0xfa8b5bed87892c83 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9407 initiator: MDT0 00010000:00010000:0.0:1715209532.476656:0:9407:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a8fdf600/0xfa8b5bed87892c83 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9407 initiator: MDT0 00010000:00010000:0.0:1715209532.476672:0:9407:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff8801303a6000) 00010000:00010000:0.0:1715209532.476676:0:9407:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1715209532.476681:0:9407:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a8fdf600/0xfa8b5bed87892c83 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9407 initiator: MDT0 00010000:00010000:0.0:1715209532.476687:0:9407:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a8fdf600/0xfa8b5bed87892c83 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9407 initiator: MDT0 00010000:00010000:0.0:1715209532.476727:0:9407:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a8fdfcc0/0xfa8b5bed87892c8a lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x646966 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9407 initiator: MDT0 00010000:00010000:0.0:1715209532.476737:0:9407:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a8fdfcc0/0xfa8b5bed87892c8a lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x646966 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9407 initiator: MDT0 00010000:00010000:0.0:1715209532.476746:0:9407:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a8fdfcc0/0xfa8b5bed87892c8a lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x646966 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9407 initiator: MDT0 00010000:00010000:0.0:1715209532.476756:0:9407:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800a8fdfcc0 already unused, calling callback (ffffffffa0eef730) 00010000:00010000:0.0:1715209532.476760:0:9407:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a8fdfcc0/0xfa8b5bed87892c8a lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x646966 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9407 initiator: MDT0 00010000:00010000:0.0:1715209532.476785:0:9407:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a8fdfcc0/0xfa8b5bed87892c8a lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x646966 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9407 initiator: MDT0 00010000:00010000:0.0:1715209532.476800:0:9407:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x646966 (ffff8800a0361400) 00010000:00010000:0.0:1715209532.476804:0:9407:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1715209532.476809:0:9407:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a8fdfcc0/0xfa8b5bed87892c8a lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x646966 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9407 initiator: MDT0 00010000:00010000:0.0:1715209532.476819:0:9407:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a8fdfcc0/0xfa8b5bed87892c8a lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x646966 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9407 initiator: MDT0 00010000:00010000:0.0:1715209532.476936:0:9407:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a8fdf180/0xfa8b5bed87892c7c lrc: 1/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.23@tcp remote: 0x7561918bd55708ca expref: 43 pid: 9407 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715209532.476947:0:9407:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a8fdf180/0xfa8b5bed87892c7c lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.23@tcp remote: 0x7561918bd55708ca expref: 43 pid: 9407 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715209532.476963:0:9407:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a8fdf180, rc 0) 00000100:00100000:0.0:1715209532.477057:0:9407:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d944700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1bc50a3e-f07c-4b55-83c3-5f3c3d406528+42:5175:x1798523505171712:12345-192.168.201.23@tcp:101:lhsmtool_posix.0 Request processed in 2090us (2387us total) trans 4294967504 rc 301/301 00000100:00100000:0.0:1715209532.477072:0:9407:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 605 00000100:00100000:1.0:1715209532.479010:0:3677:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:0.0:1715209532.479102:0:9407:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798523505171776 00000100:00100000:0.0:1715209532.479111:0:9407:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798523505171776 00000100:00100000:0.0:1715209532.479161:0:9407:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 606 00000100:00100000:0.0:1715209532.479172:0:9407:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801247db800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1bc50a3e-f07c-4b55-83c3-5f3c3d406528+42:5175:x1798523505171776:12345-192.168.201.23@tcp:59:lhsmtool_posix.0 00000100:00100000:0.0:1715209532.479277:0:9407:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8801247db800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1bc50a3e-f07c-4b55-83c3-5f3c3d406528+42:5175:x1798523505171776:12345-192.168.201.23@tcp:59:lhsmtool_posix.0 Request processed in 102us (267us total) trans 0 rc 0/0 00000100:00100000:0.0:1715209532.479291:0:9407:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 606 00000100:00100000:1.0:1715209532.481119:0:3678:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:0.0:1715209532.481182:0:9407:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798523505171840 00000100:00100000:0.0:1715209532.481190:0:9407:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798523505171840 00000100:00100000:0.0:1715209532.481231:0:9407:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 607 00000100:00100000:0.0:1715209532.481238:0:9407:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801247dad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1bc50a3e-f07c-4b55-83c3-5f3c3d406528+24:5175:x1798523505171840:12345-192.168.201.23@tcp:59:lhsmtool_posix.0 00000100:00100000:0.0:1715209532.481308:0:9407:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8801247dad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1bc50a3e-f07c-4b55-83c3-5f3c3d406528+24:5175:x1798523505171840:12345-192.168.201.23@tcp:59:lhsmtool_posix.0 Request processed in 69us (195us total) trans 0 rc 0/0 00000100:00100000:0.0:1715209532.481317:0:9407:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 607 00000100:00100000:2.0:1715209532.499356:0:3676:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:2.0:1715209532.499409:0:3676:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:0.0:1715209532.499425:0:9407:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798523505172096 00000100:00100000:0.0:1715209532.499435:0:9407:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798523505172096 00000100:00100000:0.0:1715209532.499474:0:9407:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798523505172224 00000100:00100000:0.0:1715209532.499477:0:9407:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798523505172224 00000100:00100000:0.0:1715209532.499497:0:9407:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 608 00000100:00100000:0.0:1715209532.499505:0:9407:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cd9c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1bc50a3e-f07c-4b55-83c3-5f3c3d406528+25:2001:x1798523505172096:12345-192.168.201.23@tcp:41:mkdir.0 00000100:00100000:3.0:1715209532.499539:0:7124:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 609 00000004:00000024:0.0:1715209532.499541:0:9407:0:(mdt_handler.c:569:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446273024 avail 1316810752 00000100:00100000:3.0:1715209532.499550:0:7124:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cd9e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1bc50a3e-f07c-4b55-83c3-5f3c3d406528+25:5180:x1798523505172224:12345-192.168.201.23@tcp:36:mkdir.0 00000100:00100000:0.0:1715209532.499593:0:9407:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cd9c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1bc50a3e-f07c-4b55-83c3-5f3c3d406528+25:2001:x1798523505172096:12345-192.168.201.23@tcp:41:mkdir.0 Request processed in 88us (242us total) trans 0 rc 0/0 00000100:00100000:0.0:1715209532.499603:0:9407:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 608 00000100:00100000:3.0:1715209532.499658:0:7124:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88009dfb9180 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:7124:1798523511042880:0@lo:1000:mdt00_002.0 00000100:00100000:3.0:1715209532.499718:0:7124:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1715209532.499759:0:7124:0:(client.c:2542:ptlrpc_set_wait()) set ffff88009ee8ac00 going to sleep for 11 seconds 00000100:00100000:1.0:1715209532.499782:0:7128:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798523511042880 00000100:00100000:1.0:1715209532.499791:0:7128:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798523511042880 00000100:00100000:1.0:1715209532.499858:0:7128:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3202 00000100:00100000:1.0:1715209532.499866:0:7128:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009dfbad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:7124:x1798523511042880:12345-0@lo:1000:mdt00_002.0 00000100:00100000:1.0:1715209532.500015:0:7128:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009dfbad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:7124:x1798523511042880:12345-0@lo:1000:mdt00_002.0 Request processed in 148us (294us total) trans 0 rc 0/0 00000100:00100000:1.0:1715209532.500024:0:7128:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3202 00000100:00100000:3.0:1715209532.500064:0:7124:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88009dfb9180 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:7124:1798523511042880:0@lo:1000:mdt00_002.0 00000100:00100000:3.0:1715209532.500125:0:7124:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88009dfb9180 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:7124:1798523511042944:0@lo:1000:mdt00_002.0 00000100:00100000:3.0:1715209532.500159:0:7124:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1715209532.500196:0:7124:0:(client.c:2542:ptlrpc_set_wait()) set ffff88009ee8ac00 going to sleep for 11 seconds 00000100:00100000:1.0:1715209532.500213:0:7128:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798523511042944 00000100:00100000:1.0:1715209532.500218:0:7128:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798523511042944 00000100:00100000:1.0:1715209532.500260:0:7128:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3203 00000100:00100000:1.0:1715209532.500266:0:7128:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009dfb9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:7124:x1798523511042944:12345-0@lo:1000:mdt00_002.0 00000100:00100000:1.0:1715209532.500346:0:7128:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009dfb9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:7124:x1798523511042944:12345-0@lo:1000:mdt00_002.0 Request processed in 79us (187us total) trans 0 rc -2/-2 00000100:00100000:1.0:1715209532.500353:0:7128:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3203 00000100:00100000:3.0:1715209532.500412:0:7124:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88009dfb9180 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:7124:1798523511042944:0@lo:1000:mdt00_002.0 00010000:00010000:3.0:1715209532.500469:0:7124:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff88012f8f4240/0xfa8b5bed87892c98 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 7124 initiator: MDT0 00010000:00010000:3.0:1715209532.500485:0:7124:0:(ldlm_request.c:1038:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff88012f8f4240/0xfa8b5bed87892c98 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 7124 initiator: MDT1 00010000:00010000:3.0:1715209532.500501:0:7124:0:(ldlm_request.c:1125:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff88012f8f4240/0xfa8b5bed87892c98 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x1000000000000 pid: 7124 initiator: MDT1 00000100:00100000:3.0:1715209532.500521:0:7124:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88009dfb9180 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:7124:1798523511043008:0@lo:101:mdt00_002.0 00000100:00100000:3.0:1715209532.500569:0:7124:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1715209532.500597:0:7124:0:(client.c:2542:ptlrpc_set_wait()) set ffff88009ee8ad80 going to sleep for 11 seconds 00000100:00100000:1.0:1715209532.500619:0:7128:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798523511043008 00000100:00100000:1.0:1715209532.500624:0:7128:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798523511043008 00000100:00100000:1.0:1715209532.500650:0:7128:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3204 00000100:00100000:1.0:1715209532.500655:0:7128:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009dfba300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:7124:x1798523511043008:12345-0@lo:101:mdt00_002.0 00010000:00010000:1.0:1715209532.500665:0:7128:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1715209532.500682:0:7128:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012d523a80/0xfa8b5bed87892c9f lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfa8b5bed87892c98 expref: -99 pid: 7128 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715209532.500707:0:7128:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88006ee71f80/0xfa8b5bed87892c0c lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.23@tcp remote: 0x7561918bd557088b expref: 41 pid: 9407 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715209532.500719:0:7128:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012d523a80/0xfa8b5bed87892c9f lrc: 4/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xfa8b5bed87892c98 expref: 7 pid: 7128 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715209532.500747:0:7128:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88006ee71f80/0xfa8b5bed87892c0c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.23@tcp remote: 0x7561918bd557088b expref: 41 pid: 9407 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715209532.500761:0:7128:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88006ee71f80/0xfa8b5bed87892c0c lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.23@tcp remote: 0x7561918bd557088b expref: 41 pid: 9407 timeout: 3984 lvb_type: 0 00000100:00100000:1.0:1715209532.500774:0:7128:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8801247d9880 pname:cluuid:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000_UUID:7128:1798523511043072:192.168.201.23@tcp:104: 00000100:00100000:1.0:1715209532.500845:0:7128:0:(client.c:2542:ptlrpc_set_wait()) set ffff88009ddf9f00 going to sleep for 11 seconds 00000100:00100000:1.0:1715209532.502189:0:7128:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff8801247d9880 pname:cluuid:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000_UUID:7128:1798523511043072:192.168.201.23@tcp:104: 00010000:00010000:1.0:1715209532.502222:0:7128:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012d523a80/0xfa8b5bed87892c9f lrc: 3/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xfa8b5bed87892c98 expref: 7 pid: 7128 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715209532.502233:0:7128:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88012e8ee500) 00010000:00010000:1.0:1715209532.502237:0:7128:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1715209532.502241:0:7128:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff88012d523a80/0xfa8b5bed87892c9f lrc: 3/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xfa8b5bed87892c98 expref: 7 pid: 7128 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715209532.502250:0:7128:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012d523a80, rc 0) 00000100:00100000:1.0:1715209532.502305:0:7128:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009dfba300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+7:7124:x1798523511043008:12345-0@lo:101:mdt00_002.0 Request processed in 1648us (1735us total) trans 0 rc 0/0 00000100:00100000:1.0:1715209532.502313:0:7128:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3204 00000100:00100000:3.0:1715209532.502405:0:7124:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88009dfb9180 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:7124:1798523511043008:0@lo:101:mdt00_002.0 00010000:00010000:3.0:1715209532.502425:0:7124:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff88012f8f4240/0xfa8b5bed87892c98 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xfa8b5bed87892c9f expref: -99 pid: 7124 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715209532.502438:0:7124:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: lustre-MDT0000-osp-MDT0001 lock: ffff88012f8f4240/0xfa8b5bed87892c98 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xfa8b5bed87892c9f expref: -99 pid: 7124 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1715209532.502509:0:3678:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:2.0:1715209532.502632:0:7110:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798523505172288 00000100:00100000:2.0:1715209532.502641:0:7110:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798523505172288 00010000:00010000:2.0:1715209532.502670:0:7110:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88006ee71f80/0xfa8b5bed87892c0c lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.23@tcp remote: 0x7561918bd557088b expref: 42 pid: 9407 timeout: 3984 lvb_type: 0 00000100:00100000:2.0:1715209532.502714:0:7110:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 135 00000100:00100000:2.0:1715209532.502721:0:7110:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d944a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1bc50a3e-f07c-4b55-83c3-5f3c3d406528+42:2002:x1798523505172288:12345-192.168.201.23@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1715209532.502734:0:7110:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1715209532.502740:0:7110:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88006ee71f80/0xfa8b5bed87892c0c lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.23@tcp remote: 0x7561918bd557088b expref: 42 pid: 9407 timeout: 3984 lvb_type: 0 00010000:00010000:2.0:1715209532.502762:0:7110:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88006ee71f80/0xfa8b5bed87892c0c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.23@tcp remote: 0x7561918bd557088b expref: 42 pid: 9407 timeout: 3984 lvb_type: 0 00010000:00010000:2.0:1715209532.502780:0:7110:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88006ee71f80/0xfa8b5bed87892c0c lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.23@tcp remote: 0x7561918bd557088b expref: 42 pid: 9407 timeout: 3984 lvb_type: 0 00010000:00010000:2.0:1715209532.502809:0:7110:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88012e8ee500) 00010000:00010000:2.0:1715209532.502816:0:7110:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff88012d523a80/0xfa8b5bed87892c9f lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xfa8b5bed87892c98 expref: 6 pid: 7128 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715209532.502849:0:7110:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012d523a80/0xfa8b5bed87892c9f lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40080000000000 nid: 0@lo remote: 0xfa8b5bed87892c98 expref: 6 pid: 7128 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715209532.502859:0:7110:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012d523a80/0xfa8b5bed87892c9f lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40080000000000 nid: 0@lo remote: 0xfa8b5bed87892c98 expref: 6 pid: 7128 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715209532.502918:0:7110:0:(ldlm_lockd.c:1135:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff88012d523a80/0xfa8b5bed87892c9f lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xfa8b5bed87892c98 expref: 6 pid: 7128 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1715209532.502930:0:7110:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88012cd9f100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-MDT0000_UUID:7110:1798523511043136:0@lo:105: 00000100:00100000:2.0:1715209532.502968:0:7110:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1715209532.502996:0:7110:0:(client.c:2542:ptlrpc_set_wait()) set ffff88013013b240 going to sleep for 11 seconds 00000100:00100000:1.0:1715209532.503084:0:8262:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798523511043136 00000100:00100000:1.0:1715209532.503092:0:8262:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798523511043136 00000100:00100000:1.0:1715209532.503150:0:8262:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00080000:2.0:1715209532.503155:0:7120:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000-osp-MDT0001 older than 1715209502 00000100:00100000:1.0:1715209532.503158:0:8262:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cd9ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:lustre-MDT0001-mdtlov_UUID+4:7110:x1798523511043136:12345-0@lo:105: 00010000:00010000:1.0:1715209532.503171:0:8262:0:(ldlm_lockd.c:2548:ldlm_callback_handler()) ### completion ast ns: lustre-MDT0000-osp-MDT0001 lock: ffff88012f8f4240/0xfa8b5bed87892c98 lrc: 5/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xfa8b5bed87892c9f expref: -99 pid: 7124 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715209532.503183:0:8262:0:(ldlm_lockd.c:2006:ldlm_handle_cp_callback()) ### client completion callback handler START ns: lustre-MDT0000-osp-MDT0001 lock: ffff88012f8f4240/0xfa8b5bed87892c98 lrc: 5/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xfa8b5bed87892c9f expref: -99 pid: 7124 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715209532.503193:0:8262:0:(ldlm_lockd.c:2083:ldlm_handle_cp_callback()) ### completion AST, new policy data ns: lustre-MDT0000-osp-MDT0001 lock: ffff88012f8f4240/0xfa8b5bed87892c98 lrc: 5/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xfa8b5bed87892c9f expref: -99 pid: 7124 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715209532.503201:0:8262:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: lustre-MDT0000-osp-MDT0001 lock: ffff88012f8f4240/0xfa8b5bed87892c98 lrc: 5/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0xfa8b5bed87892c9f expref: -99 pid: 7124 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715209532.503208:0:8262:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff88012f8f4240/0xfa8b5bed87892c98 lrc: 6/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0xfa8b5bed87892c9f expref: -99 pid: 7124 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715209532.503227:0:8262:0:(ldlm_lockd.c:2111:ldlm_handle_cp_callback()) ### callback handler finished, about to run_ast_work ns: lustre-MDT0000-osp-MDT0001 lock: ffff88012f8f4240/0xfa8b5bed87892c98 lrc: 6/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1080000000000 nid: local remote: 0xfa8b5bed87892c9f expref: -99 pid: 7124 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715209532.503251:0:8262:0:(ldlm_lockd.c:2122:ldlm_handle_cp_callback()) ### client completion callback handler END (lock ffff88012f8f4240) 00000100:00100000:1.0:1715209532.503300:0:8262:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cd9ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:lustre-MDT0001-mdtlov_UUID+4:7110:x1798523511043136:12345-0@lo:105: Request processed in 142us (330us total) trans 0 rc 0/0 00000100:00100000:1.0:1715209532.503308:0:8262:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:2.0:1715209532.503332:0:7110:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88012cd9f100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-MDT0000_UUID:7110:1798523511043136:0@lo:105: 00010000:00010000:3.0:1715209532.503348:0:7124:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: lustre-MDT0000-osp-MDT0001 lock: ffff88012f8f4240/0xfa8b5bed87892c98 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xfa8b5bed87892c9f expref: -99 pid: 7124 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715209532.503351:0:7110:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1715209532.503363:0:7124:0:(ldlm_request.c:808:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff88012f8f4240/0xfa8b5bed87892c98 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xfa8b5bed87892c9f expref: -99 pid: 7124 timeout: 0 lvb_type: 0 00000004:00080000:3.0:1715209532.503386:0:7124:0:(osp_object.c:1397:osp_invalidate()) Invalidate osp_object [0x200000007:0x1:0x0] 00000100:00100000:2.0:1715209532.503395:0:7110:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d944a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1bc50a3e-f07c-4b55-83c3-5f3c3d406528+41:2002:x1798523505172288:12345-192.168.201.23@tcp:103:ldlm_bl.0 Request processed in 672us (888us total) trans 0 rc 0/0 00010000:00010000:3.0:1715209532.503413:0:7124:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff88012f8f4480/0xfa8b5bed87892ca6 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x8356b9f6 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 7124 initiator: MDT0 00000100:00100000:2.0:1715209532.503416:0:7110:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 135 00010000:00010000:3.0:1715209532.503420:0:7124:0:(ldlm_request.c:1038:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff88012f8f4480/0xfa8b5bed87892ca6 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x8356b9f6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 7124 initiator: MDT1 00010000:00010000:3.0:1715209532.503429:0:7124:0:(ldlm_request.c:1125:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff88012f8f4480/0xfa8b5bed87892ca6 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x8356b9f6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 7124 initiator: MDT1 00000100:00100000:3.0:1715209532.503446:0:7124:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88009dfb9180 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:7124:1798523511043200:0@lo:101:mdt00_002.0 00000100:00100000:3.0:1715209532.503489:0:7124:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1715209532.503529:0:7124:0:(client.c:2542:ptlrpc_set_wait()) set ffff88009ee8ad80 going to sleep for 11 seconds 00000100:00100000:1.0:1715209532.503548:0:7128:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798523511043200 00000100:00100000:1.0:1715209532.503553:0:7128:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798523511043200 00000100:00100000:1.0:1715209532.503582:0:7128:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3205 00000100:00100000:1.0:1715209532.503587:0:7128:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009dfb9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+7:7124:x1798523511043200:12345-0@lo:101:mdt00_002.0 00010000:00010000:1.0:1715209532.503599:0:7128:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1715209532.503613:0:7128:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012d521d40/0xfa8b5bed87892cad lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x8356b9f6 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfa8b5bed87892ca6 expref: -99 pid: 7128 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715209532.503631:0:7128:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012d521d40/0xfa8b5bed87892cad lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x8356b9f6 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xfa8b5bed87892ca6 expref: 8 pid: 7128 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715209532.503643:0:7128:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012d521d40/0xfa8b5bed87892cad lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x8356b9f6 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xfa8b5bed87892ca6 expref: 8 pid: 7128 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715209532.503651:0:7128:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x8356b9f6 (ffff8800a5700000) 00010000:00010000:1.0:1715209532.503654:0:7128:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1715209532.503657:0:7128:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012d521d40, rc 0) 00000100:00100000:1.0:1715209532.503696:0:7128:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009dfb9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+8:7124:x1798523511043200:12345-0@lo:101:mdt00_002.0 Request processed in 107us (207us total) trans 0 rc 0/0 00000100:00100000:1.0:1715209532.503703:0:7128:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3205 00000100:00100000:3.0:1715209532.503764:0:7124:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88009dfb9180 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:7124:1798523511043200:0@lo:101:mdt00_002.0 00010000:00010000:3.0:1715209532.503782:0:7124:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff88012f8f4480/0xfa8b5bed87892ca6 lrc: 4/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x8356b9f6 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xfa8b5bed87892cad expref: -99 pid: 7124 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715209532.503810:0:7124:0:(ldlm_request.c:808:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff88012f8f4480/0xfa8b5bed87892ca6 lrc: 4/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x8356b9f6 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xfa8b5bed87892cad expref: -99 pid: 7124 timeout: 0 lvb_type: 0 00000004:00080000:3.0:1715209532.503860:0:7124:0:(osp_object.c:1397:osp_invalidate()) Invalidate osp_object [0x200000007:0x1:0x0] 00000100:00100000:3.0:1715209532.503929:0:7124:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88009dfb9180 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:7124:1798523511043264:0@lo:1000:mdt00_002.0 00000100:00100000:3.0:1715209532.503960:0:7124:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1715209532.503985:0:7124:0:(client.c:2542:ptlrpc_set_wait()) set ffff88009ee8ac00 going to sleep for 11 seconds 00000100:00100000:1.0:1715209532.504008:0:7128:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798523511043264 00000100:00100000:1.0:1715209532.504013:0:7128:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798523511043264 00000100:00100000:1.0:1715209532.504040:0:7128:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3206 00000100:00100000:1.0:1715209532.504045:0:7128:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009dfbb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+8:7124:x1798523511043264:12345-0@lo:1000:mdt00_002.0 00000100:00100000:1.0:1715209532.504109:0:7128:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009dfbb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+8:7124:x1798523511043264:12345-0@lo:1000:mdt00_002.0 Request processed in 63us (148us total) trans 0 rc 0/0 00000100:00100000:1.0:1715209532.504116:0:7128:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3206 00000100:00100000:3.0:1715209532.504146:0:7124:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88009dfb9180 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:7124:1798523511043264:0@lo:1000:mdt00_002.0 00000100:00100000:3.0:1715209532.504182:0:7124:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88009dfb9180 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:7124:1798523511043328:0@lo:1000:mdt00_002.0 00000100:00100000:3.0:1715209532.504205:0:7124:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1715209532.504216:0:7124:0:(client.c:2542:ptlrpc_set_wait()) set ffff88009ee8ac00 going to sleep for 11 seconds 00000100:00100000:1.0:1715209532.504221:0:7128:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798523511043328 00000100:00100000:1.0:1715209532.504224:0:7128:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798523511043328 00000100:00100000:1.0:1715209532.504245:0:7128:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3207 00000100:00100000:1.0:1715209532.504249:0:7128:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009dfbb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+8:7124:x1798523511043328:12345-0@lo:1000:mdt00_002.0 00000100:00100000:1.0:1715209532.504302:0:7128:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009dfbb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+8:7124:x1798523511043328:12345-0@lo:1000:mdt00_002.0 Request processed in 51us (96us total) trans 0 rc -2/-2 00000100:00100000:1.0:1715209532.504308:0:7128:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3207 00000100:00100000:3.0:1715209532.504315:0:7124:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88009dfb9180 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:7124:1798523511043328:0@lo:1000:mdt00_002.0 00000100:00100000:3.0:1715209532.504381:0:7124:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88009dfb9180 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:7124:1798523511043392:0@lo:1000:mdt00_002.0 00000100:00100000:3.0:1715209532.504400:0:7124:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1715209532.504411:0:7124:0:(client.c:2542:ptlrpc_set_wait()) set ffff88009ee8ac00 going to sleep for 11 seconds 00000100:00100000:1.0:1715209532.504415:0:7128:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798523511043392 00000100:00100000:1.0:1715209532.504418:0:7128:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798523511043392 00000100:00100000:1.0:1715209532.504441:0:7128:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3208 00000100:00100000:1.0:1715209532.504445:0:7128:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009dfba680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+8:7124:x1798523511043392:12345-0@lo:1000:mdt00_002.0 00000100:00100000:1.0:1715209532.504489:0:7128:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009dfba680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+8:7124:x1798523511043392:12345-0@lo:1000:mdt00_002.0 Request processed in 42us (87us total) trans 0 rc -2/-2 00000100:00100000:1.0:1715209532.504495:0:7128:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3208 00000100:00100000:3.0:1715209532.504501:0:7124:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88009dfb9180 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:7124:1798523511043392:0@lo:1000:mdt00_002.0 00000100:00100000:3.0:1715209532.504543:0:7124:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88009dfb9180 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:7124:1798523511043456:0@lo:1000:mdt00_002.0 00000100:00100000:3.0:1715209532.504561:0:7124:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1715209532.504571:0:7124:0:(client.c:2542:ptlrpc_set_wait()) set ffff88009ee8ac00 going to sleep for 11 seconds 00000100:00100000:1.0:1715209532.504576:0:7128:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798523511043456 00000100:00100000:1.0:1715209532.504579:0:7128:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798523511043456 00000100:00100000:1.0:1715209532.504600:0:7128:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3209 00000100:00100000:1.0:1715209532.504605:0:7128:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009dfb9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+8:7124:x1798523511043456:12345-0@lo:1000:mdt00_002.0 00000100:00100000:1.0:1715209532.504647:0:7128:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009dfb9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+8:7124:x1798523511043456:12345-0@lo:1000:mdt00_002.0 Request processed in 41us (84us total) trans 0 rc 0/0 00000100:00100000:3.0:1715209532.504658:0:7124:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88009dfb9180 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:7124:1798523511043456:0@lo:1000:mdt00_002.0 00000100:00100000:1.0:1715209532.504665:0:7128:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3209 00000100:00100000:3.0:1715209532.504695:0:7124:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88009dfb9180 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:7124:1798523511043520:0@lo:1000:mdt00_002.0 00000100:00100000:3.0:1715209532.504714:0:7124:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1715209532.504724:0:7124:0:(client.c:2542:ptlrpc_set_wait()) set ffff88009ee8ac00 going to sleep for 11 seconds 00000100:00100000:1.0:1715209532.504729:0:7128:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798523511043520 00000100:00100000:1.0:1715209532.504733:0:7128:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798523511043520 00000100:00100000:1.0:1715209532.504755:0:7128:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3210 00000100:00100000:1.0:1715209532.504760:0:7128:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f5dd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+8:7124:x1798523511043520:12345-0@lo:1000:mdt00_002.0 00000100:00100000:1.0:1715209532.504805:0:7128:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f5dd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+8:7124:x1798523511043520:12345-0@lo:1000:mdt00_002.0 Request processed in 44us (90us total) trans 0 rc 0/0 00000100:00100000:1.0:1715209532.504810:0:7128:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3210 00000100:00100000:3.0:1715209532.504820:0:7124:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88009dfb9180 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:7124:1798523511043520:0@lo:1000:mdt00_002.0 00000040:00080000:3.0:1715209532.505748:0:7124:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x240000400:0x2:0x0].11, 992 off43640 00000040:00080000:3.0:1715209532.505820:0:7124:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x200000401:0x2:0x0].11, 1144 off45312 00000004:00080000:3.0:1715209532.505857:0:7124:0:(osp_trans.c:1606:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff88009ee8ad80 with version 24 00000004:00080000:0.0:1715209532.505998:0:8266:0:(osp_trans.c:1351:osp_get_next_request()) ou ffff88006fdd4480 version 24 rpc_version 24 00000020:00100000:0.0:1715209532.506032:0:8266:0:(genops.c:2297:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:0.0:1715209532.506041:0:8266:0:(client.c:765:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff88009d946300 x1798523511043648/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 2168/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 00000100:00100000:0.0:1715209532.506062:0:8266:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88009d946300 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:8266:1798523511043648:0@lo:1000:osp_up0-1.0 00000100:00100000:0.0:1715209532.506103:0:8266:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1715209532.506135:0:8266:0:(client.c:2542:ptlrpc_set_wait()) set ffff88009df2e900 going to sleep for 11 seconds 00000100:00100000:1.0:1715209532.506224:0:7128:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798523511043648 00000100:00100000:1.0:1715209532.506233:0:7128:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798523511043648 00000100:00100000:1.0:1715209532.506276:0:7128:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3211 00000100:00100000:1.0:1715209532.506283:0:7128:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d947800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+8:8266:x1798523511043648:12345-0@lo:1000:osp_up0-1.0 00000100:00100000:1.0:1715209532.507051:0:7128:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d947800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+9:8266:x1798523511043648:12345-0@lo:1000:osp_up0-1.0 Request processed in 760us (939us total) trans 4294967505 rc 0/0 00000100:00100000:1.0:1715209532.507071:0:7128:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3211 00000100:00100000:0.0:1715209532.507113:0:8266:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88009d946300 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:8266:1798523511043648:0@lo:1000:osp_up0-1.0 00010000:00010000:3.0:1715209532.507321:0:7124:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff88012f8f46c0/0xfa8b5bed87892cb4 lrc: 3/0,1 mode: --/PW res: [0x240000403:0x13:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7124 initiator: MDT0 00010000:00010000:3.0:1715209532.507342:0:7124:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88012f8f46c0/0xfa8b5bed87892cb4 lrc: 3/0,1 mode: PW/PW res: [0x240000403:0x13:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7124 initiator: MDT1 00010000:00010000:3.0:1715209532.507355:0:7124:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88012f8f46c0/0xfa8b5bed87892cb4 lrc: 3/0,1 mode: PW/PW res: [0x240000403:0x13:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7124 initiator: MDT1 00000004:00010000:3.0:1715209532.507373:0:7124:0:(mdt_handler.c:4256:mdt_save_lock()) ### save lock request ffff88012cd9e680 reply state ffff88009dc0e000 transno 4294967354 ns: mdt-lustre-MDT0001_UUID lock: ffff88012f8f46c0/0xfa8b5bed87892cb4 lrc: 3/0,1 mode: PW/PW res: [0x240000403:0x13:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7124 initiator: MDT1 00010000:00010000:3.0:1715209532.507383:0:7124:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88012f8f46c0/0xfa8b5bed87892cb4 lrc: 3/0,1 mode: TXN/TXN res: [0x240000403:0x13:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7124 initiator: MDT1 00010000:00010000:3.0:1715209532.507391:0:7124:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x13:0x0].0x0 (ffff88012fea4300) 00010000:00010000:3.0:1715209532.507395:0:7124:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1715209532.507398:0:7124:0:(service.c:188:ptlrpc_save_lock()) nlocks 0 00000004:00200000:3.0:1715209532.507403:0:7124:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x240000403:0x13:0x0]: returning size 4096 00000004:00080000:3.0:1715209532.507411:0:7124:0:(osp_object.c:1397:osp_invalidate()) Invalidate osp_object [0x200000007:0x1:0x0] 00010000:00010000:3.0:1715209532.507420:0:7124:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff88012f8f4240/0xfa8b5bed87892c98 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xfa8b5bed87892c9f expref: -99 pid: 7124 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715209532.507429:0:7124:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff88012f8f4240/0xfa8b5bed87892c98 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xfa8b5bed87892c9f expref: -99 pid: 7124 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715209532.507437:0:7124:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff88012f8f4240/0xfa8b5bed87892c98 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xfa8b5bed87892c9f expref: -99 pid: 7124 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715209532.507486:0:7124:0:(ldlm_lockd.c:2227:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00080000:3.0:1715209532.507492:0:7124:0:(osp_object.c:1397:osp_invalidate()) Invalidate osp_object [0x200000007:0x1:0x0] 00010000:00010000:3.0:1715209532.507497:0:7124:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff88012f8f4480/0xfa8b5bed87892ca6 lrc: 4/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x8356b9f6 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xfa8b5bed87892cad expref: -99 pid: 7124 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715209532.507505:0:7124:0:(ldlm_lock.c:936:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-osp-MDT0001 lock: ffff88012f8f4480/0xfa8b5bed87892ca6 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x8356b9f6 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xfa8b5bed87892cad expref: -99 pid: 7124 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715209532.507585:0:14811:0:(ldlm_lockd.c:2857:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1715209532.507598:0:14811:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff88012f8f4240/0xfa8b5bed87892c98 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0xfa8b5bed87892c9f expref: -99 pid: 7124 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1715209532.507600:0:7124:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cd9e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1bc50a3e-f07c-4b55-83c3-5f3c3d406528+26:5180:x1798523505172224:12345-192.168.201.23@tcp:36:mkdir.0 Request processed in 8047us (8187us total) trans 4294967354 rc 0/0 00000100:00100000:3.0:1715209532.507609:0:7124:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 609 00010000:00010000:2.0:1715209532.507609:0:14811:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88012f8f4240 already unused, calling callback (ffffffffa0ef0520) 00010000:00010000:2.0:1715209532.507615:0:14811:0:(ldlm_request.c:1300:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff88012f8f4240/0xfa8b5bed87892c98 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0xfa8b5bed87892c9f expref: -99 pid: 7124 timeout: 0 lvb_type: 0 00000004:00010000:2.0:1715209532.507625:0:14811:0:(mdt_handler.c:3748:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff88012f8f4240/0xfa8b5bed87892c98 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0xfa8b5bed87892c9f expref: -99 pid: 7124 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715209532.507656:0:14811:0:(ldlm_request.c:1347:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff88012f8f4240/0xfa8b5bed87892c98 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xfa8b5bed87892c9f expref: -99 pid: 7124 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715209532.507663:0:14811:0:(ldlm_request.c:1389:_ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1715209532.507706:0:14811:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff88012f8f4240/0xfa8b5bed87892c98 lrc: 1/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xfa8b5bed87892c9f expref: -99 pid: 7124 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1715209532.507708:0:3686:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88012cd9f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3686:1798523511043712:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1715209532.507714:0:14811:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff88012f8f4240/0xfa8b5bed87892c98 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xfa8b5bed87892c9f expref: -99 pid: 7124 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715209532.507726:0:14811:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1715209532.507728:0:14811:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1715209532.507730:0:14811:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1715209532.507752:0:3686:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1715209532.507779:0:7110:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798523511043712 00000100:00100000:2.0:1715209532.507785:0:7110:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798523511043712 00000100:00100000:2.0:1715209532.507815:0:7110:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1715209532.507822:0:7110:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009dfb9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:lustre-MDT0001-mdtlov_UUID+9:3686:x1798523511043712:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1715209532.507871:0:7110:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1715209532.507918:0:7110:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012d523a80/0xfa8b5bed87892c9f lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0xfa8b5bed87892c98 expref: 9 pid: 7128 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715209532.507932:0:7110:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88012e8ee500) 00010000:00010000:2.0:1715209532.507936:0:7110:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1715209532.507990:0:7110:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009dfb9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:lustre-MDT0001-mdtlov_UUID+8:3686:x1798523511043712:12345-0@lo:103:ldlm_bl.0 Request processed in 166us (237us total) trans 0 rc 0/0 00000100:00100000:2.0:1715209532.507998:0:7110:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1715209532.508047:0:3686:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88012cd9f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3686:1798523511043712:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1715209532.512544:0:3678:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:3.0:1715209532.512677:0:7124:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798523505172352 00000100:00100000:3.0:1715209532.512688:0:7124:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798523505172352 00000100:00100000:3.0:1715209532.512746:0:7124:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 610 00000100:00100000:3.0:1715209532.512754:0:7124:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d81f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1bc50a3e-f07c-4b55-83c3-5f3c3d406528+41:5181:x1798523505172352:12345-192.168.201.23@tcp:101:rm.0 00010000:00010000:3.0:1715209532.512774:0:7124:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1715209532.512791:0:7124:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012f8f4900/0xfa8b5bed87892cbb lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7561918bd55708e6 expref: -99 pid: 7124 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715209532.512874:0:7124:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012f8f4b40/0xfa8b5bed87892cc2 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7124 initiator: MDT0 00010000:00010000:3.0:1715209532.512920:0:7124:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012f8f4b40/0xfa8b5bed87892cc2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7124 initiator: MDT0 00010000:00010000:3.0:1715209532.512940:0:7124:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012f8f4b40/0xfa8b5bed87892cc2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7124 initiator: MDT0 00000004:00200000:3.0:1715209532.512971:0:7124:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1715209532.512975:0:7124:0:(mdt_handler.c:1570:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1715209532.512989:0:7124:0:(mdt_handler.c:2451:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88012f8f4b40/0xfa8b5bed87892cc2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7124 initiator: MDT0 00010000:00010000:3.0:1715209532.513011:0:7124:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012f8f4900/0xfa8b5bed87892cbb lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.23@tcp remote: 0x7561918bd55708e6 expref: 43 pid: 7124 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715209532.513049:0:7124:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012f8f4b40/0xfa8b5bed87892cc2 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.23@tcp remote: 0x7561918bd55708e6 expref: 42 pid: 7124 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715209532.513058:0:7124:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88012e8ee500) 00010000:00010000:3.0:1715209532.513061:0:7124:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1715209532.513064:0:7124:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012f8f4b40, rc 0) 00000100:00100000:3.0:1715209532.513111:0:7124:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d81f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1bc50a3e-f07c-4b55-83c3-5f3c3d406528+42:5181:x1798523505172352:12345-192.168.201.23@tcp:101:rm.0 Request processed in 357us (571us total) trans 0 rc 0/0 00000100:00100000:3.0:1715209532.513120:0:7124:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 610 00000100:00100000:0.0:1715209532.514692:0:3676:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:3.0:1715209532.514822:0:7124:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798523505172416 00000100:00100000:3.0:1715209532.514857:0:7124:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798523505172416 00000100:00100000:3.0:1715209532.514933:0:7124:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 611 00000100:00100000:3.0:1715209532.514941:0:7124:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d81f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1bc50a3e-f07c-4b55-83c3-5f3c3d406528+42:5181:x1798523505172416:12345-192.168.201.23@tcp:101:rm.0 00010000:00010000:3.0:1715209532.514954:0:7124:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1715209532.514967:0:7124:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012f8f4d80/0xfa8b5bed87892cc9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7561918bd55708ed expref: -99 pid: 7124 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715209532.515008:0:7124:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012f8f4fc0/0xfa8b5bed87892cd0 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7124 initiator: MDT0 00010000:00010000:3.0:1715209532.515028:0:7124:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012f8f4fc0/0xfa8b5bed87892cd0 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7124 initiator: MDT0 00010000:00010000:3.0:1715209532.515038:0:7124:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012f8f4fc0/0xfa8b5bed87892cd0 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7124 initiator: MDT0 00010000:00010000:3.0:1715209532.515049:0:7124:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012f8f5200/0xfa8b5bed87892cd7 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x8356b9f6 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7124 initiator: MDT0 00010000:00010000:3.0:1715209532.515059:0:7124:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012d521d40/0xfa8b5bed87892cad lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x8356b9f6 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xfa8b5bed87892ca6 expref: 7 pid: 7128 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715209532.515067:0:7124:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012f8f5200/0xfa8b5bed87892cd7 lrc: 4/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x8356b9f6 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7124 initiator: MDT0 00010000:00010000:3.0:1715209532.515098:0:7124:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88012d521d40/0xfa8b5bed87892cad lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x8356b9f6 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 0@lo remote: 0xfa8b5bed87892ca6 expref: 7 pid: 7128 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1715209532.515113:0:7124:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88009d851180 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:7124:1798523511043776:0@lo:104: 00000100:00100000:3.0:1715209532.515148:0:7124:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1715209532.515182:0:7124:0:(client.c:2542:ptlrpc_set_wait()) set ffff88009ee8acc0 going to sleep for 11 seconds 00000100:00100000:1.0:1715209532.515268:0:8262:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798523511043776 00000100:00100000:1.0:1715209532.515277:0:8262:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798523511043776 00000100:00100000:1.0:1715209532.515325:0:8262:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:1.0:1715209532.515332:0:8262:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d850380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:lustre-MDT0001-mdtlov_UUID+4:7124:x1798523511043776:12345-0@lo:104: 00010000:00010000:1.0:1715209532.515346:0:8262:0:(ldlm_lockd.c:2536:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0000-osp-MDT0001 lock: ffff88012f8f4480/0xfa8b5bed87892ca6 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x8356b9f6 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1400000000000 nid: local remote: 0xfa8b5bed87892cad expref: -99 pid: 7124 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715209532.515417:0:8262:0:(ldlm_lockd.c:2227:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1715209532.515424:0:8262:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d850380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:lustre-MDT0001-mdtlov_UUID+4:7124:x1798523511043776:12345-0@lo:104: Request processed in 92us (275us total) trans 0 rc 0/0 00000100:00100000:1.0:1715209532.515432:0:8262:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:3.0:1715209532.515437:0:7124:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88009d851180 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:7124:1798523511043776:0@lo:104: 00010000:00010000:3.0:1715209532.515453:0:7124:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88012f8f5200/0xfa8b5bed87892cd7 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x8356b9f6 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7124 initiator: MDT0 00010000:00010000:2.0:1715209532.515517:0:9401:0:(ldlm_lockd.c:2857:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1715209532.515529:0:9401:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff88012f8f4480/0xfa8b5bed87892ca6 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x8356b9f6 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1400000000000 nid: local remote: 0xfa8b5bed87892cad expref: -99 pid: 7124 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715209532.515540:0:9401:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88012f8f4480 already unused, calling callback (ffffffffa0ef0520) 00010000:00010000:2.0:1715209532.515546:0:9401:0:(ldlm_request.c:1300:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff88012f8f4480/0xfa8b5bed87892ca6 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x8356b9f6 bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x1408400000000 nid: local remote: 0xfa8b5bed87892cad expref: -99 pid: 7124 timeout: 0 lvb_type: 0 00000004:00010000:2.0:1715209532.515555:0:9401:0:(mdt_handler.c:3748:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff88012f8f4480/0xfa8b5bed87892ca6 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x8356b9f6 bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x1409400000000 nid: local remote: 0xfa8b5bed87892cad expref: -99 pid: 7124 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715209532.515585:0:9401:0:(ldlm_request.c:1347:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff88012f8f4480/0xfa8b5bed87892ca6 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x8356b9f6 bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0xfa8b5bed87892cad expref: -99 pid: 7124 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715209532.515592:0:9401:0:(ldlm_request.c:1389:_ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1715209532.515634:0:9401:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff88012f8f4480/0xfa8b5bed87892ca6 lrc: 1/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x8356b9f6 bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0xfa8b5bed87892cad expref: -99 pid: 7124 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715209532.515642:0:9401:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff88012f8f4480/0xfa8b5bed87892ca6 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x8356b9f6 bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0xfa8b5bed87892cad expref: -99 pid: 7124 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1715209532.515660:0:3683:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88012cd9f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3683:1798523511043840:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1715209532.515680:0:9401:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1715209532.515682:0:9401:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1715209532.515685:0:9401:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1715209532.515702:0:3683:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1715209532.515731:0:7110:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798523511043840 00000100:00100000:2.0:1715209532.515737:0:7110:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798523511043840 00010000:00010000:2.0:1715209532.515756:0:7110:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012d521d40/0xfa8b5bed87892cad lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x8356b9f6 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000400000020 nid: 0@lo remote: 0xfa8b5bed87892ca6 expref: 8 pid: 7128 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1715209532.515788:0:7110:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:2.0:1715209532.515795:0:7110:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d81e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:lustre-MDT0001-mdtlov_UUID+8:3683:x1798523511043840:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1715209532.515805:0:7110:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000001:00080000:0.0:1715209532.517518:0:7105:0:(tgt_lastrcvd.c:969:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967505 is committed 00000001:00080000:0.0:1715209532.517527:0:7105:0:(tgt_lastrcvd.c:969:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967504 is committed 00010000:00010000:2.0:1715209532.517672:0:7110:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012d521d40/0xfa8b5bed87892cad lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x8356b9f6 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 0@lo remote: 0xfa8b5bed87892ca6 expref: 7 pid: 7128 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715209532.517687:0:7110:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x8356b9f6 (ffff8800a5700000) 00010000:00010000:2.0:1715209532.517692:0:7110:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff88012f8f5200/0xfa8b5bed87892cd7 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x8356b9f6 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7124 initiator: MDT0 00010000:00010000:2.0:1715209532.517699:0:7110:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012f8f5200/0xfa8b5bed87892cd7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x8356b9f6 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 7124 initiator: MDT0 00010000:00010000:2.0:1715209532.517704:0:7110:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012f8f5200/0xfa8b5bed87892cd7 lrc: 4/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x8356b9f6 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 7124 initiator: MDT0 00010000:00010000:2.0:1715209532.517731:0:7110:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1715209532.517767:0:7110:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d81e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:lustre-MDT0001-mdtlov_UUID+6:3683:x1798523511043840:12345-0@lo:103:ldlm_bl.0 Request processed in 1971us (2064us total) trans 0 rc 0/0 00000100:00100000:2.0:1715209532.517775:0:7110:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:0.0:1715209532.517789:0:3683:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88012cd9f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3683:1798523511043840:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1715209532.517855:0:7124:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88012f8f5200/0xfa8b5bed87892cd7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x8356b9f6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7124 initiator: MDT0 00010000:00010000:3.0:1715209532.517869:0:7124:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012f8f5200/0xfa8b5bed87892cd7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x8356b9f6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7124 initiator: MDT0 00000100:00100000:3.0:1715209532.518001:0:7124:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88009d851180 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:7124:1798523511043904:0@lo:1000:mdt00_002.0 00000100:00100000:3.0:1715209532.518044:0:7124:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1715209532.518079:0:7124:0:(client.c:2542:ptlrpc_set_wait()) set ffff8800b526fc00 going to sleep for 11 seconds 00000100:00100000:1.0:1715209532.518134:0:7128:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798523511043904 00000100:00100000:1.0:1715209532.518153:0:7128:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798523511043904 00000100:00100000:1.0:1715209532.518214:0:7128:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3212 00000100:00100000:1.0:1715209532.518224:0:7128:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e37bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:7124:x1798523511043904:12345-0@lo:1000:mdt00_002.0 00000100:00100000:1.0:1715209532.518330:0:7128:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e37bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:7124:x1798523511043904:12345-0@lo:1000:mdt00_002.0 Request processed in 104us (282us total) trans 0 rc 0/0 00000100:00100000:1.0:1715209532.518343:0:7128:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3212 00000100:00100000:3.0:1715209532.518356:0:7124:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88009d851180 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:7124:1798523511043904:0@lo:1000:mdt00_002.0 00010000:00010000:3.0:1715209532.518428:0:7124:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012f8f5440/0xfa8b5bed87892cde lrc: 3/1,0 mode: --/PR res: [0x240000403:0x13:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7124 initiator: MDT0 00010000:00010000:3.0:1715209532.518439:0:7124:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012f8f5440/0xfa8b5bed87892cde lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x13:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7124 initiator: MDT0 00010000:00010000:3.0:1715209532.518448:0:7124:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012f8f5440/0xfa8b5bed87892cde lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x13:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7124 initiator: MDT0 00000004:00010000:3.0:1715209532.518462:0:7124:0:(mdt_handler.c:2451:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88012f8f5440/0xfa8b5bed87892cde lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x13:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7124 initiator: MDT0 00010000:00010000:3.0:1715209532.518473:0:7124:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012f8f4fc0/0xfa8b5bed87892cd0 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7124 initiator: MDT0 00010000:00010000:3.0:1715209532.518479:0:7124:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012f8f4fc0/0xfa8b5bed87892cd0 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7124 initiator: MDT0 00010000:00010000:3.0:1715209532.518485:0:7124:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012f8f4fc0/0xfa8b5bed87892cd0 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7124 initiator: MDT0 00010000:00010000:3.0:1715209532.518491:0:7124:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012f8f4fc0/0xfa8b5bed87892cd0 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7124 initiator: MDT0 00010000:00010000:3.0:1715209532.518497:0:7124:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88012f8f4fc0 already unused, calling callback (ffffffffa0eef730) 00010000:00010000:3.0:1715209532.518501:0:7124:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012f8f4fc0/0xfa8b5bed87892cd0 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7124 initiator: MDT0 00010000:00010000:3.0:1715209532.518520:0:7124:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012f8f4fc0/0xfa8b5bed87892cd0 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7124 initiator: MDT0 00010000:00010000:3.0:1715209532.518531:0:7124:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88012e8ee500) 00010000:00010000:3.0:1715209532.518534:0:7124:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1715209532.518538:0:7124:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012f8f4fc0/0xfa8b5bed87892cd0 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7124 initiator: MDT0 00010000:00010000:3.0:1715209532.518544:0:7124:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012f8f4fc0/0xfa8b5bed87892cd0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7124 initiator: MDT0 00010000:00010000:3.0:1715209532.518556:0:7124:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012f8f5200/0xfa8b5bed87892cd7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x8356b9f6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7124 initiator: MDT0 00010000:00010000:3.0:1715209532.518562:0:7124:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012f8f5200/0xfa8b5bed87892cd7 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x8356b9f6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7124 initiator: MDT0 00010000:00010000:3.0:1715209532.518568:0:7124:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012f8f5200/0xfa8b5bed87892cd7 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x8356b9f6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7124 initiator: MDT0 00010000:00010000:3.0:1715209532.518573:0:7124:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88012f8f5200 already unused, calling callback (ffffffffa0eef730) 00010000:00010000:3.0:1715209532.518575:0:7124:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012f8f5200/0xfa8b5bed87892cd7 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x8356b9f6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7124 initiator: MDT0 00010000:00010000:3.0:1715209532.518581:0:7124:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012f8f5200/0xfa8b5bed87892cd7 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x8356b9f6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7124 initiator: MDT0 00010000:00010000:3.0:1715209532.518587:0:7124:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x8356b9f6 (ffff8800a5700000) 00010000:00010000:3.0:1715209532.518589:0:7124:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1715209532.518592:0:7124:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012f8f5200/0xfa8b5bed87892cd7 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x8356b9f6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7124 initiator: MDT0 00010000:00010000:3.0:1715209532.518597:0:7124:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012f8f5200/0xfa8b5bed87892cd7 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x8356b9f6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7124 initiator: MDT0 00010000:00010000:3.0:1715209532.518632:0:7124:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012f8f4d80/0xfa8b5bed87892cc9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.23@tcp remote: 0x7561918bd55708ed expref: 43 pid: 7124 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715209532.518645:0:7124:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012f8f5440/0xfa8b5bed87892cde lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x13:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.23@tcp remote: 0x7561918bd55708ed expref: 42 pid: 7124 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715209532.518652:0:7124:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x13:0x0].0x0 (ffff88012fea4500) 00010000:00010000:3.0:1715209532.518654:0:7124:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1715209532.518656:0:7124:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012f8f5440, rc 0) 00000100:00100000:3.0:1715209532.518723:0:7124:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d81f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1bc50a3e-f07c-4b55-83c3-5f3c3d406528+42:5181:x1798523505172416:12345-192.168.201.23@tcp:101:rm.0 Request processed in 3781us (4035us total) trans 0 rc 0/0 00000100:00100000:3.0:1715209532.518731:0:7124:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 611 00000100:00100000:0.0:1715209532.520231:0:3677:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:3.0:1715209532.520364:0:7124:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798523505172480 00000100:00100000:3.0:1715209532.520373:0:7124:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798523505172480 00000100:00100000:3.0:1715209532.520422:0:7124:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 612 00000100:00100000:3.0:1715209532.520430:0:7124:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d0af100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1bc50a3e-f07c-4b55-83c3-5f3c3d406528+26:5181:x1798523505172480:12345-192.168.201.23@tcp:101:rm.0 00010000:00010000:3.0:1715209532.520447:0:7124:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1715209532.520460:0:7124:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88012f8f5680/0xfa8b5bed87892ce5 lrc: 2/0,0 mode: --/CR res: [0x240000403:0x13:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7561918bd55708f4 expref: -99 pid: 7124 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715209532.520495:0:7124:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88012f8f58c0/0xfa8b5bed87892cec lrc: 3/1,0 mode: --/PR res: [0x240000403:0x13:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7124 initiator: MDT0 00010000:00010000:3.0:1715209532.520506:0:7124:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88012f8f58c0/0xfa8b5bed87892cec lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x13:0x0].0x0 bits 0x10/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7124 initiator: MDT1 00010000:00010000:3.0:1715209532.520515:0:7124:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88012f8f58c0/0xfa8b5bed87892cec lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x13:0x0].0x0 bits 0x10/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7124 initiator: MDT1 00000004:00200000:3.0:1715209532.520555:0:7124:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x240000403:0x13:0x0]: returning size 4096 00000004:00200000:3.0:1715209532.520559:0:7124:0:(mdt_handler.c:1570:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00010000:00010000:3.0:1715209532.520585:0:7124:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88012f8f5680/0xfa8b5bed87892ce5 lrc: 0/0,0 mode: --/CR res: [0x240000403:0x13:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.23@tcp remote: 0x7561918bd55708f4 expref: 28 pid: 7124 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715209532.520601:0:7124:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88012f8f58c0/0xfa8b5bed87892cec lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x13:0x0].0x0 bits 0x10/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.23@tcp remote: 0x7561918bd55708f4 expref: 27 pid: 7124 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715209532.520609:0:7124:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x13:0x0].0x0 (ffff88012fea4300) 00010000:00010000:3.0:1715209532.520612:0:7124:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 10 00010000:00010000:3.0:1715209532.520615:0:7124:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012f8f58c0, rc 0) 00000100:00100000:3.0:1715209532.520671:0:7124:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d0af100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1bc50a3e-f07c-4b55-83c3-5f3c3d406528+27:5181:x1798523505172480:12345-192.168.201.23@tcp:101:rm.0 Request processed in 241us (444us total) trans 0 rc 0/0 00000100:00100000:3.0:1715209532.520680:0:7124:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 612 00000100:00100000:0.0:1715209532.522234:0:3678:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:3.0:1715209532.522327:0:7124:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798523505172544 00000100:00100000:3.0:1715209532.522336:0:7124:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798523505172544 00000100:00100000:3.0:1715209532.522369:0:7124:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 613 00000100:00100000:3.0:1715209532.522377:0:7124:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d0afb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1bc50a3e-f07c-4b55-83c3-5f3c3d406528+27:5181:x1798523505172544:12345-192.168.201.23@tcp:101:rm.0 00010000:00010000:3.0:1715209532.522389:0:7124:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1715209532.522401:0:7124:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88012f8f5b00/0xfa8b5bed87892cf3 lrc: 2/0,0 mode: --/CR res: [0x240000403:0x13:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7561918bd55708fb expref: -99 pid: 7124 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715209532.522438:0:7124:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88012f8f5d40/0xfa8b5bed87892cfa lrc: 3/1,0 mode: --/CR res: [0x240000403:0x13:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7124 initiator: MDT0 00010000:00010000:3.0:1715209532.522449:0:7124:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88012f8f5d40/0xfa8b5bed87892cfa lrc: 3/1,0 mode: CR/CR res: [0x240000403:0x13:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7124 initiator: MDT1 00010000:00010000:3.0:1715209532.522458:0:7124:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88012f8f5d40/0xfa8b5bed87892cfa lrc: 3/1,0 mode: CR/CR res: [0x240000403:0x13:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7124 initiator: MDT1 00010000:00010000:3.0:1715209532.522522:0:7124:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88012f8f5f80/0xfa8b5bed87892d01 lrc: 3/1,0 mode: --/PR res: [0x240000403:0x13:0x0].0x8356ba08 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7124 initiator: MDT0 00010000:00010000:3.0:1715209532.522531:0:7124:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88012f8f5f80/0xfa8b5bed87892d01 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x13:0x0].0x8356ba08 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7124 initiator: MDT1 00010000:00010000:3.0:1715209532.522539:0:7124:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88012f8f5f80/0xfa8b5bed87892d01 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x13:0x0].0x8356ba08 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7124 initiator: MDT1 00010000:00010000:3.0:1715209532.522561:0:7124:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88012f8f5d40/0xfa8b5bed87892cfa lrc: 4/1,0 mode: CR/CR res: [0x240000403:0x13:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7124 initiator: MDT1 00010000:00010000:3.0:1715209532.522568:0:7124:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88012f8f5d40/0xfa8b5bed87892cfa lrc: 4/1,0 mode: CR/CR res: [0x240000403:0x13:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7124 initiator: MDT1 00010000:00010000:3.0:1715209532.522573:0:7124:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88012f8f5d40/0xfa8b5bed87892cfa lrc: 3/0,0 mode: CR/CR res: [0x240000403:0x13:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7124 initiator: MDT1 00010000:00010000:3.0:1715209532.522579:0:7124:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88012f8f5d40/0xfa8b5bed87892cfa lrc: 4/0,0 mode: CR/CR res: [0x240000403:0x13:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7124 initiator: MDT1 00010000:00010000:3.0:1715209532.522584:0:7124:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88012f8f5d40 already unused, calling callback (ffffffffa0eef730) 00010000:00010000:3.0:1715209532.522588:0:7124:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88012f8f5d40/0xfa8b5bed87892cfa lrc: 4/0,0 mode: CR/CR res: [0x240000403:0x13:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7124 initiator: MDT1 00010000:00010000:3.0:1715209532.522593:0:7124:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88012f8f5d40/0xfa8b5bed87892cfa lrc: 5/0,0 mode: CR/CR res: [0x240000403:0x13:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7124 initiator: MDT1 00010000:00010000:3.0:1715209532.522602:0:7124:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x13:0x0].0x0 (ffff88012fea4300) 00010000:00010000:3.0:1715209532.522605:0:7124:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1715209532.522608:0:7124:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88012f8f5d40/0xfa8b5bed87892cfa lrc: 3/0,0 mode: --/CR res: [0x240000403:0x13:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7124 initiator: MDT1 00010000:00010000:3.0:1715209532.522614:0:7124:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88012f8f5d40/0xfa8b5bed87892cfa lrc: 0/0,0 mode: --/CR res: [0x240000403:0x13:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7124 initiator: MDT1 00010000:00010000:3.0:1715209532.522632:0:7124:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88012f8f5f80/0xfa8b5bed87892d01 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x13:0x0].0x8356ba08 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7124 initiator: MDT1 00010000:00010000:3.0:1715209532.522638:0:7124:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88012f8f5f80/0xfa8b5bed87892d01 lrc: 2/0,0 mode: PR/PR res: [0x240000403:0x13:0x0].0x8356ba08 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7124 initiator: MDT1 00010000:00010000:3.0:1715209532.522643:0:7124:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88012f8f5f80/0xfa8b5bed87892d01 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x13:0x0].0x8356ba08 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7124 initiator: MDT1 00010000:00010000:3.0:1715209532.522648:0:7124:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88012f8f5f80 already unused, calling callback (ffffffffa0eef730) 00010000:00010000:3.0:1715209532.522651:0:7124:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88012f8f5f80/0xfa8b5bed87892d01 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x13:0x0].0x8356ba08 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7124 initiator: MDT1 00010000:00010000:3.0:1715209532.522656:0:7124:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88012f8f5f80/0xfa8b5bed87892d01 lrc: 4/0,0 mode: PR/PR res: [0x240000403:0x13:0x0].0x8356ba08 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7124 initiator: MDT1 00010000:00010000:3.0:1715209532.522664:0:7124:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x13:0x0].0x8356ba08 (ffff88012fea4c00) 00010000:00010000:3.0:1715209532.522666:0:7124:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1715209532.522668:0:7124:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88012f8f5f80/0xfa8b5bed87892d01 lrc: 2/0,0 mode: --/PR res: [0x240000403:0x13:0x0].0x8356ba08 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7124 initiator: MDT1 00010000:00010000:3.0:1715209532.522674:0:7124:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88012f8f5f80/0xfa8b5bed87892d01 lrc: 0/0,0 mode: --/PR res: [0x240000403:0x13:0x0].0x8356ba08 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7124 initiator: MDT1 00010000:00010000:3.0:1715209532.522701:0:7124:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88012f8f5b00/0xfa8b5bed87892cf3 lrc: 1/0,0 mode: --/CR res: [0x240000403:0x13:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.23@tcp remote: 0x7561918bd55708fb expref: 28 pid: 7124 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715209532.522709:0:7124:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88012f8f5b00/0xfa8b5bed87892cf3 lrc: 0/0,0 mode: --/CR res: [0x240000403:0x13:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.23@tcp remote: 0x7561918bd55708fb expref: 28 pid: 7124 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715209532.522717:0:7124:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012f8f5b00, rc 0) 00000100:00100000:3.0:1715209532.522777:0:7124:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d0afb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1bc50a3e-f07c-4b55-83c3-5f3c3d406528+27:5181:x1798523505172544:12345-192.168.201.23@tcp:101:rm.0 Request processed in 399us (547us total) trans 0 rc 301/301 00000100:00100000:3.0:1715209532.522785:0:7124:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 613 00000100:00100000:0.0:1715209532.524567:0:3676:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:3.0:1715209532.524699:0:7124:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798523505172608 00000100:00100000:3.0:1715209532.524708:0:7124:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798523505172608 00000100:00100000:3.0:1715209532.524757:0:7124:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 614 00000100:00100000:3.0:1715209532.524765:0:7124:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d0ac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1bc50a3e-f07c-4b55-83c3-5f3c3d406528+27:5181:x1798523505172608:12345-192.168.201.23@tcp:101:rm.0 00010000:00010000:3.0:1715209532.524778:0:7124:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1715209532.524790:0:7124:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88012f8f61c0/0xfa8b5bed87892d08 lrc: 2/0,0 mode: --/CR res: [0x240000403:0x13:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7561918bd5570902 expref: -99 pid: 7124 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715209532.524859:0:7124:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88012f8f6400/0xfa8b5bed87892d0f lrc: 3/1,0 mode: --/CR res: [0x240000403:0x13:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7124 initiator: MDT0 00010000:00010000:3.0:1715209532.524870:0:7124:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88012f8f6400/0xfa8b5bed87892d0f lrc: 3/1,0 mode: CR/CR res: [0x240000403:0x13:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7124 initiator: MDT1 00010000:00010000:3.0:1715209532.524924:0:7124:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88012f8f6400/0xfa8b5bed87892d0f lrc: 3/1,0 mode: CR/CR res: [0x240000403:0x13:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7124 initiator: MDT1 00010000:00010000:3.0:1715209532.524937:0:7124:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88012f8f6640/0xfa8b5bed87892d16 lrc: 3/1,0 mode: --/PR res: [0x240000403:0x13:0x0].0x8356ba08 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7124 initiator: MDT0 00010000:00010000:3.0:1715209532.524945:0:7124:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88012f8f6640/0xfa8b5bed87892d16 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x13:0x0].0x8356ba08 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7124 initiator: MDT1 00010000:00010000:3.0:1715209532.524951:0:7124:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88012f8f6640/0xfa8b5bed87892d16 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x13:0x0].0x8356ba08 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7124 initiator: MDT1 00010000:00010000:3.0:1715209532.524972:0:7124:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88012f8f6400/0xfa8b5bed87892d0f lrc: 4/1,0 mode: CR/CR res: [0x240000403:0x13:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7124 initiator: MDT1 00010000:00010000:3.0:1715209532.524978:0:7124:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88012f8f6400/0xfa8b5bed87892d0f lrc: 4/1,0 mode: CR/CR res: [0x240000403:0x13:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7124 initiator: MDT1 00010000:00010000:3.0:1715209532.524993:0:7124:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88012f8f6400/0xfa8b5bed87892d0f lrc: 3/0,0 mode: CR/CR res: [0x240000403:0x13:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7124 initiator: MDT1 00010000:00010000:3.0:1715209532.524999:0:7124:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88012f8f6400/0xfa8b5bed87892d0f lrc: 4/0,0 mode: CR/CR res: [0x240000403:0x13:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7124 initiator: MDT1 00010000:00010000:3.0:1715209532.525005:0:7124:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88012f8f6400 already unused, calling callback (ffffffffa0eef730) 00010000:00010000:3.0:1715209532.525008:0:7124:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88012f8f6400/0xfa8b5bed87892d0f lrc: 4/0,0 mode: CR/CR res: [0x240000403:0x13:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7124 initiator: MDT1 00010000:00010000:3.0:1715209532.525014:0:7124:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88012f8f6400/0xfa8b5bed87892d0f lrc: 5/0,0 mode: CR/CR res: [0x240000403:0x13:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7124 initiator: MDT1 00010000:00010000:3.0:1715209532.525024:0:7124:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x13:0x0].0x0 (ffff88012fea4300) 00010000:00010000:3.0:1715209532.525027:0:7124:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1715209532.525030:0:7124:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88012f8f6400/0xfa8b5bed87892d0f lrc: 3/0,0 mode: --/CR res: [0x240000403:0x13:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7124 initiator: MDT1 00010000:00010000:3.0:1715209532.525035:0:7124:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88012f8f6400/0xfa8b5bed87892d0f lrc: 0/0,0 mode: --/CR res: [0x240000403:0x13:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7124 initiator: MDT1 00010000:00010000:3.0:1715209532.525049:0:7124:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88012f8f6640/0xfa8b5bed87892d16 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x13:0x0].0x8356ba08 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7124 initiator: MDT1 00010000:00010000:3.0:1715209532.525055:0:7124:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88012f8f6640/0xfa8b5bed87892d16 lrc: 2/0,0 mode: PR/PR res: [0x240000403:0x13:0x0].0x8356ba08 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7124 initiator: MDT1 00010000:00010000:3.0:1715209532.525061:0:7124:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88012f8f6640/0xfa8b5bed87892d16 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x13:0x0].0x8356ba08 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7124 initiator: MDT1 00010000:00010000:3.0:1715209532.525066:0:7124:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88012f8f6640 already unused, calling callback (ffffffffa0eef730) 00010000:00010000:3.0:1715209532.525068:0:7124:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88012f8f6640/0xfa8b5bed87892d16 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x13:0x0].0x8356ba08 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7124 initiator: MDT1 00010000:00010000:3.0:1715209532.525084:0:7124:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88012f8f6640/0xfa8b5bed87892d16 lrc: 4/0,0 mode: PR/PR res: [0x240000403:0x13:0x0].0x8356ba08 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7124 initiator: MDT1 00010000:00010000:3.0:1715209532.525091:0:7124:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x13:0x0].0x8356ba08 (ffff88012fea4600) 00010000:00010000:3.0:1715209532.525094:0:7124:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1715209532.525096:0:7124:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88012f8f6640/0xfa8b5bed87892d16 lrc: 2/0,0 mode: --/PR res: [0x240000403:0x13:0x0].0x8356ba08 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7124 initiator: MDT1 00010000:00010000:3.0:1715209532.525102:0:7124:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88012f8f6640/0xfa8b5bed87892d16 lrc: 0/0,0 mode: --/PR res: [0x240000403:0x13:0x0].0x8356ba08 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7124 initiator: MDT1 00010000:00010000:3.0:1715209532.525131:0:7124:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88012f8f61c0/0xfa8b5bed87892d08 lrc: 1/0,0 mode: --/CR res: [0x240000403:0x13:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.23@tcp remote: 0x7561918bd5570902 expref: 28 pid: 7124 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715209532.525140:0:7124:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88012f8f61c0/0xfa8b5bed87892d08 lrc: 0/0,0 mode: --/CR res: [0x240000403:0x13:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.23@tcp remote: 0x7561918bd5570902 expref: 28 pid: 7124 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715209532.525148:0:7124:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012f8f61c0, rc 0) 00000100:00100000:3.0:1715209532.525202:0:7124:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d0ac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1bc50a3e-f07c-4b55-83c3-5f3c3d406528+27:5181:x1798523505172608:12345-192.168.201.23@tcp:101:rm.0 Request processed in 437us (640us total) trans 0 rc 301/301 00000100:00100000:3.0:1715209532.525211:0:7124:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 614 00000100:00100000:0.0:1715209532.530407:0:3677:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:3.0:1715209532.530534:0:7124:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798523505172736 00000100:00100000:3.0:1715209532.530544:0:7124:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798523505172736 00000100:00100000:3.0:1715209532.530593:0:7124:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 615 00000100:00100000:3.0:1715209532.530600:0:7124:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d0aca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1bc50a3e-f07c-4b55-83c3-5f3c3d406528+27:5182:x1798523505172736:12345-192.168.201.23@tcp:101:dd.0 00010000:00010000:3.0:1715209532.530614:0:7124:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1715209532.530626:0:7124:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88012f8f6880/0xfa8b5bed87892d1d lrc: 2/0,0 mode: --/CW res: [0x240000403:0x13:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7561918bd5570909 expref: -99 pid: 7124 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715209532.530703:0:7124:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff88012f8f6ac0/0xfa8b5bed87892d24 lrc: 3/0,1 mode: --/CW res: [0x240000403:0x13:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7124 initiator: MDT0 00010000:00010000:3.0:1715209532.530715:0:7124:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88012f8f6ac0/0xfa8b5bed87892d24 lrc: 3/0,1 mode: CW/CW res: [0x240000403:0x13:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7124 initiator: MDT1 00010000:00010000:3.0:1715209532.530724:0:7124:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88012f8f6ac0/0xfa8b5bed87892d24 lrc: 3/0,1 mode: CW/CW res: [0x240000403:0x13:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7124 initiator: MDT1 00010000:00010000:3.0:1715209532.530735:0:7124:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff88012f8f6d00/0xfa8b5bed87892d2b lrc: 3/0,1 mode: --/PW res: [0x240000403:0x13:0x0].0x8356ba08 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7124 initiator: MDT0 00010000:00010000:3.0:1715209532.530743:0:7124:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88012f8f6d00/0xfa8b5bed87892d2b lrc: 3/0,1 mode: PW/PW res: [0x240000403:0x13:0x0].0x8356ba08 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7124 initiator: MDT1 00010000:00010000:3.0:1715209532.530749:0:7124:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88012f8f6d00/0xfa8b5bed87892d2b lrc: 3/0,1 mode: PW/PW res: [0x240000403:0x13:0x0].0x8356ba08 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7124 initiator: MDT1 00000100:00100000:3.0:1715209532.530861:0:7124:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88009e37b480 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:7124:1798523511043968:0@lo:1000:mdt00_002.0 00000100:00100000:3.0:1715209532.530931:0:7124:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1715209532.530958:0:7124:0:(client.c:2542:ptlrpc_set_wait()) set ffff88009ee8acc0 going to sleep for 11 seconds 00000100:00100000:1.0:1715209532.531020:0:7128:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798523511043968 00000100:00100000:1.0:1715209532.531029:0:7128:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798523511043968 00000100:00100000:1.0:1715209532.531083:0:7128:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3213 00000100:00100000:1.0:1715209532.531093:0:7128:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e378000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:7124:x1798523511043968:12345-0@lo:1000:mdt00_002.0 00000100:00100000:1.0:1715209532.531201:0:7128:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e378000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:7124:x1798523511043968:12345-0@lo:1000:mdt00_002.0 Request processed in 106us (266us total) trans 0 rc 0/0 00000100:00100000:1.0:1715209532.531215:0:7128:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3213 00000100:00100000:3.0:1715209532.531234:0:7124:0:(client.c:2956:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 4294967505 gen 2 00000004:00080000:3.0:1715209532.531239:0:7124:0:(osp_trans.c:1052:osp_request_commit_cb()) trans no 4294967505 committed transno 4294967505 00000100:00100000:3.0:1715209532.531264:0:7124:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88009e37b480 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:7124:1798523511043968:0@lo:1000:mdt00_002.0 00000004:00080000:3.0:1715209532.531480:0:7124:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000400:0x7:0x0], index 0: 0 00010000:00010000:3.0:1715209532.531579:0:7124:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88012f8f6f40/0xfa8b5bed87892d32 lrc: 3/1,0 mode: --/PR res: [0x240000403:0x14:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7124 initiator: MDT0 00010000:00010000:3.0:1715209532.531589:0:7124:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88012f8f6f40/0xfa8b5bed87892d32 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x14:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7124 initiator: MDT1 00010000:00010000:3.0:1715209532.531610:0:7124:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88012f8f6f40/0xfa8b5bed87892d32 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x14:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7124 initiator: MDT1 00010000:00010000:3.0:1715209532.531643:0:7124:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff88012f8f6ac0/0xfa8b5bed87892d24 lrc: 4/0,1 mode: CW/CW res: [0x240000403:0x13:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7124 initiator: MDT1 00010000:00010000:3.0:1715209532.531649:0:7124:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff88012f8f6ac0/0xfa8b5bed87892d24 lrc: 4/0,1 mode: CW/CW res: [0x240000403:0x13:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7124 initiator: MDT1 00010000:00010000:3.0:1715209532.531655:0:7124:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88012f8f6ac0/0xfa8b5bed87892d24 lrc: 3/0,0 mode: CW/CW res: [0x240000403:0x13:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7124 initiator: MDT1 00010000:00010000:3.0:1715209532.531661:0:7124:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88012f8f6ac0/0xfa8b5bed87892d24 lrc: 4/0,0 mode: CW/CW res: [0x240000403:0x13:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7124 initiator: MDT1 00010000:00010000:3.0:1715209532.531666:0:7124:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88012f8f6ac0 already unused, calling callback (ffffffffa0eef730) 00010000:00010000:3.0:1715209532.531669:0:7124:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88012f8f6ac0/0xfa8b5bed87892d24 lrc: 4/0,0 mode: CW/CW res: [0x240000403:0x13:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7124 initiator: MDT1 00010000:00010000:3.0:1715209532.531675:0:7124:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88012f8f6ac0/0xfa8b5bed87892d24 lrc: 5/0,0 mode: CW/CW res: [0x240000403:0x13:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7124 initiator: MDT1 00010000:00010000:3.0:1715209532.531684:0:7124:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x13:0x0].0x0 (ffff88012fea4300) 00010000:00010000:3.0:1715209532.531687:0:7124:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1715209532.531690:0:7124:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88012f8f6ac0/0xfa8b5bed87892d24 lrc: 3/0,0 mode: --/CW res: [0x240000403:0x13:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7124 initiator: MDT1 00010000:00010000:3.0:1715209532.531695:0:7124:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88012f8f6ac0/0xfa8b5bed87892d24 lrc: 0/0,0 mode: --/CW res: [0x240000403:0x13:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7124 initiator: MDT1 00000004:00010000:3.0:1715209532.531707:0:7124:0:(mdt_handler.c:4256:mdt_save_lock()) ### save lock request ffff88012d0aca80 reply state ffff88012d934000 transno 4294967355 ns: mdt-lustre-MDT0001_UUID lock: ffff88012f8f6d00/0xfa8b5bed87892d2b lrc: 3/0,1 mode: PW/PW res: [0x240000403:0x13:0x0].0x8356ba08 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7124 initiator: MDT1 00010000:00010000:3.0:1715209532.531715:0:7124:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88012f8f6d00/0xfa8b5bed87892d2b lrc: 3/0,1 mode: TXN/TXN res: [0x240000403:0x13:0x0].0x8356ba08 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7124 initiator: MDT1 00010000:00010000:3.0:1715209532.531728:0:7124:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x13:0x0].0x8356ba08 (ffff88012fea4e00) 00010000:00010000:3.0:1715209532.531731:0:7124:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1715209532.531734:0:7124:0:(service.c:188:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1715209532.531758:0:7124:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88012f8f6880/0xfa8b5bed87892d1d lrc: 0/0,0 mode: --/CW res: [0x240000403:0x13:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.23@tcp remote: 0x7561918bd5570909 expref: 30 pid: 7124 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715209532.531772:0:7124:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88012f8f6f40/0xfa8b5bed87892d32 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x14:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.23@tcp remote: 0x7561918bd5570909 expref: 29 pid: 7124 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715209532.531779:0:7124:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x14:0x0].0x0 (ffff88012feb9300) 00010000:00010000:3.0:1715209532.531782:0:7124:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1715209532.531784:0:7124:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012f8f6f40, rc 0) 00000100:00100000:3.0:1715209532.531860:0:7124:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d0aca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1bc50a3e-f07c-4b55-83c3-5f3c3d406528+30:5182:x1798523505172736:12345-192.168.201.23@tcp:101:dd.0 Request processed in 1259us (1457us total) trans 4294967355 rc 0/0 00000100:00100000:3.0:1715209532.531869:0:7124:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 615 00000100:00100000:0.0:1715209532.550019:0:3678:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:3.0:1715209532.550152:0:15069:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798523505172864 00000100:00100000:3.0:1715209532.550161:0:15069:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798523505172864 00000100:00100000:3.0:1715209532.550213:0:15069:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 101 00000100:00100000:3.0:1715209532.550221:0:15069:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88011dc71180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:1bc50a3e-f07c-4b55-83c3-5f3c3d406528+30:5182:x1798523505172864:12345-192.168.201.23@tcp:35:dd.0 00000100:00100000:3.0:1715209532.550413:0:15069:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88011dc71180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:1bc50a3e-f07c-4b55-83c3-5f3c3d406528+31:5182:x1798523505172864:12345-192.168.201.23@tcp:35:dd.0 Request processed in 190us (396us total) trans 4294967356 rc 0/0 00000100:00100000:3.0:1715209532.550422:0:15069:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 101 00000100:00100000:0.0:1715209532.660042:0:3683:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1715209532.660064:0:3683:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88011dc72a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3683:1798523511044032:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1715209532.660072:0:3685:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88012cd9ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3685:1798523511044096:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1715209532.660121:0:3683:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1715209532.660132:0:3685:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1715209532.660163:0:7128:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798523511044032 00000100:00100000:3.0:1715209532.660168:0:9389:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798523511044096 00000100:00100000:1.0:1715209532.660176:0:7128:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798523511044032 00000100:00100000:3.0:1715209532.660178:0:9389:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798523511044096 00000100:00080000:2.0:1715209532.660210:0:7120:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 older than 1715209502 00000100:00100000:1.0:1715209532.660228:0:7128:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3214 00000100:00100000:1.0:1715209532.660236:0:7128:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88011dc71f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3683:x1798523511044032:12345-0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1715209532.660237:0:9389:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3048 00000100:00100000:3.0:1715209532.660244:0:9389:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cd9f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3685:x1798523511044096:12345-0@lo:13:osp-pre-0-0.0 00000004:00000024:1.0:1715209532.660262:0:7128:0:(mdt_handler.c:569:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446273024 avail 1316810752 00002000:00000024:3.0:1715209532.660287:0:9389:0:(ofd_obd.c:743:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3922501632 avail 3690979328 00000100:00100000:1.0:1715209532.660324:0:7128:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88011dc71f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3683:x1798523511044032:12345-0@lo:41:osp-pre-1-0.0 Request processed in 88us (202us total) trans 0 rc 0/0 00000100:00100000:1.0:1715209532.660332:0:7128:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3214 00000100:00100000:3.0:1715209532.660359:0:9389:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cd9f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3685:x1798523511044096:12345-0@lo:13:osp-pre-0-0.0 Request processed in 114us (226us total) trans 0 rc 0/0 00000100:00100000:0.0:1715209532.660366:0:3683:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88011dc72a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3683:1798523511044032:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1715209532.660368:0:9389:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3048 00000100:00100000:2.0:1715209532.660409:0:3685:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88012cd9ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3685:1798523511044096:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1715209532.676132:0:3686:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88011dc72a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3686:1798523511044160:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1715209532.676174:0:3686:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1715209532.676235:0:9389:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798523511044160 00000100:00100000:3.0:1715209532.676245:0:9389:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798523511044160 00000100:00080000:2.0:1715209532.676274:0:7120:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 older than 1715209502 00000100:00100000:3.0:1715209532.676297:0:9389:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3049 00000100:00100000:3.0:1715209532.676305:0:9389:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cd9ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3686:x1798523511044160:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1715209532.676322:0:9389:0:(ofd_obd.c:743:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3922501632 avail 3690979328 00000100:00100000:3.0:1715209532.676379:0:9389:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cd9ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3686:x1798523511044160:12345-0@lo:13:osp-pre-0-1.0 Request processed in 74us (205us total) trans 0 rc 0/0 00000100:00100000:3.0:1715209532.676388:0:9389:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3049 00000100:00100000:2.0:1715209532.676429:0:3686:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88011dc72a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3686:1798523511044160:0@lo:13:osp-pre-0-1.0 00000040:00080000:2.0:1715209532.741057:0:15215:0:(llog.c:735:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1715209532.741067:0:15215:0:(llog_cat.c:796:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1715209532.741802:0:15215:0:(llog.c:792:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 1 00000040:00080000:2.0:1715209532.741814:0:15215:0:(llog.c:792:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000040:00080000:2.0:1715209532.777229:0:15218:0:(llog.c:792:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000001:02000400:3.0:1715209533.194953:0:24969:0:(debug.c:705:libcfs_debug_mark_buffer()) DEBUG MARKER: sanity-hsm test_29b: @@@@@@ FAIL: cannot create /mnt/lustre2/d29b.sanity-hsm/f29b.sanity-hsm with dd, status=1 00010000:00010000:2.0:1715209533.318161:0:7112:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) Debug log: 805 lines, 805 kept, 0 dropped, 0 bad.