00010000:00010000:3.0F:1715207780.796197:0:11642:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0F:1715207781.146459:0:3678:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:3.0:1715207781.146635:0:7124:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798523505025728 00000100:00100000:3.0:1715207781.146652:0:7124:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798523505025728 00000100:00100000:3.0:1715207781.146762:0:7124:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 358 00000100:00100000:3.0:1715207781.146776:0:7124:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c8d9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1bc50a3e-f07c-4b55-83c3-5f3c3d406528+26:30487:x1798523505025728:12345-192.168.201.23@tcp:60:lhsmtool_posix.0 00000100:00080000:2.0F:1715207781.146805:0:7120:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 older than 1715207751 00000100:00100000:3.0:1715207781.146991:0:7124:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c8d9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1bc50a3e-f07c-4b55-83c3-5f3c3d406528+26:30487:x1798523505025728:12345-192.168.201.23@tcp:60:lhsmtool_posix.0 Request processed in 214us (541us total) trans 0 rc 0/0 00000100:00100000:3.0:1715207781.147002:0:7124:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 358 00000100:00100000:2.0:1715207781.148359:0:3677:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:3.0:1715207781.148484:0:7124:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798523505025792 00000100:00100000:3.0:1715207781.148493:0:7124:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798523505025792 00000100:00100000:3.0:1715207781.148543:0:7124:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 359 00000100:00100000:3.0:1715207781.148550:0:7124:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009dd48a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1bc50a3e-f07c-4b55-83c3-5f3c3d406528+9:30487:x1798523505025792:12345-192.168.201.23@tcp:60:lhsmtool_posix.0 00000100:00080000:2.0:1715207781.148564:0:7120:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 older than 1715207751 00000100:00100000:3.0:1715207781.148619:0:7124:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009dd48a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1bc50a3e-f07c-4b55-83c3-5f3c3d406528+9:30487:x1798523505025792:12345-192.168.201.23@tcp:60:lhsmtool_posix.0 Request processed in 68us (264us total) trans 0 rc 0/0 00000100:00100000:3.0:1715207781.148627:0:7124:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 359 00000100:00100000:0.0F:1715207781.150195:0:3676:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:3.0:1715207781.150263:0:15069:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798523505025920 00000100:00100000:3.0:1715207781.150272:0:15069:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798523505025920 00000100:00100000:3.0:1715207781.150318:0:15069:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 62 00000100:00100000:3.0:1715207781.150326:0:15069:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009dc6ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:1bc50a3e-f07c-4b55-83c3-5f3c3d406528+26:30487:x1798523505025920:12345-192.168.201.23@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1715207781.150517:0:15069:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009dc6ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:1bc50a3e-f07c-4b55-83c3-5f3c3d406528+27:30487:x1798523505025920:12345-192.168.201.23@tcp:35:lhsmtool_posix.0 Request processed in 190us (326us total) trans 4294967424 rc 0/0 00000100:00100000:3.0:1715207781.150526:0:15069:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 62 00000100:00100000:3.0:1715207781.716053:0:3685:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88009dd48e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3685:1798523510609728:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1715207781.716066:0:3683:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88012c8d9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3683:1798523510609856:0@lo:400:kworker.0 00000100:00100000:0.0:1715207781.716110:0:3686:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88012c8d8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:24597633-7c6c-43cc-a7e8-ad821c1018c0:3686:1798523510609792:0@lo:400:kworker.0 00000100:00100000:2.0:1715207781.716136:0:3683:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1715207781.716137:0:3685:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1715207781.716151:0:3684:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88012c8db480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3684:1798523510609920:0@lo:400:kworker.0 00000100:00100000:2.0:1715207781.716171:0:3683:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88009e33c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3683:1798523510610112:0@lo:400:kworker.0 00000100:00100000:3.0:1715207781.716174:0:3685:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88012c8d8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3685:1798523510609984:0@lo:400:kworker.0 00000100:00100000:0.0:1715207781.716185:0:3686:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1715207781.716198:0:3683:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1715207781.716209:0:3684:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1715207781.716213:0:7119:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798523510609792 00000100:00100000:2.0:1715207781.716217:0:3683:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8801300b0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3683:1798523510610368:0@lo:400:kworker.0 00000100:00100000:0.0:1715207781.716217:0:3686:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88012c8db800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3686:1798523510610048:0@lo:400:kworker.0 00000100:00100000:3.0:1715207781.716227:0:7119:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798523510609792 00000100:00100000:2.0:1715207781.716238:0:3683:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1715207781.716240:0:3684:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88009e33f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3684:1798523510610176:0@lo:400:kworker.0 00000100:00100000:0.0:1715207781.716255:0:3686:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1715207781.716267:0:7124:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798523510609856 00000100:00100000:2.0:1715207781.716272:0:7124:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798523510609856 00000100:00100000:1.0:1715207781.716275:0:3684:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1715207781.716275:0:3686:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8801300b0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3686:1798523510610304:0@lo:400:kworker.0 00000100:00100000:1.0:1715207781.716297:0:3684:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8801300b0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3684:1798523510610432:0@lo:400:kworker.0 00000100:00100000:0.0:1715207781.716299:0:3686:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1715207781.716301:0:7124:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798523510610112 00000100:00100000:2.0:1715207781.716304:0:7124:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798523510610112 00000100:00100000:0.0:1715207781.716318:0:3686:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88009e306680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3686:1798523510610560:0@lo:400:kworker.0 00000100:00100000:2.0:1715207781.716319:0:7124:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798523510610368 00000100:00100000:2.0:1715207781.716322:0:7124:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798523510610368 00000100:00100000:1.0:1715207781.716327:0:3684:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1715207781.716332:0:7119:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1342 00000100:00100000:2.0:1715207781.716333:0:7124:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798523510610176 00000100:00100000:2.0:1715207781.716335:0:7124:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798523510610176 00000100:00100000:0.0:1715207781.716335:0:3686:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1715207781.716340:0:7119:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a86c2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:24597633-7c6c-43cc-a7e8-ad821c1018c0+23:3686:x1798523510609792:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1715207781.716344:0:7124:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798523510610432 00000100:00100000:2.0:1715207781.716347:0:7124:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798523510610432 00000100:00100000:2.0:1715207781.716357:0:7124:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3865 00000100:00100000:2.0:1715207781.716363:0:7124:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009dd4b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3683:x1798523510609856:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1715207781.716363:0:7128:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798523510609920 00000100:00100000:0.0:1715207781.716364:0:9389:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798523510609728 00000100:00100000:1.0:1715207781.716368:0:7128:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798523510609920 00000100:00100000:0.0:1715207781.716369:0:9389:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798523510609728 00000100:00100000:1.0:1715207781.716395:0:7128:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798523510610048 00000100:00100000:3.0:1715207781.716397:0:7119:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a86c2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:24597633-7c6c-43cc-a7e8-ad821c1018c0+23:3686:x1798523510609792:12345-0@lo:400:kworker.0 Request processed in 58us (215us total) trans 0 rc 0/0 00000100:00100000:0.0:1715207781.716397:0:9389:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1650 00000100:00100000:1.0:1715207781.716399:0:7128:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798523510610048 00000100:00100000:0.0:1715207781.716404:0:9389:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a03f2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3685:x1798523510609728:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1715207781.716405:0:7119:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1342 00000100:00100000:2.0:1715207781.716408:0:7124:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009dd4b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3683:x1798523510609856:12345-0@lo:400:kworker.0 Request processed in 44us (275us total) trans 0 rc 0/0 00000100:00100000:2.0:1715207781.716415:0:7124:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3865 00000100:00100000:1.0:1715207781.716418:0:7128:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1712 00000100:00100000:1.0:1715207781.716426:0:7128:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e305f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3684:x1798523510609920:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1715207781.716429:0:7124:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3866 00002000:00000024:0.0:1715207781.716431:0:9389:0:(ofd_obd.c:743:ofd_statfs()) blocks cached 0 granted 16080576 pending 0 free 3921453056 avail 3689930752 00000100:00100000:2.0:1715207781.716433:0:7124:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009dd4a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3683:x1798523510610112:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1715207781.716440:0:10664:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3867 00000100:00100000:3.0:1715207781.716445:0:10664:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5748000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3683:x1798523510610368:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1715207781.716458:0:7124:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009dd4a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3683:x1798523510610112:12345-0@lo:400:kworker.0 Request processed in 24us (259us total) trans 0 rc 0/0 00000100:00100000:2.0:1715207781.716465:0:7124:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3866 00000100:00100000:0.0:1715207781.716471:0:9389:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a03f2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3685:x1798523510609728:12345-0@lo:13:osp-pre-1-0.0 Request processed in 67us (338us total) trans 0 rc 0/0 00000100:00100000:3.0:1715207781.716481:0:10664:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5748000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3683:x1798523510610368:12345-0@lo:400:kworker.0 Request processed in 34us (241us total) trans 0 rc 0/0 00000100:00100000:0.0:1715207781.716481:0:9389:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1650 00000100:00100000:3.0:1715207781.716487:0:10664:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3867 00000100:00100000:2.0:1715207781.716492:0:7124:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3868 00000100:00100000:1.0:1715207781.716493:0:7128:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e305f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3684:x1798523510609920:12345-0@lo:400:kworker.0 Request processed in 64us (283us total) trans 0 rc 0/0 00000100:00100000:2.0:1715207781.716496:0:7124:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e304a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3684:x1798523510610176:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1715207781.716502:0:10664:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3869 00000100:00100000:1.0:1715207781.716505:0:7128:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1712 00000100:00100000:3.0:1715207781.716506:0:10664:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e306a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3684:x1798523510610432:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1715207781.716520:0:8276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1713 00000100:00100000:2.0:1715207781.716526:0:7124:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e304a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3684:x1798523510610176:12345-0@lo:400:kworker.0 Request processed in 29us (252us total) trans 0 rc 0/0 00000100:00100000:0.0:1715207781.716526:0:8276:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009dc6d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3686:x1798523510610048:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1715207781.716529:0:10664:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e306a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3684:x1798523510610432:12345-0@lo:400:kworker.0 Request processed in 22us (203us total) trans 0 rc 0/0 00000100:00100000:2.0:1715207781.716532:0:7124:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3868 00000100:00100000:3.0:1715207781.716536:0:10664:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3869 00000100:00080000:2.0:1715207781.716551:0:7120:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 older than 1715207751 00000100:00100000:3.0:1715207781.716553:0:9918:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798523510610304 00000100:00080000:2.0:1715207781.716555:0:7120:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 older than 1715207751 00000100:00100000:0.0:1715207781.716555:0:8276:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009dc6d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3686:x1798523510610048:12345-0@lo:400:kworker.0 Request processed in 29us (301us total) trans 0 rc 0/0 00000100:00100000:3.0:1715207781.716556:0:9918:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798523510610304 00000100:00080000:2.0:1715207781.716558:0:7120:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 older than 1715207751 00000100:00080000:2.0:1715207781.716561:0:7120:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 older than 1715207751 00000100:00100000:0.0:1715207781.716562:0:8276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1713 00000100:00080000:2.0:1715207781.716563:0:7120:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd MGS older than 1715207751 00000100:00100000:1.0:1715207781.716567:0:3684:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88012c8db480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3684:1798523510609920:0@lo:400:kworker.0 00000100:00100000:3.0:1715207781.716578:0:9918:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798523510610560 00000100:00100000:3.0:1715207781.716580:0:9918:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798523510610560 00000100:00100000:1.0:1715207781.716581:0:3684:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88009e33f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3684:1798523510610176:0@lo:400:kworker.0 00000100:00100000:2.0:1715207781.716587:0:9385:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2057 00000100:00100000:1.0:1715207781.716591:0:3684:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff8801300b0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3684:1798523510610432:0@lo:400:kworker.0 00000100:00100000:2.0:1715207781.716592:0:9385:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009dc6dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3686:x1798523510610304:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1715207781.716593:0:17457:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2058 00000100:00100000:0.0:1715207781.716598:0:17457:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009dd8aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+5:3686:x1798523510610560:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1715207781.716613:0:3685:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1715207781.716618:0:9385:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009dc6dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3686:x1798523510610304:12345-0@lo:400:kworker.0 Request processed in 26us (319us total) trans 0 rc 0/0 00000100:00100000:2.0:1715207781.716626:0:9385:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2057 00000100:00100000:1.0:1715207781.716627:0:6554:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798523510609984 00000100:00100000:0.0:1715207781.716627:0:17457:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009dd8aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+5:3686:x1798523510610560:12345-0@lo:400:kworker.0 Request processed in 27us (290us total) trans 0 rc 0/0 00000100:00100000:3.0:1715207781.716630:0:3685:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88009e33ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3685:1798523510610240:0@lo:400:kworker.0 00000100:00100000:1.0:1715207781.716630:0:6554:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798523510609984 00000100:00100000:0.0:1715207781.716649:0:17457:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2058 00000100:00100000:3.0:1715207781.716650:0:3685:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1715207781.716653:0:6554:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3870 00000100:00100000:2.0:1715207781.716657:0:3683:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88009e33c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3683:1798523510610112:0@lo:400:kworker.0 00000100:00100000:1.0:1715207781.716659:0:6554:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a03f0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000-lwp-MDT0001_UUID+5:3685:x1798523510609984:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1715207781.716661:0:3685:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88009e304e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3685:1798523510610496:0@lo:400:kworker.0 00000100:00100000:2.0:1715207781.716668:0:3683:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff8801300b0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3683:1798523510610368:0@lo:400:kworker.0 00000100:00100000:0.0:1715207781.716668:0:17457:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798523510610240 00000100:00100000:0.0:1715207781.716674:0:17457:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798523510610240 00000100:00100000:3.0:1715207781.716675:0:3685:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1715207781.716677:0:3683:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88012c8d9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3683:1798523510609856:0@lo:400:kworker.0 00000100:00100000:1.0:1715207781.716696:0:6554:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a03f0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000-lwp-MDT0001_UUID+5:3685:x1798523510609984:12345-0@lo:400:kworker.0 Request processed in 37us (83us total) trans 0 rc 0/0 00000100:00100000:3.0:1715207781.716702:0:3685:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88009dd48e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3685:1798523510609728:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1715207781.716703:0:6554:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3870 00000100:00100000:2.0:1715207781.716704:0:9385:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798523510610496 00000100:00100000:2.0:1715207781.716707:0:9385:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798523510610496 00000100:00100000:0.0:1715207781.716709:0:17457:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2059 00000100:00100000:0.0:1715207781.716716:0:17457:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a03f1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:3685:x1798523510610240:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1715207781.716726:0:9385:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2060 00000100:00100000:2.0:1715207781.716731:0:9385:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a03f0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3685:x1798523510610496:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1715207781.716737:0:3685:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88012c8d8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3685:1798523510609984:0@lo:400:kworker.0 00000100:00100000:2.0:1715207781.716765:0:9385:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a03f0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3685:x1798523510610496:12345-0@lo:400:kworker.0 Request processed in 34us (89us total) trans 0 rc 0/0 00000100:00100000:0.0:1715207781.716771:0:17457:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a03f1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:3685:x1798523510610240:12345-0@lo:400:kworker.0 Request processed in 53us (117us total) trans 0 rc 0/0 00000100:00100000:2.0:1715207781.716772:0:9385:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2060 00000100:00100000:3.0:1715207781.716775:0:3685:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88009e33ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3685:1798523510610240:0@lo:400:kworker.0 00000100:00100000:0.0:1715207781.716782:0:17457:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2059 00000100:00100000:3.0:1715207781.716784:0:3685:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88009e304e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3685:1798523510610496:0@lo:400:kworker.0 00000100:00080000:0.0:1715207781.716805:0:7120:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 older than 1715207751 00000100:00080000:0.0:1715207781.716810:0:7120:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 older than 1715207751 00000100:00100000:0.0:1715207781.716930:0:3686:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88009e306680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3686:1798523510610560:0@lo:400:kworker.0 00000100:00100000:0.0:1715207781.716951:0:3686:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88012c8d8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:24597633-7c6c-43cc-a7e8-ad821c1018c0:3686:1798523510609792:0@lo:400:kworker.0 00000100:00100000:0.0:1715207781.716965:0:3686:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88012c8db800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3686:1798523510610048:0@lo:400:kworker.0 00000100:00100000:0.0:1715207781.716978:0:3686:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff8801300b0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3686:1798523510610304:0@lo:400:kworker.0 00000100:00100000:2.0:1715207781.732032:0:3683:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88009dd89c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3683:1798523510610624:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1715207781.732090:0:3683:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1715207781.732215:0:9919:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798523510610624 00000100:00100000:3.0:1715207781.732224:0:9919:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798523510610624 00000100:00100000:3.0:1715207781.732271:0:9919:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1651 00000100:00100000:3.0:1715207781.732278:0:9919:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88006ee78e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3683:x1798523510610624:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1715207781.732298:0:9919:0:(ofd_obd.c:743:ofd_statfs()) blocks cached 0 granted 16080576 pending 0 free 3921453056 avail 3689930752 00000100:00100000:3.0:1715207781.732351:0:9919:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88006ee78e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3683:x1798523510610624:12345-0@lo:13:osp-pre-1-1.0 Request processed in 72us (262us total) trans 0 rc 0/0 00000100:00100000:3.0:1715207781.732358:0:9919:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1651 00000100:00100000:2.0:1715207781.732430:0:3683:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88009dd89c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3683:1798523510610624:0@lo:13:osp-pre-1-1.0 00010000:00010000:2.0:1715207781.798073:0:7113:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1715207782.733015:0:15215:0:(llog.c:735:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1715207782.733023:0:15215:0:(llog_cat.c:796:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1715207782.733574:0:15215:0:(llog.c:792:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 1 00000040:00080000:0.0:1715207782.733583:0:15215:0:(llog.c:792:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000040:00080000:2.0:1715207782.774538:0:15218:0:(llog.c:792:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1715207782.800128:0:14811:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1715207782.996051:0:3684:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88009e304700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3684:1798523510610688:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1715207782.996134:0:3684:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1715207782.996179:0:8276:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798523510610688 00000100:00100000:0.0:1715207782.996189:0:8276:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798523510610688 00000100:00100000:0.0:1715207782.996230:0:8276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1714 00000100:00100000:0.0:1715207782.996237:0:8276:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e306680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3684:x1798523510610688:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1715207782.996272:0:8276:0:(mdt_handler.c:569:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445048320 avail 1315586048 00000100:00100000:0.0:1715207782.996322:0:8276:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e306680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3684:x1798523510610688:12345-0@lo:41:osp-pre-0-1.0 Request processed in 85us (192us total) trans 0 rc 0/0 00000100:00100000:0.0:1715207782.996337:0:8276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1714 00000100:00100000:1.0:1715207782.996354:0:3684:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88009e304700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3684:1798523510610688:0@lo:41:osp-pre-0-1.0 00000001:00080000:0.0:1715207783.463654:0:7105:0:(tgt_lastrcvd.c:969:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967424 is committed 00010000:00010000:2.0:1715207783.463756:0:3669:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88006ee721c0/0xfa8b5bed87891fb7 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xbce51078 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 21028 initiator: MDT0 00010000:00010000:2.0:1715207783.463773:0:3669:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88006ee721c0/0xfa8b5bed87891fb7 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xbce51078 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 21028 initiator: MDT0 00010000:00010000:2.0:1715207783.463782:0:3669:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88006ee721c0/0xfa8b5bed87891fb7 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xbce51078 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 21028 initiator: MDT0 00010000:00010000:2.0:1715207783.463788:0:3669:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88006ee721c0 already unused, calling callback (ffffffffa0eef730) 00010000:00010000:2.0:1715207783.463793:0:3669:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88006ee721c0/0xfa8b5bed87891fb7 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xbce51078 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 21028 initiator: MDT0 00010000:00010000:2.0:1715207783.463801:0:3669:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88006ee721c0/0xfa8b5bed87891fb7 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xbce51078 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 21028 initiator: MDT0 00010000:00010000:2.0:1715207783.463846:0:3669:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xbce51078 (ffff88012f833b00) 00010000:00010000:2.0:1715207783.463850:0:3669:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1715207783.463855:0:3669:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88006ee721c0/0xfa8b5bed87891fb7 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xbce51078 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 21028 initiator: MDT0 00010000:00010000:2.0:1715207783.463872:0:3669:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88006ee721c0/0xfa8b5bed87891fb7 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xbce51078 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 21028 initiator: MDT0 00010000:00010000:2.0:1715207783.463933:0:3669:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88006ee718c0/0xfa8b5bed87891fbe lrc: 3/0,1 mode: TXN/TXN res: [0x200000403:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 21028 initiator: MDT0 00010000:00010000:2.0:1715207783.463954:0:3669:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88006ee718c0/0xfa8b5bed87891fbe lrc: 2/0,0 mode: TXN/TXN res: [0x200000403:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 21028 initiator: MDT0 00010000:00010000:2.0:1715207783.463960:0:3669:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88006ee718c0/0xfa8b5bed87891fbe lrc: 3/0,0 mode: TXN/TXN res: [0x200000403:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 21028 initiator: MDT0 00010000:00010000:2.0:1715207783.463965:0:3669:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88006ee718c0 already unused, calling callback (ffffffffa0eef730) 00010000:00010000:2.0:1715207783.463968:0:3669:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88006ee718c0/0xfa8b5bed87891fbe lrc: 3/0,0 mode: TXN/TXN res: [0x200000403:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 21028 initiator: MDT0 00010000:00010000:2.0:1715207783.463973:0:3669:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88006ee718c0/0xfa8b5bed87891fbe lrc: 4/0,0 mode: TXN/TXN res: [0x200000403:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 21028 initiator: MDT0 00010000:00010000:2.0:1715207783.463982:0:3669:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x5:0x0].0x0 (ffff88012f833500) 00010000:00010000:2.0:1715207783.463985:0:3669:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1715207783.463988:0:3669:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88006ee718c0/0xfa8b5bed87891fbe lrc: 2/0,0 mode: --/TXN res: [0x200000403:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 21028 initiator: MDT0 00010000:00010000:2.0:1715207783.463993:0:3669:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88006ee718c0/0xfa8b5bed87891fbe lrc: 0/0,0 mode: --/TXN res: [0x200000403:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 21028 initiator: MDT0 00010000:00010000:2.0:1715207783.464010:0:3669:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88012ed4d200/0xfa8b5bed87892027 lrc: 3/0,1 mode: TXN/TXN res: [0x200000403:0x5:0x0].0xbce5108a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 21028 initiator: MDT0 00010000:00010000:2.0:1715207783.464015:0:3669:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012ed4d200/0xfa8b5bed87892027 lrc: 2/0,0 mode: TXN/TXN res: [0x200000403:0x5:0x0].0xbce5108a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 21028 initiator: MDT0 00010000:00010000:2.0:1715207783.464021:0:3669:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012ed4d200/0xfa8b5bed87892027 lrc: 3/0,0 mode: TXN/TXN res: [0x200000403:0x5:0x0].0xbce5108a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 21028 initiator: MDT0 00010000:00010000:2.0:1715207783.464026:0:3669:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88012ed4d200 already unused, calling callback (ffffffffa0eef730) 00010000:00010000:2.0:1715207783.464028:0:3669:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012ed4d200/0xfa8b5bed87892027 lrc: 3/0,0 mode: TXN/TXN res: [0x200000403:0x5:0x0].0xbce5108a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 21028 initiator: MDT0 00010000:00010000:2.0:1715207783.464042:0:3669:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012ed4d200/0xfa8b5bed87892027 lrc: 4/0,0 mode: TXN/TXN res: [0x200000403:0x5:0x0].0xbce5108a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 21028 initiator: MDT0 00010000:00010000:2.0:1715207783.464050:0:3669:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x5:0x0].0xbce5108a (ffff88009dced000) 00010000:00010000:2.0:1715207783.464052:0:3669:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1715207783.464055:0:3669:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012ed4d200/0xfa8b5bed87892027 lrc: 2/0,0 mode: --/TXN res: [0x200000403:0x5:0x0].0xbce5108a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 21028 initiator: MDT0 00010000:00010000:2.0:1715207783.464060:0:3669:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012ed4d200/0xfa8b5bed87892027 lrc: 0/0,0 mode: --/TXN res: [0x200000403:0x5:0x0].0xbce5108a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 21028 initiator: MDT0 00010000:00010000:3.0:1715207783.802095:0:9401:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1715207784.013243:0:16506:0:(debug.c:705:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-hsm test 15: Rebind a list of files ============ 18:36:23 (1715207783) 00000100:00100000:0.0:1715207784.119989:0:3678:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:1.0:1715207784.120106:0:7123:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798523505026112 00000100:00100000:1.0:1715207784.120122:0:7123:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798523505026112 00000100:00080000:0.0:1715207784.120195:0:7120:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 older than 1715207754 00000100:00100000:1.0:1715207784.120217:0:7123:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 360 00000100:00100000:1.0:1715207784.120231:0:7123:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009dd8a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1bc50a3e-f07c-4b55-83c3-5f3c3d406528+20:31763:x1798523505026112:12345-192.168.201.23@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1715207784.120266:0:7123:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1715207784.120355:0:7123:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009e3bf840/0xfa8b5bed8789203c lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7561918bd55701a7 expref: -99 pid: 7123 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715207784.120443:0:7123:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009e3bd8c0/0xfa8b5bed87892043 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7123 initiator: MDT0 00010000:00010000:1.0:1715207784.120460:0:7123:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009e3bd8c0/0xfa8b5bed87892043 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7123 initiator: MDT0 00010000:00010000:1.0:1715207784.120491:0:7123:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009e3bd8c0/0xfa8b5bed87892043 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7123 initiator: MDT0 00010000:00010000:1.0:1715207784.120505:0:7123:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009e3be880/0xfa8b5bed8789204a lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x646966 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7123 initiator: MDT0 00010000:00010000:1.0:1715207784.120512:0:7123:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009e3be880/0xfa8b5bed8789204a lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x646966 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7123 initiator: MDT0 00010000:00010000:1.0:1715207784.120518:0:7123:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009e3be880/0xfa8b5bed8789204a lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x646966 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7123 initiator: MDT0 00000004:00200000:1.0:1715207784.120611:0:7123:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 4096 00010000:00010000:1.0:1715207784.120696:0:7123:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009e3bd8c0/0xfa8b5bed87892043 lrc: 4/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7123 initiator: MDT0 00010000:00010000:1.0:1715207784.120717:0:7123:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009e3bd8c0/0xfa8b5bed87892043 lrc: 4/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7123 initiator: MDT0 00010000:00010000:1.0:1715207784.120724:0:7123:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009e3bd8c0/0xfa8b5bed87892043 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7123 initiator: MDT0 00010000:00010000:1.0:1715207784.120732:0:7123:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009e3bd8c0/0xfa8b5bed87892043 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7123 initiator: MDT0 00010000:00010000:1.0:1715207784.120738:0:7123:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88009e3bd8c0 already unused, calling callback (ffffffffa0eef730) 00010000:00010000:1.0:1715207784.120742:0:7123:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009e3bd8c0/0xfa8b5bed87892043 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7123 initiator: MDT0 00010000:00010000:1.0:1715207784.120750:0:7123:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009e3bd8c0/0xfa8b5bed87892043 lrc: 5/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7123 initiator: MDT0 00010000:00010000:1.0:1715207784.120764:0:7123:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff8801303a6000) 00010000:00010000:1.0:1715207784.120768:0:7123:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1715207784.120772:0:7123:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009e3bd8c0/0xfa8b5bed87892043 lrc: 3/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7123 initiator: MDT0 00010000:00010000:1.0:1715207784.120779:0:7123:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009e3bd8c0/0xfa8b5bed87892043 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7123 initiator: MDT0 00010000:00010000:1.0:1715207784.120837:0:7123:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009e3be880/0xfa8b5bed8789204a lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x646966 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7123 initiator: MDT0 00010000:00010000:1.0:1715207784.120847:0:7123:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009e3be880/0xfa8b5bed8789204a lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x646966 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7123 initiator: MDT0 00010000:00010000:1.0:1715207784.120856:0:7123:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009e3be880/0xfa8b5bed8789204a lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x646966 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7123 initiator: MDT0 00010000:00010000:1.0:1715207784.120864:0:7123:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88009e3be880 already unused, calling callback (ffffffffa0eef730) 00010000:00010000:1.0:1715207784.120906:0:7123:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009e3be880/0xfa8b5bed8789204a lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x646966 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7123 initiator: MDT0 00010000:00010000:1.0:1715207784.120917:0:7123:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009e3be880/0xfa8b5bed8789204a lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x646966 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7123 initiator: MDT0 00010000:00010000:1.0:1715207784.120932:0:7123:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x646966 (ffff88012d095a00) 00010000:00010000:1.0:1715207784.120936:0:7123:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1715207784.120941:0:7123:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009e3be880/0xfa8b5bed8789204a lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x646966 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7123 initiator: MDT0 00010000:00010000:1.0:1715207784.120951:0:7123:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009e3be880/0xfa8b5bed8789204a lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x646966 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7123 initiator: MDT0 00010000:00010000:1.0:1715207784.121006:0:7123:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009e3bf840/0xfa8b5bed8789203c lrc: 1/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.23@tcp remote: 0x7561918bd55701a7 expref: 22 pid: 7123 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715207784.121020:0:7123:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009e3bf840/0xfa8b5bed8789203c lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.23@tcp remote: 0x7561918bd55701a7 expref: 22 pid: 7123 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715207784.121034:0:7123:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009e3bf840, rc 0) 00000100:00100000:1.0:1715207784.121106:0:7123:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009dd8a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1bc50a3e-f07c-4b55-83c3-5f3c3d406528+21:31763:x1798523505026112:12345-192.168.201.23@tcp:101:lhsmtool_posix.0 Request processed in 875us (1127us total) trans 4294967425 rc 301/301 00000100:00100000:1.0:1715207784.121120:0:7123:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 360 00000100:00100000:0.0:1715207784.122167:0:3677:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:0.0:1715207784.122202:0:3677:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:0.0:1715207784.122236:0:3677:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:2.0:1715207784.122261:0:7118:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798523505026176 00000100:00100000:2.0:1715207784.122272:0:7118:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798523505026176 00000100:00100000:1.0:1715207784.122283:0:7123:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798523505026304 00000100:00100000:1.0:1715207784.122292:0:7123:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798523505026304 00000100:00100000:0.0:1715207784.122300:0:3677:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:2.0:1715207784.122321:0:7118:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 1343 00000100:00100000:1.0:1715207784.122328:0:7123:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798523505026240 00000100:00100000:2.0:1715207784.122329:0:7118:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a86c2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7e7a1b67-d841-4c3c-9f35-ded8f965b8dd+12:2003:x1798523505026176:12345-192.168.201.23@tcp:400:kworker.0 00000100:00100000:0.0:1715207784.122331:0:9918:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798523505026368 00000100:00100000:1.0:1715207784.122332:0:7123:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798523505026240 00000100:00100000:0.0:1715207784.122335:0:9918:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798523505026368 00000100:00100000:1.0:1715207784.122357:0:7123:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 3871 00000100:00100000:1.0:1715207784.122368:0:7123:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009dd89f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1bc50a3e-f07c-4b55-83c3-5f3c3d406528+9:2003:x1798523505026304:12345-192.168.201.23@tcp:400:kworker.0 00000100:00100000:0.0:1715207784.122369:0:9918:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 2061 00000100:00100000:0.0:1715207784.122377:0:9918:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009dd89c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:1bc50a3e-f07c-4b55-83c3-5f3c3d406528+7:2003:x1798523505026368:12345-192.168.201.23@tcp:400:kworker.0 00000100:00100000:2.0:1715207784.122378:0:7118:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a86c2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7e7a1b67-d841-4c3c-9f35-ded8f965b8dd+12:2003:x1798523505026176:12345-192.168.201.23@tcp:400:kworker.0 Request processed in 49us (215us total) trans 0 rc 0/0 00000100:00100000:3.0:1715207784.122382:0:6554:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 3872 00000100:00100000:2.0:1715207784.122386:0:7118:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 1343 00000100:00100000:3.0:1715207784.122394:0:6554:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009dd88700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:04532c2b-e5e9-420d-abb0-4480aab1e378+8:2003:x1798523505026240:12345-192.168.201.23@tcp:400:kworker.0 00000100:00100000:0.0:1715207784.122421:0:9918:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009dd89c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:1bc50a3e-f07c-4b55-83c3-5f3c3d406528+7:2003:x1798523505026368:12345-192.168.201.23@tcp:400:kworker.0 Request processed in 42us (120us total) trans 0 rc 0/0 00000100:00100000:1.0:1715207784.122430:0:7123:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009dd89f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1bc50a3e-f07c-4b55-83c3-5f3c3d406528+9:2003:x1798523505026304:12345-192.168.201.23@tcp:400:kworker.0 Request processed in 63us (226us total) trans 0 rc 0/0 00000100:00100000:0.0:1715207784.122432:0:9918:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 2061 00000100:00100000:3.0:1715207784.122445:0:6554:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009dd88700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:04532c2b-e5e9-420d-abb0-4480aab1e378+8:2003:x1798523505026240:12345-192.168.201.23@tcp:400:kworker.0 Request processed in 53us (210us total) trans 0 rc 0/0 00000100:00100000:1.0:1715207784.122451:0:7123:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 3871 00000100:00100000:3.0:1715207784.122456:0:6554:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 3872 00000100:00080000:0.0:1715207784.122461:0:7120:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 older than 1715207754 00000100:00080000:0.0:1715207784.122465:0:7120:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 older than 1715207754 00000100:00080000:0.0:1715207784.122468:0:7120:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd MGS older than 1715207754 00000100:00100000:0.0:1715207784.122924:0:3676:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:3.0:1715207784.123042:0:6554:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798523505026432 00000100:00100000:3.0:1715207784.123051:0:6554:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798523505026432 00000100:00100000:3.0:1715207784.123097:0:6554:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 361 00000100:00100000:3.0:1715207784.123105:0:6554:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cd95500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:1bc50a3e-f07c-4b55-83c3-5f3c3d406528+21:31763:x1798523505026432:12345-192.168.201.23@tcp:59:lhsmtool_posix.0 00000100:00100000:3.0:1715207784.123182:0:6554:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cd95500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:1bc50a3e-f07c-4b55-83c3-5f3c3d406528+21:31763:x1798523505026432:12345-192.168.201.23@tcp:59:lhsmtool_posix.0 Request processed in 76us (259us total) trans 0 rc 0/0 00000100:00100000:3.0:1715207784.123217:0:6554:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 361 00000100:00100000:2.0:1715207784.124246:0:3678:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:0.0:1715207784.124306:0:6554:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798523505026496 00000100:00100000:0.0:1715207784.124315:0:6554:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798523505026496 00000100:00100000:0.0:1715207784.124358:0:6554:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 362 00000100:00100000:0.0:1715207784.124370:0:6554:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88006ee7aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:1bc50a3e-f07c-4b55-83c3-5f3c3d406528+9:31763:x1798523505026496:12345-192.168.201.23@tcp:59:lhsmtool_posix.0 00000100:00100000:0.0:1715207784.124458:0:6554:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88006ee7aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:1bc50a3e-f07c-4b55-83c3-5f3c3d406528+9:31763:x1798523505026496:12345-192.168.201.23@tcp:59:lhsmtool_posix.0 Request processed in 87us (214us total) trans 0 rc 0/0 00000100:00100000:0.0:1715207784.124469:0:6554:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 362 00000100:00100000:0.0:1715207784.148974:0:3677:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:0.0:1715207784.149027:0:3677:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:2.0:1715207784.149105:0:6554:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798523505026752 00000100:00100000:1.0:1715207784.149116:0:7122:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798523505026880 00000100:00100000:2.0:1715207784.149118:0:6554:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798523505026752 00000100:00100000:1.0:1715207784.149124:0:7122:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798523505026880 00000100:00100000:2.0:1715207784.149191:0:6554:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 363 00000100:00100000:2.0:1715207784.149203:0:6554:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cd96680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:1bc50a3e-f07c-4b55-83c3-5f3c3d406528+10:2001:x1798523505026752:12345-192.168.201.23@tcp:41:mkdir.0 00000100:00100000:1.0:1715207784.149209:0:7122:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 364 00000100:00100000:1.0:1715207784.149220:0:7122:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801247dbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1bc50a3e-f07c-4b55-83c3-5f3c3d406528+10:31769:x1798523505026880:12345-192.168.201.23@tcp:36:mkdir.0 00000004:00000024:2.0:1715207784.149246:0:6554:0:(mdt_handler.c:569:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446309888 avail 1316847616 00000100:00100000:2.0:1715207784.149318:0:6554:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cd96680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:1bc50a3e-f07c-4b55-83c3-5f3c3d406528+10:2001:x1798523505026752:12345-192.168.201.23@tcp:41:mkdir.0 Request processed in 114us (346us total) trans 0 rc 0/0 00000100:00100000:1.0:1715207784.149328:0:7122:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88009e304700 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-mdtlov_UUID:7122:1798523510610752:0@lo:1000:mdt00_000.0 00000100:00100000:2.0:1715207784.149331:0:6554:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 363 00000100:00100000:1.0:1715207784.149377:0:7122:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1715207784.149412:0:7122:0:(client.c:2542:ptlrpc_set_wait()) set ffff88011dd66b40 going to sleep for 11 seconds 00000100:00100000:0.0:1715207784.149446:0:8276:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798523510610752 00000100:00100000:0.0:1715207784.149453:0:8276:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798523510610752 00000100:00100000:0.0:1715207784.149502:0:8276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1715 00000100:00100000:0.0:1715207784.149511:0:8276:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e304e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:7122:x1798523510610752:12345-0@lo:1000:mdt00_000.0 00000100:00100000:0.0:1715207784.149597:0:8276:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e304e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:7122:x1798523510610752:12345-0@lo:1000:mdt00_000.0 Request processed in 83us (216us total) trans 0 rc 0/0 00000100:00100000:0.0:1715207784.149608:0:8276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1715 00000100:00100000:1.0:1715207784.149627:0:7122:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88009e304700 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-mdtlov_UUID:7122:1798523510610752:0@lo:1000:mdt00_000.0 00000100:00100000:1.0:1715207784.149687:0:7122:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88009e304700 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-mdtlov_UUID:7122:1798523510610816:0@lo:1000:mdt00_000.0 00000100:00100000:1.0:1715207784.149719:0:7122:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1715207784.149734:0:7122:0:(client.c:2542:ptlrpc_set_wait()) set ffff88011dd66b40 going to sleep for 11 seconds 00000100:00100000:0.0:1715207784.149749:0:8276:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798523510610816 00000100:00100000:0.0:1715207784.149755:0:8276:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798523510610816 00000100:00100000:0.0:1715207784.149780:0:8276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1716 00000100:00100000:0.0:1715207784.149788:0:8276:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801300b0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:7122:x1798523510610816:12345-0@lo:1000:mdt00_000.0 00000100:00100000:0.0:1715207784.149951:0:8276:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8801300b0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:7122:x1798523510610816:12345-0@lo:1000:mdt00_000.0 Request processed in 160us (228us total) trans 0 rc -2/-2 00000100:00100000:0.0:1715207784.149962:0:8276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1716 00000100:00100000:1.0:1715207784.149999:0:7122:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88009e304700 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-mdtlov_UUID:7122:1798523510610816:0@lo:1000:mdt00_000.0 00010000:00010000:1.0:1715207784.150052:0:7122:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff88009e3bdd40/0xfa8b5bed87892058 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 7122 initiator: MDT0 00010000:00010000:1.0:1715207784.150067:0:7122:0:(ldlm_request.c:1038:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff88009e3bdd40/0xfa8b5bed87892058 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 7122 initiator: MDT1 00010000:00010000:1.0:1715207784.150081:0:7122:0:(ldlm_request.c:1125:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff88009e3bdd40/0xfa8b5bed87892058 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x1000000000000 pid: 7122 initiator: MDT1 00000100:00100000:1.0:1715207784.150097:0:7122:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8801300b0a80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-mdtlov_UUID:7122:1798523510610880:0@lo:101:mdt00_000.0 00000100:00100000:1.0:1715207784.150130:0:7122:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1715207784.150160:0:7122:0:(client.c:2542:ptlrpc_set_wait()) set ffff88011dd669c0 going to sleep for 11 seconds 00000100:00100000:0.0:1715207784.150194:0:8276:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798523510610880 00000100:00100000:0.0:1715207784.150201:0:8276:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798523510610880 00000100:00100000:0.0:1715207784.150226:0:8276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1717 00000100:00100000:0.0:1715207784.150234:0:8276:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801300b0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:7122:x1798523510610880:12345-0@lo:101:mdt00_000.0 00010000:00010000:0.0:1715207784.150248:0:8276:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1715207784.150264:0:8276:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a8fdfcc0/0xfa8b5bed8789205f lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfa8b5bed87892058 expref: -99 pid: 8276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715207784.150294:0:8276:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88006ee72400/0xfa8b5bed87891fcc lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.23@tcp remote: 0x7561918bd557016f expref: 20 pid: 21028 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715207784.150310:0:8276:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a8fdfcc0/0xfa8b5bed8789205f lrc: 4/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xfa8b5bed87892058 expref: 7 pid: 8276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715207784.150351:0:8276:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88006ee72400/0xfa8b5bed87891fcc lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.23@tcp remote: 0x7561918bd557016f expref: 20 pid: 21028 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715207784.150371:0:8276:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88006ee72400/0xfa8b5bed87891fcc lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.23@tcp remote: 0x7561918bd557016f expref: 20 pid: 21028 timeout: 2236 lvb_type: 0 00000100:00100000:0.0:1715207784.150389:0:8276:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8801247d9880 pname:cluuid:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000_UUID:8276:1798523510610944:192.168.201.23@tcp:104: 00000100:00100000:0.0:1715207784.150441:0:8276:0:(client.c:2542:ptlrpc_set_wait()) set ffff88009e3bac00 going to sleep for 11 seconds 00000100:00100000:2.0:1715207784.151847:0:8276:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff8801247d9880 pname:cluuid:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000_UUID:8276:1798523510610944:192.168.201.23@tcp:104: 00010000:00010000:2.0:1715207784.151877:0:8276:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a8fdfcc0/0xfa8b5bed8789205f lrc: 3/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xfa8b5bed87892058 expref: 7 pid: 8276 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715207784.151920:0:8276:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88012e8ee500) 00010000:00010000:2.0:1715207784.151923:0:8276:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1715207784.151928:0:8276:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a8fdfcc0/0xfa8b5bed8789205f lrc: 3/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xfa8b5bed87892058 expref: 7 pid: 8276 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715207784.151938:0:8276:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a8fdfcc0, rc 0) 00000100:00100000:2.0:1715207784.151994:0:8276:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8801300b0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+7:7122:x1798523510610880:12345-0@lo:101:mdt00_000.0 Request processed in 1759us (1863us total) trans 0 rc 0/0 00000100:00100000:2.0:1715207784.152002:0:8276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1717 00000100:00100000:1.0:1715207784.152053:0:7122:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff8801300b0a80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-mdtlov_UUID:7122:1798523510610880:0@lo:101:mdt00_000.0 00010000:00010000:1.0:1715207784.152093:0:7122:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff88009e3bdd40/0xfa8b5bed87892058 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xfa8b5bed8789205f expref: -99 pid: 7122 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715207784.152110:0:7122:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: lustre-MDT0000-osp-MDT0001 lock: ffff88009e3bdd40/0xfa8b5bed87892058 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xfa8b5bed8789205f expref: -99 pid: 7122 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1715207784.152265:0:3678:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:1.0:1715207784.152333:0:8263:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798523505026944 00000100:00100000:1.0:1715207784.152341:0:8263:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798523505026944 00010000:00010000:1.0:1715207784.152368:0:8263:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88006ee72400/0xfa8b5bed87891fcc lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.23@tcp remote: 0x7561918bd557016f expref: 21 pid: 21028 timeout: 2236 lvb_type: 0 00000100:00100000:1.0:1715207784.152410:0:8263:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 121 00000100:00100000:1.0:1715207784.152418:0:8263:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801247d8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1bc50a3e-f07c-4b55-83c3-5f3c3d406528+21:2003:x1798523505026944:12345-192.168.201.23@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1715207784.152431:0:8263:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1715207784.152437:0:8263:0:(ldlm_lockd.c:1837:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88006ee72400/0xfa8b5bed87891fcc lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.23@tcp remote: 0x7561918bd557016f expref: 21 pid: 21028 timeout: 2236 lvb_type: 0 00010000:00010000:1.0:1715207784.152449:0:8263:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88006ee72400/0xfa8b5bed87891fcc lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.23@tcp remote: 0x7561918bd557016f expref: 21 pid: 21028 timeout: 2236 lvb_type: 0 00010000:00010000:1.0:1715207784.152467:0:8263:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88006ee72400/0xfa8b5bed87891fcc lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.23@tcp remote: 0x7561918bd557016f expref: 21 pid: 21028 timeout: 2236 lvb_type: 0 00010000:00010000:1.0:1715207784.152495:0:8263:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88012e8ee500) 00010000:00010000:1.0:1715207784.152504:0:8263:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a8fdfcc0/0xfa8b5bed8789205f lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xfa8b5bed87892058 expref: 6 pid: 8276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715207784.152521:0:8263:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a8fdfcc0/0xfa8b5bed8789205f lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40080000000000 nid: 0@lo remote: 0xfa8b5bed87892058 expref: 6 pid: 8276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715207784.152545:0:8263:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a8fdfcc0/0xfa8b5bed8789205f lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40080000000000 nid: 0@lo remote: 0xfa8b5bed87892058 expref: 6 pid: 8276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715207784.152581:0:8263:0:(ldlm_lockd.c:1135:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800a8fdfcc0/0xfa8b5bed8789205f lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xfa8b5bed87892058 expref: 6 pid: 8276 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1715207784.152597:0:8263:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88009e304700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-MDT0000_UUID:8263:1798523510611008:0@lo:105: 00000100:00100000:1.0:1715207784.152634:0:8263:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1715207784.152668:0:8263:0:(client.c:2542:ptlrpc_set_wait()) set ffff88011dd669c0 going to sleep for 11 seconds 00000100:00100000:2.0:1715207784.152745:0:8262:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798523510611008 00000100:00100000:2.0:1715207784.152756:0:8262:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798523510611008 00000100:00080000:0.0:1715207784.152850:0:7120:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000-osp-MDT0001 older than 1715207754 00000100:00100000:2.0:1715207784.152859:0:8262:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:2.0:1715207784.152867:0:8262:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e33ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:lustre-MDT0001-mdtlov_UUID+4:8263:x1798523510611008:12345-0@lo:105: 00010000:00010000:2.0:1715207784.152910:0:8262:0:(ldlm_lockd.c:2548:ldlm_callback_handler()) ### completion ast ns: lustre-MDT0000-osp-MDT0001 lock: ffff88009e3bdd40/0xfa8b5bed87892058 lrc: 5/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xfa8b5bed8789205f expref: -99 pid: 7122 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715207784.152923:0:8262:0:(ldlm_lockd.c:2006:ldlm_handle_cp_callback()) ### client completion callback handler START ns: lustre-MDT0000-osp-MDT0001 lock: ffff88009e3bdd40/0xfa8b5bed87892058 lrc: 5/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xfa8b5bed8789205f expref: -99 pid: 7122 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715207784.152933:0:8262:0:(ldlm_lockd.c:2083:ldlm_handle_cp_callback()) ### completion AST, new policy data ns: lustre-MDT0000-osp-MDT0001 lock: ffff88009e3bdd40/0xfa8b5bed87892058 lrc: 5/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xfa8b5bed8789205f expref: -99 pid: 7122 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715207784.152940:0:8262:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: lustre-MDT0000-osp-MDT0001 lock: ffff88009e3bdd40/0xfa8b5bed87892058 lrc: 5/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0xfa8b5bed8789205f expref: -99 pid: 7122 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715207784.152962:0:8262:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff88009e3bdd40/0xfa8b5bed87892058 lrc: 6/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0xfa8b5bed8789205f expref: -99 pid: 7122 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715207784.152972:0:8262:0:(ldlm_lockd.c:2111:ldlm_handle_cp_callback()) ### callback handler finished, about to run_ast_work ns: lustre-MDT0000-osp-MDT0001 lock: ffff88009e3bdd40/0xfa8b5bed87892058 lrc: 6/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1080000000000 nid: local remote: 0xfa8b5bed8789205f expref: -99 pid: 7122 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715207784.152999:0:8262:0:(ldlm_lockd.c:2122:ldlm_handle_cp_callback()) ### client completion callback handler END (lock ffff88009e3bdd40) 00010000:00010000:1.0:1715207784.153033:0:7122:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: lustre-MDT0000-osp-MDT0001 lock: ffff88009e3bdd40/0xfa8b5bed87892058 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xfa8b5bed8789205f expref: -99 pid: 7122 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715207784.153048:0:7122:0:(ldlm_request.c:808:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff88009e3bdd40/0xfa8b5bed87892058 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xfa8b5bed8789205f expref: -99 pid: 7122 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1715207784.153051:0:8262:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e33ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:lustre-MDT0001-mdtlov_UUID+4:8263:x1798523510611008:12345-0@lo:105: Request processed in 183us (416us total) trans 0 rc 0/0 00000100:00100000:2.0:1715207784.153059:0:8262:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000004:00080000:1.0:1715207784.153074:0:7122:0:(osp_object.c:1397:osp_invalidate()) Invalidate osp_object [0x200000007:0x1:0x0] 00000100:00100000:0.0:1715207784.153099:0:8263:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88009e304700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-MDT0000_UUID:8263:1798523510611008:0@lo:105: 00010000:00010000:1.0:1715207784.153104:0:7122:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff88009e3be1c0/0xfa8b5bed87892066 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xbcee1078 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 7122 initiator: MDT0 00010000:00010000:1.0:1715207784.153115:0:7122:0:(ldlm_request.c:1038:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff88009e3be1c0/0xfa8b5bed87892066 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xbcee1078 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 7122 initiator: MDT1 00010000:00010000:0.0:1715207784.153117:0:8263:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1715207784.153127:0:7122:0:(ldlm_request.c:1125:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff88009e3be1c0/0xfa8b5bed87892066 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xbcee1078 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 7122 initiator: MDT1 00000100:00100000:1.0:1715207784.153145:0:7122:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88009e33c700 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-mdtlov_UUID:7122:1798523510611072:0@lo:101:mdt00_000.0 00000100:00100000:0.0:1715207784.153171:0:8263:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8801247d8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1bc50a3e-f07c-4b55-83c3-5f3c3d406528+20:2003:x1798523505026944:12345-192.168.201.23@tcp:103:ldlm_bl.0 Request processed in 750us (906us total) trans 0 rc 0/0 00000100:00100000:1.0:1715207784.153178:0:7122:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1715207784.153185:0:8263:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 121 00000100:00100000:1.0:1715207784.153209:0:7122:0:(client.c:2542:ptlrpc_set_wait()) set ffff88011dd66b40 going to sleep for 11 seconds 00000100:00100000:3.0:1715207784.153294:0:8276:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798523510611072 00000100:00100000:3.0:1715207784.153303:0:8276:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798523510611072 00000100:00100000:3.0:1715207784.153334:0:8276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1718 00000100:00100000:3.0:1715207784.153342:0:8276:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e33f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+7:7122:x1798523510611072:12345-0@lo:101:mdt00_000.0 00010000:00010000:3.0:1715207784.153355:0:8276:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1715207784.153370:0:8276:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88006ee72ac0/0xfa8b5bed8789206d lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xbcee1078 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfa8b5bed87892066 expref: -99 pid: 8276 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715207784.153390:0:8276:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88006ee72ac0/0xfa8b5bed8789206d lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xbcee1078 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xfa8b5bed87892066 expref: 8 pid: 8276 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715207784.153402:0:8276:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88006ee72ac0/0xfa8b5bed8789206d lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xbcee1078 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xfa8b5bed87892066 expref: 8 pid: 8276 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715207784.153410:0:8276:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xbcee1078 (ffff88011dd62100) 00010000:00010000:3.0:1715207784.153413:0:8276:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1715207784.153416:0:8276:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88006ee72ac0, rc 0) 00000100:00100000:3.0:1715207784.153455:0:8276:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e33f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+8:7122:x1798523510611072:12345-0@lo:101:mdt00_000.0 Request processed in 114us (276us total) trans 0 rc 0/0 00000100:00100000:3.0:1715207784.153463:0:8276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1718 00000100:00100000:1.0:1715207784.153472:0:7122:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88009e33c700 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-mdtlov_UUID:7122:1798523510611072:0@lo:101:mdt00_000.0 00010000:00010000:1.0:1715207784.153496:0:7122:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff88009e3be1c0/0xfa8b5bed87892066 lrc: 4/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xbcee1078 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xfa8b5bed8789206d expref: -99 pid: 7122 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715207784.153506:0:7122:0:(ldlm_request.c:808:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff88009e3be1c0/0xfa8b5bed87892066 lrc: 4/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xbcee1078 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xfa8b5bed8789206d expref: -99 pid: 7122 timeout: 0 lvb_type: 0 00000004:00080000:1.0:1715207784.153520:0:7122:0:(osp_object.c:1397:osp_invalidate()) Invalidate osp_object [0x200000007:0x1:0x0] 00000100:00100000:1.0:1715207784.153543:0:7122:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88009e33c700 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-mdtlov_UUID:7122:1798523510611136:0@lo:1000:mdt00_000.0 00000100:00100000:1.0:1715207784.153569:0:7122:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1715207784.153594:0:7122:0:(client.c:2542:ptlrpc_set_wait()) set ffff88011dd66480 going to sleep for 11 seconds 00000100:00100000:3.0:1715207784.153620:0:8276:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798523510611136 00000100:00100000:3.0:1715207784.153625:0:8276:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798523510611136 00000100:00100000:3.0:1715207784.153644:0:8276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1719 00000100:00100000:3.0:1715207784.153649:0:8276:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801300b0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+8:7122:x1798523510611136:12345-0@lo:1000:mdt00_000.0 00000100:00100000:3.0:1715207784.153705:0:8276:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8801300b0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+8:7122:x1798523510611136:12345-0@lo:1000:mdt00_000.0 Request processed in 55us (135us total) trans 0 rc 0/0 00000100:00100000:1.0:1715207784.153717:0:7122:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88009e33c700 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-mdtlov_UUID:7122:1798523510611136:0@lo:1000:mdt00_000.0 00000100:00100000:3.0:1715207784.153726:0:8276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1719 00000100:00100000:1.0:1715207784.153750:0:7122:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88009e33c700 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-mdtlov_UUID:7122:1798523510611200:0@lo:1000:mdt00_000.0 00000100:00100000:1.0:1715207784.153769:0:7122:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1715207784.153779:0:7122:0:(client.c:2542:ptlrpc_set_wait()) set ffff88011dd66480 going to sleep for 11 seconds 00000100:00100000:3.0:1715207784.153788:0:8276:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798523510611200 00000100:00100000:3.0:1715207784.153818:0:8276:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798523510611200 00000100:00100000:3.0:1715207784.153836:0:8276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1720 00000100:00100000:3.0:1715207784.153841:0:8276:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c8db800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+8:7122:x1798523510611200:12345-0@lo:1000:mdt00_000.0 00000100:00100000:3.0:1715207784.153937:0:8276:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c8db800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+8:7122:x1798523510611200:12345-0@lo:1000:mdt00_000.0 Request processed in 94us (165us total) trans 0 rc -2/-2 00000100:00100000:3.0:1715207784.153944:0:8276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1720 00000100:00100000:1.0:1715207784.153952:0:7122:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88009e33c700 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-mdtlov_UUID:7122:1798523510611200:0@lo:1000:mdt00_000.0 00000100:00100000:1.0:1715207784.154012:0:7122:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88012c8d8a80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-mdtlov_UUID:7122:1798523510611264:0@lo:1000:mdt00_000.0 00000100:00100000:1.0:1715207784.154034:0:7122:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1715207784.154057:0:7122:0:(client.c:2542:ptlrpc_set_wait()) set ffff88011dd66480 going to sleep for 11 seconds 00000100:00100000:3.0:1715207784.154078:0:8276:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798523510611264 00000100:00100000:3.0:1715207784.154082:0:8276:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798523510611264 00000100:00100000:3.0:1715207784.154100:0:8276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1721 00000100:00100000:3.0:1715207784.154105:0:8276:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c8d8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+8:7122:x1798523510611264:12345-0@lo:1000:mdt00_000.0 00000100:00100000:3.0:1715207784.154159:0:8276:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c8d8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+8:7122:x1798523510611264:12345-0@lo:1000:mdt00_000.0 Request processed in 53us (123us total) trans 0 rc -2/-2 00000100:00100000:3.0:1715207784.154165:0:8276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1721 00000100:00100000:1.0:1715207784.154170:0:7122:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88012c8d8a80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-mdtlov_UUID:7122:1798523510611264:0@lo:1000:mdt00_000.0 00000100:00100000:1.0:1715207784.154210:0:7122:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88012c8d8a80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-mdtlov_UUID:7122:1798523510611328:0@lo:1000:mdt00_000.0 00000100:00100000:1.0:1715207784.154229:0:7122:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1715207784.154239:0:7122:0:(client.c:2542:ptlrpc_set_wait()) set ffff88011dd66480 going to sleep for 11 seconds 00000100:00100000:3.0:1715207784.154241:0:8276:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798523510611328 00000100:00100000:3.0:1715207784.154244:0:8276:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798523510611328 00000100:00100000:3.0:1715207784.154258:0:8276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1722 00000100:00100000:3.0:1715207784.154262:0:8276:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c8d9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+8:7122:x1798523510611328:12345-0@lo:1000:mdt00_000.0 00000100:00100000:3.0:1715207784.154304:0:8276:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c8d9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+8:7122:x1798523510611328:12345-0@lo:1000:mdt00_000.0 Request processed in 41us (74us total) trans 0 rc 0/0 00000100:00100000:3.0:1715207784.154310:0:8276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1722 00000100:00100000:1.0:1715207784.154315:0:7122:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88012c8d8a80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-mdtlov_UUID:7122:1798523510611328:0@lo:1000:mdt00_000.0 00000100:00100000:1.0:1715207784.154351:0:7122:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88012c8d8a80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-mdtlov_UUID:7122:1798523510611392:0@lo:1000:mdt00_000.0 00000100:00100000:1.0:1715207784.154369:0:7122:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1715207784.154387:0:8276:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798523510611392 00000100:00100000:3.0:1715207784.154389:0:8276:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798523510611392 00000100:00100000:1.0:1715207784.154389:0:7122:0:(client.c:2542:ptlrpc_set_wait()) set ffff88011dd66480 going to sleep for 11 seconds 00000100:00100000:3.0:1715207784.154403:0:8276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1723 00000100:00100000:3.0:1715207784.154407:0:8276:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c8db480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+8:7122:x1798523510611392:12345-0@lo:1000:mdt00_000.0 00000100:00100000:3.0:1715207784.154463:0:8276:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c8db480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+8:7122:x1798523510611392:12345-0@lo:1000:mdt00_000.0 Request processed in 55us (93us total) trans 0 rc 0/0 00000100:00100000:3.0:1715207784.154471:0:8276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1723 00000100:00100000:1.0:1715207784.154477:0:7122:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88012c8d8a80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-mdtlov_UUID:7122:1798523510611392:0@lo:1000:mdt00_000.0 00000040:00080000:1.0:1715207784.155070:0:7122:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x240000400:0x2:0x0].4, 984 off36712 00000040:00080000:1.0:1715207784.155122:0:7122:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x200000401:0x2:0x0].4, 1136 off37320 00000004:00080000:1.0:1715207784.155127:0:7122:0:(osp_trans.c:1606:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff88011dd66b40 with version 10 00000004:00080000:0.0:1715207784.155202:0:8266:0:(osp_trans.c:1351:osp_get_next_request()) ou ffff88006fdd4480 version 10 rpc_version 10 00000020:00100000:0.0:1715207784.155229:0:8266:0:(genops.c:2297:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:0.0:1715207784.155239:0:8266:0:(client.c:765:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8801247d9880 x1798523510611520/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 2160/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 00000100:00100000:0.0:1715207784.155262:0:8266:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8801247d9880 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:8266:1798523510611520:0@lo:1000:osp_up0-1.0 00000100:00100000:0.0:1715207784.155300:0:8266:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1715207784.155328:0:8266:0:(client.c:2542:ptlrpc_set_wait()) set ffff88009e3baf00 going to sleep for 11 seconds 00000100:00100000:3.0:1715207784.155413:0:8276:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798523510611520 00000100:00100000:3.0:1715207784.155422:0:8276:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798523510611520 00000100:00100000:3.0:1715207784.155465:0:8276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1724 00000100:00100000:3.0:1715207784.155472:0:8276:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e304700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+8:8266:x1798523510611520:12345-0@lo:1000:osp_up0-1.0 00000100:00100000:3.0:1715207784.155868:0:8276:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e304700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+9:8266:x1798523510611520:12345-0@lo:1000:osp_up0-1.0 Request processed in 394us (565us total) trans 4294967426 rc 0/0 00000100:00100000:3.0:1715207784.155907:0:8276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1724 00000100:00100000:0.0:1715207784.155948:0:8266:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff8801247d9880 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:8266:1798523510611520:0@lo:1000:osp_up0-1.0 00010000:00010000:1.0:1715207784.156021:0:7122:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff88009e3bf600/0xfa8b5bed87892074 lrc: 3/0,1 mode: --/PW res: [0x240000403:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7122 initiator: MDT0 00010000:00010000:1.0:1715207784.156038:0:7122:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88009e3bf600/0xfa8b5bed87892074 lrc: 3/0,1 mode: PW/PW res: [0x240000403:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7122 initiator: MDT1 00010000:00010000:1.0:1715207784.156049:0:7122:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009e3bf600/0xfa8b5bed87892074 lrc: 3/0,1 mode: PW/PW res: [0x240000403:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7122 initiator: MDT1 00000004:00010000:1.0:1715207784.156064:0:7122:0:(mdt_handler.c:4256:mdt_save_lock()) ### save lock request ffff8801247dbb80 reply state ffff88009e2f8000 transno 4294967333 ns: mdt-lustre-MDT0001_UUID lock: ffff88009e3bf600/0xfa8b5bed87892074 lrc: 3/0,1 mode: PW/PW res: [0x240000403:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7122 initiator: MDT1 00010000:00010000:1.0:1715207784.156073:0:7122:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88009e3bf600/0xfa8b5bed87892074 lrc: 3/0,1 mode: TXN/TXN res: [0x240000403:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7122 initiator: MDT1 00010000:00010000:1.0:1715207784.156080:0:7122:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x5:0x0].0x0 (ffff88012d095a00) 00010000:00010000:1.0:1715207784.156083:0:7122:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1715207784.156086:0:7122:0:(service.c:188:ptlrpc_save_lock()) nlocks 0 00000004:00200000:1.0:1715207784.156090:0:7122:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x240000403:0x5:0x0]: returning size 4096 00000004:00080000:1.0:1715207784.156095:0:7122:0:(osp_object.c:1397:osp_invalidate()) Invalidate osp_object [0x200000007:0x1:0x0] 00010000:00010000:1.0:1715207784.156102:0:7122:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff88009e3bdd40/0xfa8b5bed87892058 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xfa8b5bed8789205f expref: -99 pid: 7122 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715207784.156110:0:7122:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff88009e3bdd40/0xfa8b5bed87892058 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xfa8b5bed8789205f expref: -99 pid: 7122 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715207784.156117:0:7122:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff88009e3bdd40/0xfa8b5bed87892058 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xfa8b5bed8789205f expref: -99 pid: 7122 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715207784.156160:0:7122:0:(ldlm_lockd.c:2227:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00080000:1.0:1715207784.156166:0:7122:0:(osp_object.c:1397:osp_invalidate()) Invalidate osp_object [0x200000007:0x1:0x0] 00010000:00010000:1.0:1715207784.156171:0:7122:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff88009e3be1c0/0xfa8b5bed87892066 lrc: 4/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xbcee1078 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xfa8b5bed8789206d expref: -99 pid: 7122 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715207784.156179:0:7122:0:(ldlm_lock.c:936:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-osp-MDT0001 lock: ffff88009e3be1c0/0xfa8b5bed87892066 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xbcee1078 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xfa8b5bed8789206d expref: -99 pid: 7122 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715207784.156194:0:7112:0:(ldlm_lockd.c:2857:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1715207784.156204:0:7112:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff88009e3bdd40/0xfa8b5bed87892058 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0xfa8b5bed8789205f expref: -99 pid: 7122 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715207784.156215:0:7112:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88009e3bdd40 already unused, calling callback (ffffffffa0ef0520) 00010000:00010000:3.0:1715207784.156222:0:7112:0:(ldlm_request.c:1300:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff88009e3bdd40/0xfa8b5bed87892058 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0xfa8b5bed8789205f expref: -99 pid: 7122 timeout: 0 lvb_type: 0 00000004:00010000:3.0:1715207784.156232:0:7112:0:(mdt_handler.c:3748:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff88009e3bdd40/0xfa8b5bed87892058 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0xfa8b5bed8789205f expref: -99 pid: 7122 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1715207784.156241:0:7122:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8801247dbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1bc50a3e-f07c-4b55-83c3-5f3c3d406528+11:31769:x1798523505026880:12345-192.168.201.23@tcp:36:mkdir.0 Request processed in 7020us (7210us total) trans 4294967333 rc 0/0 00000100:00100000:1.0:1715207784.156253:0:7122:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 364 00010000:00010000:3.0:1715207784.156259:0:7112:0:(ldlm_request.c:1347:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff88009e3bdd40/0xfa8b5bed87892058 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xfa8b5bed8789205f expref: -99 pid: 7122 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715207784.156266:0:7112:0:(ldlm_request.c:1389:_ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1715207784.156297:0:7112:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff88009e3bdd40/0xfa8b5bed87892058 lrc: 1/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xfa8b5bed8789205f expref: -99 pid: 7122 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715207784.156305:0:7112:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff88009e3bdd40/0xfa8b5bed87892058 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xfa8b5bed8789205f expref: -99 pid: 7122 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1715207784.156313:0:3686:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1715207784.156328:0:3686:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800a03f3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3686:1798523510611584:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1715207784.156330:0:7112:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1715207784.156332:0:7112:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1715207784.156335:0:7112:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1715207784.156364:0:3686:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1715207784.156392:0:8263:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798523510611584 00000100:00100000:0.0:1715207784.156399:0:8263:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798523510611584 00000100:00100000:0.0:1715207784.156451:0:8263:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1715207784.156459:0:8263:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c8d8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:lustre-MDT0001-mdtlov_UUID+9:3686:x1798523510611584:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1715207784.156471:0:8263:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1715207784.156486:0:8263:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a8fdfcc0/0xfa8b5bed8789205f lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0xfa8b5bed87892058 expref: 9 pid: 8276 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715207784.156520:0:8263:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88012e8ee500) 00010000:00010000:0.0:1715207784.156526:0:8263:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1715207784.156575:0:8263:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c8d8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:lustre-MDT0001-mdtlov_UUID+8:3686:x1798523510611584:12345-0@lo:103:ldlm_bl.0 Request processed in 114us (209us total) trans 0 rc 0/0 00000100:00100000:0.0:1715207784.156585:0:8263:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1715207784.156625:0:3686:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff8800a03f3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3686:1798523510611584:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1715207784.161477:0:3678:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:1.0:1715207784.161554:0:7122:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798523505027008 00000100:00100000:1.0:1715207784.161561:0:7122:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798523505027008 00000100:00100000:1.0:1715207784.161604:0:7122:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 365 00000100:00100000:1.0:1715207784.161611:0:7122:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801247cd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1bc50a3e-f07c-4b55-83c3-5f3c3d406528+20:31770:x1798523505027008:12345-192.168.201.23@tcp:101:rm.0 00010000:00010000:1.0:1715207784.161623:0:7122:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1715207784.161634:0:7122:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009e3be400/0xfa8b5bed8789207b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7561918bd55701c3 expref: -99 pid: 7122 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715207784.161675:0:7122:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009e3bed00/0xfa8b5bed87892082 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7122 initiator: MDT0 00010000:00010000:1.0:1715207784.161685:0:7122:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009e3bed00/0xfa8b5bed87892082 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7122 initiator: MDT0 00010000:00010000:1.0:1715207784.161702:0:7122:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009e3bed00/0xfa8b5bed87892082 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7122 initiator: MDT0 00000004:00200000:1.0:1715207784.161728:0:7122:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1715207784.161731:0:7122:0:(mdt_handler.c:1570:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1715207784.161744:0:7122:0:(mdt_handler.c:2451:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88009e3bed00/0xfa8b5bed87892082 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7122 initiator: MDT0 00010000:00010000:1.0:1715207784.161763:0:7122:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009e3be400/0xfa8b5bed8789207b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.23@tcp remote: 0x7561918bd55701c3 expref: 22 pid: 7122 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715207784.161816:0:7122:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009e3bed00/0xfa8b5bed87892082 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.23@tcp remote: 0x7561918bd55701c3 expref: 21 pid: 7122 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715207784.161828:0:7122:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88012e8ee500) 00010000:00010000:1.0:1715207784.161833:0:7122:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1715207784.161837:0:7122:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009e3bed00, rc 0) 00000100:00100000:1.0:1715207784.161919:0:7122:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8801247cd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1bc50a3e-f07c-4b55-83c3-5f3c3d406528+21:31770:x1798523505027008:12345-192.168.201.23@tcp:101:rm.0 Request processed in 304us (442us total) trans 0 rc 0/0 00000100:00100000:1.0:1715207784.161928:0:7122:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 365 00000100:00100000:0.0:1715207784.163575:0:3677:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:1.0:1715207784.163655:0:7122:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798523505027072 00000100:00100000:1.0:1715207784.163664:0:7122:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798523505027072 00000100:00100000:1.0:1715207784.163710:0:7122:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 366 00000100:00100000:1.0:1715207784.163717:0:7122:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801247ce300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1bc50a3e-f07c-4b55-83c3-5f3c3d406528+21:31770:x1798523505027072:12345-192.168.201.23@tcp:101:rm.0 00010000:00010000:1.0:1715207784.163730:0:7122:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1715207784.163742:0:7122:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009e3bfa80/0xfa8b5bed87892089 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7561918bd55701ca expref: -99 pid: 7122 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715207784.163779:0:7122:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009e3bfcc0/0xfa8b5bed87892090 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7122 initiator: MDT0 00010000:00010000:1.0:1715207784.163845:0:7122:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009e3bfcc0/0xfa8b5bed87892090 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7122 initiator: MDT0 00010000:00010000:1.0:1715207784.163854:0:7122:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009e3bfcc0/0xfa8b5bed87892090 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7122 initiator: MDT0 00010000:00010000:1.0:1715207784.163864:0:7122:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009e3bf3c0/0xfa8b5bed87892097 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xbcee1078 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7122 initiator: MDT0 00010000:00010000:1.0:1715207784.163873:0:7122:0:(ldlm_lock.c:701:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88006ee72ac0/0xfa8b5bed8789206d lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xbcee1078 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xfa8b5bed87892066 expref: 7 pid: 8276 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715207784.163906:0:7122:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009e3bf3c0/0xfa8b5bed87892097 lrc: 4/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xbcee1078 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7122 initiator: MDT0 00010000:00010000:1.0:1715207784.163928:0:7122:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88006ee72ac0/0xfa8b5bed8789206d lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xbcee1078 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 0@lo remote: 0xfa8b5bed87892066 expref: 7 pid: 8276 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1715207784.163940:0:7122:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88009e33c700 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:7122:1798523510611648:0@lo:104: 00000100:00100000:1.0:1715207784.163969:0:7122:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1715207784.163994:0:7122:0:(client.c:2542:ptlrpc_set_wait()) set ffff88011dd66780 going to sleep for 11 seconds 00000100:00100000:2.0:1715207784.164017:0:8262:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798523510611648 00000100:00100000:2.0:1715207784.164026:0:8262:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798523510611648 00000100:00100000:2.0:1715207784.164064:0:8262:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:2.0:1715207784.164071:0:8262:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007e4ee300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:lustre-MDT0001-mdtlov_UUID+4:7122:x1798523510611648:12345-0@lo:104: 00010000:00010000:2.0:1715207784.164082:0:8262:0:(ldlm_lockd.c:2536:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0000-osp-MDT0001 lock: ffff88009e3be1c0/0xfa8b5bed87892066 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xbcee1078 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1400000000000 nid: local remote: 0xfa8b5bed8789206d expref: -99 pid: 7122 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715207784.164140:0:8262:0:(ldlm_lockd.c:2227:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1715207784.164146:0:8262:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007e4ee300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:lustre-MDT0001-mdtlov_UUID+4:7122:x1798523510611648:12345-0@lo:104: Request processed in 75us (176us total) trans 0 rc 0/0 00010000:00010000:3.0:1715207784.164150:0:11642:0:(ldlm_lockd.c:2857:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000100:00100000:2.0:1715207784.164153:0:8262:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00010000:00010000:3.0:1715207784.164161:0:11642:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff88009e3be1c0/0xfa8b5bed87892066 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xbcee1078 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1400000000000 nid: local remote: 0xfa8b5bed8789206d expref: -99 pid: 7122 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1715207784.164172:0:7122:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88009e33c700 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:7122:1798523510611648:0@lo:104: 00010000:00010000:3.0:1715207784.164176:0:11642:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88009e3be1c0 already unused, calling callback (ffffffffa0ef0520) 00010000:00010000:3.0:1715207784.164183:0:11642:0:(ldlm_request.c:1300:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff88009e3be1c0/0xfa8b5bed87892066 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xbcee1078 bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x1408400000000 nid: local remote: 0xfa8b5bed8789206d expref: -99 pid: 7122 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715207784.164187:0:7122:0:(ldlm_request.c:293:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009e3bf3c0/0xfa8b5bed87892097 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xbcee1078 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7122 initiator: MDT0 00000004:00010000:3.0:1715207784.164195:0:11642:0:(mdt_handler.c:3748:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff88009e3be1c0/0xfa8b5bed87892066 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xbcee1078 bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x1409400000000 nid: local remote: 0xfa8b5bed8789206d expref: -99 pid: 7122 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715207784.164227:0:11642:0:(ldlm_request.c:1347:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff88009e3be1c0/0xfa8b5bed87892066 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xbcee1078 bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0xfa8b5bed8789206d expref: -99 pid: 7122 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715207784.164236:0:11642:0:(ldlm_request.c:1389:_ldlm_cancel_pack()) 1 locks packed 00000100:00100000:1.0:1715207784.164264:0:3686:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800a03f1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3686:1798523510611712:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1715207784.164268:0:11642:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff88009e3be1c0/0xfa8b5bed87892066 lrc: 1/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xbcee1078 bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0xfa8b5bed8789206d expref: -99 pid: 7122 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715207784.164279:0:11642:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff88009e3be1c0/0xfa8b5bed87892066 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xbcee1078 bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0xfa8b5bed8789206d expref: -99 pid: 7122 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1715207784.164287:0:3686:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1715207784.164307:0:11642:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1715207784.164309:0:11642:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1715207784.164311:0:11642:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1715207784.164354:0:8263:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798523510611712 00000100:00100000:0.0:1715207784.164361:0:8263:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798523510611712 00010000:00010000:0.0:1715207784.164379:0:8263:0:(ldlm_lockd.c:2706:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88006ee72ac0/0xfa8b5bed8789206d lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xbcee1078 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000400000020 nid: 0@lo remote: 0xfa8b5bed87892066 expref: 8 pid: 8276 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1715207784.164416:0:8263:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:0.0:1715207784.164424:0:8263:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88007e4edf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:lustre-MDT0001-mdtlov_UUID+8:3686:x1798523510611712:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1715207784.164436:0:8263:0:(ldlm_lockd.c:1792:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000001:00080000:0.0:1715207784.166366:0:7105:0:(tgt_lastrcvd.c:969:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967426 is committed 00000001:00080000:0.0:1715207784.166374:0:7105:0:(tgt_lastrcvd.c:969:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967425 is committed 00010000:00010000:2.0:1715207784.166535:0:8263:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88006ee72ac0/0xfa8b5bed8789206d lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xbcee1078 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 0@lo remote: 0xfa8b5bed87892066 expref: 7 pid: 8276 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715207784.166573:0:8263:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xbcee1078 (ffff88011dd62100) 00010000:00010000:2.0:1715207784.166578:0:8263:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff88009e3bf3c0/0xfa8b5bed87892097 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xbcee1078 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7122 initiator: MDT0 00010000:00010000:2.0:1715207784.166601:0:8263:0:(ldlm_lock.c:729:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009e3bf3c0/0xfa8b5bed87892097 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xbcee1078 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 7122 initiator: MDT0 00010000:00010000:2.0:1715207784.166608:0:8263:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009e3bf3c0/0xfa8b5bed87892097 lrc: 4/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xbcee1078 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 7122 initiator: MDT0 00010000:00010000:2.0:1715207784.166632:0:8263:0:(ldlm_lockd.c:1850:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1715207784.166673:0:8263:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88007e4edf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:lustre-MDT0001-mdtlov_UUID+6:3686:x1798523510611712:12345-0@lo:103:ldlm_bl.0 Request processed in 2248us (2383us total) trans 0 rc 0/0 00000100:00100000:2.0:1715207784.166682:0:8263:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00010000:00010000:1.0:1715207784.166686:0:7122:0:(ldlm_request.c:205:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009e3bf3c0/0xfa8b5bed87892097 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xbcee1078 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7122 initiator: MDT0 00010000:00010000:1.0:1715207784.166702:0:7122:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009e3bf3c0/0xfa8b5bed87892097 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xbcee1078 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7122 initiator: MDT0 00000100:00100000:0.0:1715207784.166705:0:3686:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff8800a03f1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3686:1798523510611712:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1715207784.166830:0:7122:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007e4ef800 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:7122:1798523510611776:0@lo:1000:mdt00_000.0 00000100:00100000:1.0:1715207784.166910:0:7122:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1715207784.166936:0:7122:0:(client.c:2542:ptlrpc_set_wait()) set ffff88011dd66540 going to sleep for 11 seconds 00000100:00100000:3.0:1715207784.166994:0:8276:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798523510611776 00000100:00100000:3.0:1715207784.167003:0:8276:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798523510611776 00000100:00100000:3.0:1715207784.167061:0:8276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1725 00000100:00100000:3.0:1715207784.167068:0:8276:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e33c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:7122:x1798523510611776:12345-0@lo:1000:mdt00_000.0 00000100:00100000:3.0:1715207784.167140:0:8276:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e33c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:7122:x1798523510611776:12345-0@lo:1000:mdt00_000.0 Request processed in 72us (264us total) trans 0 rc 0/0 00000100:00100000:3.0:1715207784.167148:0:8276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1725 00000100:00100000:1.0:1715207784.167158:0:7122:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88007e4ef800 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:7122:1798523510611776:0@lo:1000:mdt00_000.0 00010000:00010000:1.0:1715207784.167195:0:7122:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009e3be400/0xfa8b5bed8789209e lrc: 3/1,0 mode: --/PR res: [0x240000403:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7122 initiator: MDT0 00010000:00010000:1.0:1715207784.167206:0:7122:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009e3be400/0xfa8b5bed8789209e lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7122 initiator: MDT0 00010000:00010000:1.0:1715207784.167214:0:7122:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009e3be400/0xfa8b5bed8789209e lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7122 initiator: MDT0 00000004:00010000:1.0:1715207784.167228:0:7122:0:(mdt_handler.c:2451:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88009e3be400/0xfa8b5bed8789209e lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7122 initiator: MDT0 00010000:00010000:1.0:1715207784.167238:0:7122:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009e3bfcc0/0xfa8b5bed87892090 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7122 initiator: MDT0 00010000:00010000:1.0:1715207784.167244:0:7122:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009e3bfcc0/0xfa8b5bed87892090 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7122 initiator: MDT0 00010000:00010000:1.0:1715207784.167249:0:7122:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009e3bfcc0/0xfa8b5bed87892090 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7122 initiator: MDT0 00010000:00010000:1.0:1715207784.167255:0:7122:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009e3bfcc0/0xfa8b5bed87892090 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7122 initiator: MDT0 00010000:00010000:1.0:1715207784.167260:0:7122:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88009e3bfcc0 already unused, calling callback (ffffffffa0eef730) 00010000:00010000:1.0:1715207784.167264:0:7122:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009e3bfcc0/0xfa8b5bed87892090 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7122 initiator: MDT0 00010000:00010000:1.0:1715207784.167282:0:7122:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009e3bfcc0/0xfa8b5bed87892090 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7122 initiator: MDT0 00010000:00010000:1.0:1715207784.167292:0:7122:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88012e8ee500) 00010000:00010000:1.0:1715207784.167295:0:7122:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1715207784.167299:0:7122:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009e3bfcc0/0xfa8b5bed87892090 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7122 initiator: MDT0 00010000:00010000:1.0:1715207784.167305:0:7122:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009e3bfcc0/0xfa8b5bed87892090 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7122 initiator: MDT0 00010000:00010000:1.0:1715207784.167334:0:7122:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009e3bf3c0/0xfa8b5bed87892097 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xbcee1078 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7122 initiator: MDT0 00010000:00010000:1.0:1715207784.167344:0:7122:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009e3bf3c0/0xfa8b5bed87892097 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xbcee1078 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7122 initiator: MDT0 00010000:00010000:1.0:1715207784.167354:0:7122:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009e3bf3c0/0xfa8b5bed87892097 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xbcee1078 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7122 initiator: MDT0 00010000:00010000:1.0:1715207784.167362:0:7122:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88009e3bf3c0 already unused, calling callback (ffffffffa0eef730) 00010000:00010000:1.0:1715207784.167367:0:7122:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009e3bf3c0/0xfa8b5bed87892097 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xbcee1078 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7122 initiator: MDT0 00010000:00010000:1.0:1715207784.167377:0:7122:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009e3bf3c0/0xfa8b5bed87892097 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xbcee1078 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7122 initiator: MDT0 00010000:00010000:1.0:1715207784.167390:0:7122:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xbcee1078 (ffff88011dd62100) 00010000:00010000:1.0:1715207784.167394:0:7122:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1715207784.167398:0:7122:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009e3bf3c0/0xfa8b5bed87892097 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xbcee1078 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7122 initiator: MDT0 00010000:00010000:1.0:1715207784.167408:0:7122:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009e3bf3c0/0xfa8b5bed87892097 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xbcee1078 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7122 initiator: MDT0 00010000:00010000:1.0:1715207784.167453:0:7122:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009e3bfa80/0xfa8b5bed87892089 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.23@tcp remote: 0x7561918bd55701ca expref: 22 pid: 7122 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715207784.167472:0:7122:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009e3be400/0xfa8b5bed8789209e lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.23@tcp remote: 0x7561918bd55701ca expref: 21 pid: 7122 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715207784.167484:0:7122:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x5:0x0].0x0 (ffff88012d095400) 00010000:00010000:1.0:1715207784.167486:0:7122:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1715207784.167489:0:7122:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009e3be400, rc 0) 00000100:00100000:1.0:1715207784.167539:0:7122:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8801247ce300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1bc50a3e-f07c-4b55-83c3-5f3c3d406528+21:31770:x1798523505027072:12345-192.168.201.23@tcp:101:rm.0 Request processed in 3820us (3966us total) trans 0 rc 0/0 00000100:00100000:1.0:1715207784.167552:0:7122:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 366 00000100:00100000:0.0:1715207784.169145:0:3676:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:1.0:1715207784.169224:0:7122:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798523505027136 00000100:00100000:1.0:1715207784.169233:0:7122:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798523505027136 00000100:00100000:1.0:1715207784.169281:0:7122:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 367 00000100:00100000:1.0:1715207784.169289:0:7122:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880130390000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1bc50a3e-f07c-4b55-83c3-5f3c3d406528+11:31770:x1798523505027136:12345-192.168.201.23@tcp:101:rm.0 00010000:00010000:1.0:1715207784.169307:0:7122:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1715207784.169319:0:7122:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009e3bdd40/0xfa8b5bed878920a5 lrc: 2/0,0 mode: --/CR res: [0x240000403:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7561918bd55701d1 expref: -99 pid: 7122 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715207784.169353:0:7122:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88009e3bf840/0xfa8b5bed878920ac lrc: 3/1,0 mode: --/PR res: [0x240000403:0x5:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7122 initiator: MDT0 00010000:00010000:1.0:1715207784.169364:0:7122:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88009e3bf840/0xfa8b5bed878920ac lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x5:0x0].0x0 bits 0x10/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7122 initiator: MDT1 00010000:00010000:1.0:1715207784.169374:0:7122:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009e3bf840/0xfa8b5bed878920ac lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x5:0x0].0x0 bits 0x10/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7122 initiator: MDT1 00000004:00200000:1.0:1715207784.169414:0:7122:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x240000403:0x5:0x0]: returning size 4096 00000004:00200000:1.0:1715207784.169417:0:7122:0:(mdt_handler.c:1570:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00010000:00010000:1.0:1715207784.169444:0:7122:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009e3bdd40/0xfa8b5bed878920a5 lrc: 0/0,0 mode: --/CR res: [0x240000403:0x5:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.23@tcp remote: 0x7561918bd55701d1 expref: 13 pid: 7122 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715207784.169458:0:7122:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88009e3bf840/0xfa8b5bed878920ac lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x5:0x0].0x0 bits 0x10/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.23@tcp remote: 0x7561918bd55701d1 expref: 12 pid: 7122 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715207784.169465:0:7122:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x5:0x0].0x0 (ffff88012d095a00) 00010000:00010000:1.0:1715207784.169468:0:7122:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 10 00010000:00010000:1.0:1715207784.169471:0:7122:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009e3bf840, rc 0) 00000100:00100000:1.0:1715207784.169523:0:7122:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880130390000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1bc50a3e-f07c-4b55-83c3-5f3c3d406528+12:31770:x1798523505027136:12345-192.168.201.23@tcp:101:rm.0 Request processed in 231us (379us total) trans 0 rc 0/0 00000100:00100000:1.0:1715207784.169535:0:7122:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 367 00000100:00100000:0.0:1715207784.171337:0:3678:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:1.0:1715207784.171409:0:7122:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798523505027200 00000100:00100000:1.0:1715207784.171417:0:7122:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798523505027200 00000100:00100000:1.0:1715207784.171462:0:7122:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 368 00000100:00100000:1.0:1715207784.171472:0:7122:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e288000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1bc50a3e-f07c-4b55-83c3-5f3c3d406528+12:31770:x1798523505027200:12345-192.168.201.23@tcp:101:rm.0 00010000:00010000:1.0:1715207784.171486:0:7122:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1715207784.171498:0:7122:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009e3be880/0xfa8b5bed878920b3 lrc: 2/0,0 mode: --/CR res: [0x240000403:0x5:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7561918bd55701d8 expref: -99 pid: 7122 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715207784.171536:0:7122:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88009e3bd8c0/0xfa8b5bed878920ba lrc: 3/1,0 mode: --/CR res: [0x240000403:0x5:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7122 initiator: MDT0 00010000:00010000:1.0:1715207784.171547:0:7122:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88009e3bd8c0/0xfa8b5bed878920ba lrc: 3/1,0 mode: CR/CR res: [0x240000403:0x5:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7122 initiator: MDT1 00010000:00010000:1.0:1715207784.171555:0:7122:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009e3bd8c0/0xfa8b5bed878920ba lrc: 3/1,0 mode: CR/CR res: [0x240000403:0x5:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7122 initiator: MDT1 00010000:00010000:1.0:1715207784.171608:0:7122:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88009e3bcd80/0xfa8b5bed878920c1 lrc: 3/1,0 mode: --/PR res: [0x240000403:0x5:0x0].0x5efc94da bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7122 initiator: MDT0 00010000:00010000:1.0:1715207784.171617:0:7122:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88009e3bcd80/0xfa8b5bed878920c1 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x5:0x0].0x5efc94da bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7122 initiator: MDT1 00010000:00010000:1.0:1715207784.171624:0:7122:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009e3bcd80/0xfa8b5bed878920c1 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x5:0x0].0x5efc94da bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7122 initiator: MDT1 00010000:00010000:1.0:1715207784.171645:0:7122:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88009e3bd8c0/0xfa8b5bed878920ba lrc: 4/1,0 mode: CR/CR res: [0x240000403:0x5:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7122 initiator: MDT1 00010000:00010000:1.0:1715207784.171651:0:7122:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88009e3bd8c0/0xfa8b5bed878920ba lrc: 4/1,0 mode: CR/CR res: [0x240000403:0x5:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7122 initiator: MDT1 00010000:00010000:1.0:1715207784.171656:0:7122:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88009e3bd8c0/0xfa8b5bed878920ba lrc: 3/0,0 mode: CR/CR res: [0x240000403:0x5:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7122 initiator: MDT1 00010000:00010000:1.0:1715207784.171662:0:7122:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88009e3bd8c0/0xfa8b5bed878920ba lrc: 4/0,0 mode: CR/CR res: [0x240000403:0x5:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7122 initiator: MDT1 00010000:00010000:1.0:1715207784.171668:0:7122:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88009e3bd8c0 already unused, calling callback (ffffffffa0eef730) 00010000:00010000:1.0:1715207784.171671:0:7122:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009e3bd8c0/0xfa8b5bed878920ba lrc: 4/0,0 mode: CR/CR res: [0x240000403:0x5:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7122 initiator: MDT1 00010000:00010000:1.0:1715207784.171677:0:7122:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009e3bd8c0/0xfa8b5bed878920ba lrc: 5/0,0 mode: CR/CR res: [0x240000403:0x5:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7122 initiator: MDT1 00010000:00010000:1.0:1715207784.171685:0:7122:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x5:0x0].0x0 (ffff88012d095a00) 00010000:00010000:1.0:1715207784.171689:0:7122:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1715207784.171692:0:7122:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88009e3bd8c0/0xfa8b5bed878920ba lrc: 3/0,0 mode: --/CR res: [0x240000403:0x5:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7122 initiator: MDT1 00010000:00010000:1.0:1715207784.171697:0:7122:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009e3bd8c0/0xfa8b5bed878920ba lrc: 0/0,0 mode: --/CR res: [0x240000403:0x5:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7122 initiator: MDT1 00010000:00010000:1.0:1715207784.171714:0:7122:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88009e3bcd80/0xfa8b5bed878920c1 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x5:0x0].0x5efc94da bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7122 initiator: MDT1 00010000:00010000:1.0:1715207784.171720:0:7122:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88009e3bcd80/0xfa8b5bed878920c1 lrc: 2/0,0 mode: PR/PR res: [0x240000403:0x5:0x0].0x5efc94da bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7122 initiator: MDT1 00010000:00010000:1.0:1715207784.171726:0:7122:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88009e3bcd80/0xfa8b5bed878920c1 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x5:0x0].0x5efc94da bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7122 initiator: MDT1 00010000:00010000:1.0:1715207784.171730:0:7122:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88009e3bcd80 already unused, calling callback (ffffffffa0eef730) 00010000:00010000:1.0:1715207784.171733:0:7122:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009e3bcd80/0xfa8b5bed878920c1 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x5:0x0].0x5efc94da bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7122 initiator: MDT1 00010000:00010000:1.0:1715207784.171739:0:7122:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009e3bcd80/0xfa8b5bed878920c1 lrc: 4/0,0 mode: PR/PR res: [0x240000403:0x5:0x0].0x5efc94da bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7122 initiator: MDT1 00010000:00010000:1.0:1715207784.171746:0:7122:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x5:0x0].0x5efc94da (ffff88012d095e00) 00010000:00010000:1.0:1715207784.171748:0:7122:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1715207784.171751:0:7122:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88009e3bcd80/0xfa8b5bed878920c1 lrc: 2/0,0 mode: --/PR res: [0x240000403:0x5:0x0].0x5efc94da bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7122 initiator: MDT1 00010000:00010000:1.0:1715207784.171756:0:7122:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009e3bcd80/0xfa8b5bed878920c1 lrc: 0/0,0 mode: --/PR res: [0x240000403:0x5:0x0].0x5efc94da bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7122 initiator: MDT1 00010000:00010000:1.0:1715207784.171782:0:7122:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88009e3be880/0xfa8b5bed878920b3 lrc: 1/0,0 mode: --/CR res: [0x240000403:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.23@tcp remote: 0x7561918bd55701d8 expref: 13 pid: 7122 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715207784.171822:0:7122:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009e3be880/0xfa8b5bed878920b3 lrc: 0/0,0 mode: --/CR res: [0x240000403:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.23@tcp remote: 0x7561918bd55701d8 expref: 13 pid: 7122 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715207784.171832:0:7122:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009e3be880, rc 0) 00000100:00100000:1.0:1715207784.171922:0:7122:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e288000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1bc50a3e-f07c-4b55-83c3-5f3c3d406528+12:31770:x1798523505027200:12345-192.168.201.23@tcp:101:rm.0 Request processed in 447us (586us total) trans 0 rc 301/301 00000100:00100000:1.0:1715207784.171934:0:7122:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 368 00000100:00100000:0.0:1715207784.173780:0:3677:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:1.0:1715207784.173863:0:7122:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798523505027264 00000100:00100000:1.0:1715207784.173872:0:7122:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798523505027264 00000100:00100000:1.0:1715207784.173946:0:7122:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 369 00000100:00100000:1.0:1715207784.173954:0:7122:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e288380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1bc50a3e-f07c-4b55-83c3-5f3c3d406528+12:31770:x1798523505027264:12345-192.168.201.23@tcp:101:rm.0 00010000:00010000:1.0:1715207784.173967:0:7122:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1715207784.173983:0:7122:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009e3be640/0xfa8b5bed878920c8 lrc: 2/0,0 mode: --/CR res: [0x240000403:0x5:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7561918bd55701df expref: -99 pid: 7122 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715207784.174032:0:7122:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88009e3beac0/0xfa8b5bed878920cf lrc: 3/1,0 mode: --/CR res: [0x240000403:0x5:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7122 initiator: MDT0 00010000:00010000:1.0:1715207784.174047:0:7122:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88009e3beac0/0xfa8b5bed878920cf lrc: 3/1,0 mode: CR/CR res: [0x240000403:0x5:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7122 initiator: MDT1 00010000:00010000:1.0:1715207784.174061:0:7122:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009e3beac0/0xfa8b5bed878920cf lrc: 3/1,0 mode: CR/CR res: [0x240000403:0x5:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7122 initiator: MDT1 00010000:00010000:1.0:1715207784.174078:0:7122:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88009e3bc240/0xfa8b5bed878920d6 lrc: 3/1,0 mode: --/PR res: [0x240000403:0x5:0x0].0x5efc94da bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7122 initiator: MDT0 00010000:00010000:1.0:1715207784.174089:0:7122:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88009e3bc240/0xfa8b5bed878920d6 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x5:0x0].0x5efc94da bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7122 initiator: MDT1 00010000:00010000:1.0:1715207784.174099:0:7122:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009e3bc240/0xfa8b5bed878920d6 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x5:0x0].0x5efc94da bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7122 initiator: MDT1 00010000:00010000:1.0:1715207784.174124:0:7122:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88009e3beac0/0xfa8b5bed878920cf lrc: 4/1,0 mode: CR/CR res: [0x240000403:0x5:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7122 initiator: MDT1 00010000:00010000:1.0:1715207784.174134:0:7122:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff88009e3beac0/0xfa8b5bed878920cf lrc: 4/1,0 mode: CR/CR res: [0x240000403:0x5:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7122 initiator: MDT1 00010000:00010000:1.0:1715207784.174153:0:7122:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88009e3beac0/0xfa8b5bed878920cf lrc: 3/0,0 mode: CR/CR res: [0x240000403:0x5:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7122 initiator: MDT1 00010000:00010000:1.0:1715207784.174161:0:7122:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88009e3beac0/0xfa8b5bed878920cf lrc: 4/0,0 mode: CR/CR res: [0x240000403:0x5:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7122 initiator: MDT1 00010000:00010000:1.0:1715207784.174166:0:7122:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88009e3beac0 already unused, calling callback (ffffffffa0eef730) 00010000:00010000:1.0:1715207784.174170:0:7122:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009e3beac0/0xfa8b5bed878920cf lrc: 4/0,0 mode: CR/CR res: [0x240000403:0x5:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7122 initiator: MDT1 00010000:00010000:1.0:1715207784.174176:0:7122:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009e3beac0/0xfa8b5bed878920cf lrc: 5/0,0 mode: CR/CR res: [0x240000403:0x5:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7122 initiator: MDT1 00010000:00010000:1.0:1715207784.174186:0:7122:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x5:0x0].0x0 (ffff88012d095a00) 00010000:00010000:1.0:1715207784.174189:0:7122:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1715207784.174192:0:7122:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88009e3beac0/0xfa8b5bed878920cf lrc: 3/0,0 mode: --/CR res: [0x240000403:0x5:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7122 initiator: MDT1 00010000:00010000:1.0:1715207784.174198:0:7122:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009e3beac0/0xfa8b5bed878920cf lrc: 0/0,0 mode: --/CR res: [0x240000403:0x5:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7122 initiator: MDT1 00010000:00010000:1.0:1715207784.174209:0:7122:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88009e3bc240/0xfa8b5bed878920d6 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x5:0x0].0x5efc94da bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7122 initiator: MDT1 00010000:00010000:1.0:1715207784.174215:0:7122:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88009e3bc240/0xfa8b5bed878920d6 lrc: 2/0,0 mode: PR/PR res: [0x240000403:0x5:0x0].0x5efc94da bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7122 initiator: MDT1 00010000:00010000:1.0:1715207784.174220:0:7122:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88009e3bc240/0xfa8b5bed878920d6 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x5:0x0].0x5efc94da bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7122 initiator: MDT1 00010000:00010000:1.0:1715207784.174225:0:7122:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88009e3bc240 already unused, calling callback (ffffffffa0eef730) 00010000:00010000:1.0:1715207784.174228:0:7122:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009e3bc240/0xfa8b5bed878920d6 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x5:0x0].0x5efc94da bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7122 initiator: MDT1 00010000:00010000:1.0:1715207784.174244:0:7122:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009e3bc240/0xfa8b5bed878920d6 lrc: 4/0,0 mode: PR/PR res: [0x240000403:0x5:0x0].0x5efc94da bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7122 initiator: MDT1 00010000:00010000:1.0:1715207784.174252:0:7122:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x5:0x0].0x5efc94da (ffff88012d095900) 00010000:00010000:1.0:1715207784.174254:0:7122:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1715207784.174257:0:7122:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88009e3bc240/0xfa8b5bed878920d6 lrc: 2/0,0 mode: --/PR res: [0x240000403:0x5:0x0].0x5efc94da bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7122 initiator: MDT1 00010000:00010000:1.0:1715207784.174262:0:7122:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009e3bc240/0xfa8b5bed878920d6 lrc: 0/0,0 mode: --/PR res: [0x240000403:0x5:0x0].0x5efc94da bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7122 initiator: MDT1 00010000:00010000:1.0:1715207784.174290:0:7122:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88009e3be640/0xfa8b5bed878920c8 lrc: 1/0,0 mode: --/CR res: [0x240000403:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.23@tcp remote: 0x7561918bd55701df expref: 13 pid: 7122 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715207784.174299:0:7122:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009e3be640/0xfa8b5bed878920c8 lrc: 0/0,0 mode: --/CR res: [0x240000403:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.23@tcp remote: 0x7561918bd55701df expref: 13 pid: 7122 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715207784.174307:0:7122:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009e3be640, rc 0) 00000100:00100000:1.0:1715207784.174360:0:7122:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e288380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1bc50a3e-f07c-4b55-83c3-5f3c3d406528+12:31770:x1798523505027264:12345-192.168.201.23@tcp:101:rm.0 Request processed in 403us (581us total) trans 0 rc 301/301 00000100:00100000:1.0:1715207784.174372:0:7122:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 369 00000100:00100000:0.0:1715207784.180923:0:3676:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:1.0:1715207784.181012:0:7122:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798523505027392 00000100:00100000:1.0:1715207784.181020:0:7122:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798523505027392 00000100:00100000:1.0:1715207784.181066:0:7122:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 370 00000100:00100000:1.0:1715207784.181073:0:7122:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e288700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1bc50a3e-f07c-4b55-83c3-5f3c3d406528+12:31771:x1798523505027392:12345-192.168.201.23@tcp:101:dd.0 00010000:00010000:1.0:1715207784.181087:0:7122:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1715207784.181098:0:7122:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009e3bdb00/0xfa8b5bed878920dd lrc: 2/0,0 mode: --/CW res: [0x240000403:0x5:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7561918bd55701e6 expref: -99 pid: 7122 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715207784.181174:0:7122:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff88009e3bdf80/0xfa8b5bed878920e4 lrc: 3/0,1 mode: --/CW res: [0x240000403:0x5:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7122 initiator: MDT0 00010000:00010000:1.0:1715207784.181185:0:7122:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88009e3bdf80/0xfa8b5bed878920e4 lrc: 3/0,1 mode: CW/CW res: [0x240000403:0x5:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7122 initiator: MDT1 00010000:00010000:1.0:1715207784.181193:0:7122:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009e3bdf80/0xfa8b5bed878920e4 lrc: 3/0,1 mode: CW/CW res: [0x240000403:0x5:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7122 initiator: MDT1 00010000:00010000:1.0:1715207784.181204:0:7122:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff88009e3bc900/0xfa8b5bed878920eb lrc: 3/0,1 mode: --/PW res: [0x240000403:0x5:0x0].0x5efc94da bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7122 initiator: MDT0 00010000:00010000:1.0:1715207784.181212:0:7122:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88009e3bc900/0xfa8b5bed878920eb lrc: 3/0,1 mode: PW/PW res: [0x240000403:0x5:0x0].0x5efc94da bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7122 initiator: MDT1 00010000:00010000:1.0:1715207784.181218:0:7122:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009e3bc900/0xfa8b5bed878920eb lrc: 3/0,1 mode: PW/PW res: [0x240000403:0x5:0x0].0x5efc94da bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7122 initiator: MDT1 00000100:00100000:1.0:1715207784.181293:0:7122:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88007e4ef800 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-mdtlov_UUID:7122:1798523510611840:0@lo:1000:mdt00_000.0 00000100:00100000:1.0:1715207784.181334:0:7122:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1715207784.181364:0:7122:0:(client.c:2542:ptlrpc_set_wait()) set ffff88011dd66540 going to sleep for 11 seconds 00000100:00100000:3.0:1715207784.181458:0:8276:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798523510611840 00000100:00100000:3.0:1715207784.181466:0:8276:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798523510611840 00000100:00100000:3.0:1715207784.181510:0:8276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1726 00000100:00100000:3.0:1715207784.181518:0:8276:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e0f4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:7122:x1798523510611840:12345-0@lo:1000:mdt00_000.0 00000100:00100000:3.0:1715207784.181590:0:8276:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e0f4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:7122:x1798523510611840:12345-0@lo:1000:mdt00_000.0 Request processed in 72us (255us total) trans 0 rc 0/0 00000100:00100000:3.0:1715207784.181598:0:8276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1726 00000100:00100000:1.0:1715207784.181606:0:7122:0:(client.c:2956:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 4294967426 gen 2 00000004:00080000:1.0:1715207784.181612:0:7122:0:(osp_trans.c:1052:osp_request_commit_cb()) trans no 4294967426 committed transno 4294967426 00000100:00100000:1.0:1715207784.181634:0:7122:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88007e4ef800 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-mdtlov_UUID:7122:1798523510611840:0@lo:1000:mdt00_000.0 00000004:00080000:1.0:1715207784.181847:0:7122:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000400:0x3:0x0], index 1: 0 00010000:00010000:1.0:1715207784.181985:0:7122:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff88009e3bc480/0xfa8b5bed878920f2 lrc: 3/1,0 mode: --/PR res: [0x240000403:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7122 initiator: MDT0 00010000:00010000:1.0:1715207784.181995:0:7122:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88009e3bc480/0xfa8b5bed878920f2 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7122 initiator: MDT1 00010000:00010000:1.0:1715207784.182016:0:7122:0:(ldlm_request.c:538:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff88009e3bc480/0xfa8b5bed878920f2 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7122 initiator: MDT1 00010000:00010000:1.0:1715207784.182048:0:7122:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff88009e3bdf80/0xfa8b5bed878920e4 lrc: 4/0,1 mode: CW/CW res: [0x240000403:0x5:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7122 initiator: MDT1 00010000:00010000:1.0:1715207784.182054:0:7122:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff88009e3bdf80/0xfa8b5bed878920e4 lrc: 4/0,1 mode: CW/CW res: [0x240000403:0x5:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7122 initiator: MDT1 00010000:00010000:1.0:1715207784.182060:0:7122:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88009e3bdf80/0xfa8b5bed878920e4 lrc: 3/0,0 mode: CW/CW res: [0x240000403:0x5:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7122 initiator: MDT1 00010000:00010000:1.0:1715207784.182066:0:7122:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88009e3bdf80/0xfa8b5bed878920e4 lrc: 4/0,0 mode: CW/CW res: [0x240000403:0x5:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7122 initiator: MDT1 00010000:00010000:1.0:1715207784.182071:0:7122:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88009e3bdf80 already unused, calling callback (ffffffffa0eef730) 00010000:00010000:1.0:1715207784.182074:0:7122:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009e3bdf80/0xfa8b5bed878920e4 lrc: 4/0,0 mode: CW/CW res: [0x240000403:0x5:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7122 initiator: MDT1 00010000:00010000:1.0:1715207784.182080:0:7122:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009e3bdf80/0xfa8b5bed878920e4 lrc: 5/0,0 mode: CW/CW res: [0x240000403:0x5:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7122 initiator: MDT1 00010000:00010000:1.0:1715207784.182089:0:7122:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x5:0x0].0x0 (ffff88012d095a00) 00010000:00010000:1.0:1715207784.182092:0:7122:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1715207784.182095:0:7122:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88009e3bdf80/0xfa8b5bed878920e4 lrc: 3/0,0 mode: --/CW res: [0x240000403:0x5:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7122 initiator: MDT1 00010000:00010000:1.0:1715207784.182101:0:7122:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009e3bdf80/0xfa8b5bed878920e4 lrc: 0/0,0 mode: --/CW res: [0x240000403:0x5:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7122 initiator: MDT1 00000004:00010000:1.0:1715207784.182130:0:7122:0:(mdt_handler.c:4256:mdt_save_lock()) ### save lock request ffff88009e288700 reply state ffff88009e27e000 transno 4294967334 ns: mdt-lustre-MDT0001_UUID lock: ffff88009e3bc900/0xfa8b5bed878920eb lrc: 3/0,1 mode: PW/PW res: [0x240000403:0x5:0x0].0x5efc94da bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7122 initiator: MDT1 00010000:00010000:1.0:1715207784.182145:0:7122:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff88009e3bc900/0xfa8b5bed878920eb lrc: 3/0,1 mode: TXN/TXN res: [0x240000403:0x5:0x0].0x5efc94da bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7122 initiator: MDT1 00010000:00010000:1.0:1715207784.182164:0:7122:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x5:0x0].0x5efc94da (ffff88012d095900) 00010000:00010000:1.0:1715207784.182169:0:7122:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1715207784.182173:0:7122:0:(service.c:188:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1715207784.182209:0:7122:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009e3bdb00/0xfa8b5bed878920dd lrc: 0/0,0 mode: --/CW res: [0x240000403:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.23@tcp remote: 0x7561918bd55701e6 expref: 15 pid: 7122 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715207784.182229:0:7122:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff88009e3bc480/0xfa8b5bed878920f2 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.23@tcp remote: 0x7561918bd55701e6 expref: 14 pid: 7122 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715207784.182241:0:7122:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x6:0x0].0x0 (ffff88012d095e00) 00010000:00010000:1.0:1715207784.182245:0:7122:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1715207784.182248:0:7122:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009e3bc480, rc 0) 00000100:00100000:1.0:1715207784.182303:0:7122:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e288700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1bc50a3e-f07c-4b55-83c3-5f3c3d406528+15:31771:x1798523505027392:12345-192.168.201.23@tcp:101:dd.0 Request processed in 1227us (1382us total) trans 4294967334 rc 0/0 00000100:00100000:1.0:1715207784.182315:0:7122:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 370 00000100:00100000:0.0:1715207784.202327:0:3678:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:2.0:1715207784.202436:0:17457:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798523505027456 00000100:00100000:2.0:1715207784.202448:0:17457:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798523505027456 00000100:00100000:2.0:1715207784.202521:0:17457:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 57 00000100:00100000:2.0:1715207784.202532:0:17457:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e288a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:1bc50a3e-f07c-4b55-83c3-5f3c3d406528+7:31771:x1798523505027456:12345-192.168.201.23@tcp:101:dd.0 00010000:00010000:2.0:1715207784.202550:0:17457:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1715207784.202576:0:17457:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012ed4d440/0xfa8b5bed87892100 lrc: 2/0,0 mode: --/PW res: [0x2c0000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x7561918bd55701ed expref: -99 pid: 17457 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1715207784.202603:0:17457:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x2c0000400:0x3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1715207784.202625:0:17457:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1715207784.202629:0:17457:0:(ldlm_extent.c:329:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1715207784.202644:0:17457:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012ed4d440/0xfa8b5bed87892100 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.201.23@tcp remote: 0x7561918bd55701ed expref: 8 pid: 17457 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715207784.202663:0:17457:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012ed4d440/0xfa8b5bed87892100 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.201.23@tcp remote: 0x7561918bd55701ed expref: 8 pid: 17457 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715207784.202678:0:17457:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012ed4d440, rc 0) 00000100:00100000:2.0:1715207784.202751:0:17457:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e288a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:1bc50a3e-f07c-4b55-83c3-5f3c3d406528+8:31771:x1798523505027456:12345-192.168.201.23@tcp:101:dd.0 Request processed in 218us (428us total) trans 0 rc 0/0 00000100:00100000:2.0:1715207784.202762:0:17457:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 57 00000100:00100000:0.0:1715207784.221571:0:3677:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:2.0:1715207784.221695:0:9392:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798523505027520 00000100:00100000:2.0:1715207784.221703:0:9392:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798523505027520 00002000:00100000:2.0:1715207784.221739:0:9392:0:(ofd_dev.c:2616:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000400:0x3:0x0] (0->1048575) req@ffff88009e288e00 x1798523505027520/t0(0) o4->1bc50a3e-f07c-4b55-83c3-5f3c3d406528@192.168.201.23@tcp:305/0 lens 488/0 e 0 to 0 dl 1715207795 ref 1 fl New:/200/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 00002000:00100000:2.0:1715207784.221751:0:9392:0:(ofd_dev.c:2475:ofd_prolong_extent_locks()) Prolong locks for req ffff88009e288e00 with x1798523505027520 ext(0->1048575) 00002000:00010000:2.0:1715207784.221757:0:9392:0:(ofd_dev.c:2621:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009e288e00 00000100:00100000:2.0:1715207784.221816:0:9392:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 3 00000100:00100000:2.0:1715207784.221823:0:9392:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e288e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1bc50a3e-f07c-4b55-83c3-5f3c3d406528+8:2003:x1798523505027520:12345-192.168.201.23@tcp:4:dd.0 00000100:00100000:2.0:1715207784.238751:0:9392:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e288e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1bc50a3e-f07c-4b55-83c3-5f3c3d406528+10:2003:x1798523505027520:12345-192.168.201.23@tcp:4:dd.0 Request processed in 16917us (17174us total) trans 4294967304 rc 0/0 00000100:00100000:2.0:1715207784.238766:0:9392:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 3 00002000:00100000:2.0:1715207784.238782:0:9392:0:(ofd_dev.c:2616:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000400:0x3:0x0] (0->1048575) req@ffff88009e288e00 x1798523505027520/t4294967304(0) o4->1bc50a3e-f07c-4b55-83c3-5f3c3d406528@192.168.201.23@tcp:305/0 lens 488/448 e 0 to 0 dl 1715207795 ref 1 fl Complete:/200/0 rc 0/0 job:'dd.0' uid:0 gid:0 00002000:00100000:2.0:1715207784.238818:0:9392:0:(ofd_dev.c:2475:ofd_prolong_extent_locks()) Prolong locks for req ffff88009e288e00 with x1798523505027520 ext(0->1048575) 00002000:00010000:2.0:1715207784.238825:0:9392:0:(ofd_dev.c:2621:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009e288e00 00000100:00100000:0.0:1715207784.240915:0:3676:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:1.0:1715207784.241060:0:7122:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798523505027584 00000100:00100000:1.0:1715207784.241072:0:7122:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798523505027584 00000100:00100000:1.0:1715207784.241128:0:7122:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 371 00000100:00100000:1.0:1715207784.241137:0:7122:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e289180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1bc50a3e-f07c-4b55-83c3-5f3c3d406528+15:31771:x1798523505027584:12345-192.168.201.23@tcp:44:dd.0 00000001:00080000:0.0:1715207784.242608:0:8254:0:(tgt_lastrcvd.c:969:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967334 is committed 00000020:00080000:0.0:1715207784.242622:0:8254:0:(update_trans.c:80:top_multiple_thandle_dump()) lustre-MDT0001-osd tmt ffff88011dd66480 refcount 2 committed 0 result 0 batchid 4 00000020:00080000:0.0:1715207784.242627:0:8254:0:(update_trans.c:89:top_multiple_thandle_dump()) st ffff88012d095000 obd lustre-MDT0000-osp-MDT0001 committed 1 started 1 stopped 1 result 0 sub_th ffff88011dd66b40 00000020:00080000:0.0:1715207784.242631:0:8254:0:(update_trans.c:94:top_multiple_thandle_dump()) cookie [0x200000401:0x2:0x0].4 00000020:00080000:0.0:1715207784.242634:0:8254:0:(update_trans.c:89:top_multiple_thandle_dump()) st ffff88012d095b00 obd lustre-MDT0001-osd committed 1 started 1 stopped 1 result 0 sub_th ffff88009e2aca00 00000020:00080000:0.0:1715207784.242637:0:8254:0:(update_trans.c:94:top_multiple_thandle_dump()) cookie [0x240000400:0x2:0x0].4 00010000:00010000:1.0:1715207784.242706:0:3670:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff88009e3bf600/0xfa8b5bed87892074 lrc: 3/0,1 mode: TXN/TXN res: [0x240000403:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7122 initiator: MDT1 00010000:00010000:1.0:1715207784.242721:0:3670:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88009e3bf600/0xfa8b5bed87892074 lrc: 2/0,0 mode: TXN/TXN res: [0x240000403:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7122 initiator: MDT1 00010000:00010000:1.0:1715207784.242731:0:3670:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88009e3bf600/0xfa8b5bed87892074 lrc: 3/0,0 mode: TXN/TXN res: [0x240000403:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7122 initiator: MDT1 00010000:00010000:1.0:1715207784.242738:0:3670:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88009e3bf600 already unused, calling callback (ffffffffa0eef730) 00000020:00080000:2.0:1715207784.242746:0:8273:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 4 committed batchid 3 00010000:00010000:1.0:1715207784.242752:0:3670:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009e3bf600/0xfa8b5bed87892074 lrc: 3/0,0 mode: TXN/TXN res: [0x240000403:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7122 initiator: MDT1 00010000:00010000:1.0:1715207784.242761:0:3670:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009e3bf600/0xfa8b5bed87892074 lrc: 4/0,0 mode: TXN/TXN res: [0x240000403:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7122 initiator: MDT1 00000100:00100000:0.0:1715207784.242777:0:7122:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e289180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1bc50a3e-f07c-4b55-83c3-5f3c3d406528+13:31771:x1798523505027584:12345-192.168.201.23@tcp:44:dd.0 Request processed in 1638us (1865us total) trans 0 rc 0/0 00010000:00010000:1.0:1715207784.242780:0:3670:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x5:0x0].0x0 (ffff88012d095a00) 00010000:00010000:1.0:1715207784.242784:0:3670:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1715207784.242787:0:7122:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 371 00010000:00010000:1.0:1715207784.242789:0:3670:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88009e3bf600/0xfa8b5bed87892074 lrc: 2/0,0 mode: --/TXN res: [0x240000403:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7122 initiator: MDT1 00000020:00080000:2.0:1715207784.242816:0:8273:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 3 00010000:00010000:1.0:1715207784.242824:0:3670:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009e3bf600/0xfa8b5bed87892074 lrc: 0/0,0 mode: --/TXN res: [0x240000403:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7122 initiator: MDT1 00010000:00010000:1.0:1715207784.242849:0:3670:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff88009e3bc900/0xfa8b5bed878920eb lrc: 3/0,1 mode: TXN/TXN res: [0x240000403:0x5:0x0].0x5efc94da bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7122 initiator: MDT1 00010000:00010000:1.0:1715207784.242856:0:3670:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff88009e3bc900/0xfa8b5bed878920eb lrc: 2/0,0 mode: TXN/TXN res: [0x240000403:0x5:0x0].0x5efc94da bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7122 initiator: MDT1 00010000:00010000:1.0:1715207784.242862:0:3670:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff88009e3bc900/0xfa8b5bed878920eb lrc: 3/0,0 mode: TXN/TXN res: [0x240000403:0x5:0x0].0x5efc94da bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7122 initiator: MDT1 00010000:00010000:1.0:1715207784.242866:0:3670:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88009e3bc900 already unused, calling callback (ffffffffa0eef730) 00010000:00010000:1.0:1715207784.242869:0:3670:0:(ldlm_request.c:374:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009e3bc900/0xfa8b5bed878920eb lrc: 3/0,0 mode: TXN/TXN res: [0x240000403:0x5:0x0].0x5efc94da bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7122 initiator: MDT1 00010000:00010000:1.0:1715207784.242875:0:3670:0:(ldlm_request.c:1325:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff88009e3bc900/0xfa8b5bed878920eb lrc: 4/0,0 mode: TXN/TXN res: [0x240000403:0x5:0x0].0x5efc94da bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7122 initiator: MDT1 00010000:00010000:1.0:1715207784.242916:0:3670:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x5:0x0].0x5efc94da (ffff88012d095900) 00010000:00010000:1.0:1715207784.242918:0:3670:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1715207784.242921:0:3670:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff88009e3bc900/0xfa8b5bed878920eb lrc: 2/0,0 mode: --/TXN res: [0x240000403:0x5:0x0].0x5efc94da bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7122 initiator: MDT1 00010000:00010000:1.0:1715207784.242938:0:3670:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff88009e3bc900/0xfa8b5bed878920eb lrc: 0/0,0 mode: --/TXN res: [0x240000403:0x5:0x0].0x5efc94da bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7122 initiator: MDT1 00000100:00100000:0.0:1715207784.244442:0:3678:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:2.0:1715207784.244557:0:17457:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798523505027648 00000100:00100000:2.0:1715207784.244566:0:17457:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798523505027648 00000100:00100000:2.0:1715207784.244612:0:17457:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 58 00000100:00100000:2.0:1715207784.244620:0:17457:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e289500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:1bc50a3e-f07c-4b55-83c3-5f3c3d406528+10:2002:x1798523505027648:12345-192.168.201.23@tcp:16:dd.0 00000001:00080000:0.0:1715207784.245937:0:10651:0:(tgt_lastrcvd.c:969:tgt_cb_last_committed()) lustre-OST0001: transno 4294967304 is committed 00000100:00100000:2.0:1715207784.246106:0:17457:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e289500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:1bc50a3e-f07c-4b55-83c3-5f3c3d406528+8:2002:x1798523505027648:12345-192.168.201.23@tcp:16:dd.0 Request processed in 1479us (1660us total) trans 0 rc 0/0 00000100:00100000:2.0:1715207784.246132:0:17457:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 58 00000100:00100000:3.0:1715207784.247726:0:3677:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.23@tcp (source: 12345-192.168.201.23@tcp) 00000100:00100000:0.0:1715207784.247821:0:15069:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798523505027776 00000100:00100000:0.0:1715207784.247847:0:15069:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798523505027776 00000100:00100000:0.0:1715207784.247934:0:15069:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.23@tcp, seq: 63 00000100:00100000:0.0:1715207784.247947:0:15069:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a03f1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:1bc50a3e-f07c-4b55-83c3-5f3c3d406528+11:31771:x1798523505027776:12345-192.168.201.23@tcp:35:dd.0 00000100:00100000:0.0:1715207784.248177:0:15069:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a03f1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:1bc50a3e-f07c-4b55-83c3-5f3c3d406528+12:31771:x1798523505027776:12345-192.168.201.23@tcp:35:dd.0 Request processed in 231us (454us total) trans 4294967335 rc 0/0 00000100:00100000:0.0:1715207784.248187:0:15069:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.23@tcp, seq: 63 00000040:00080000:0.0:1715207784.733017:0:15215:0:(llog.c:735:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1715207784.733025:0:15215:0:(llog_cat.c:796:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1715207784.733578:0:15215:0:(llog.c:792:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 1 00000040:00080000:0.0:1715207784.733586:0:15215:0:(llog.c:792:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000040:00080000:0.0:1715207784.774737:0:15218:0:(llog.c:792:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1715207784.804123:0:7113:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1715207784.828706:0:16571:0:(debug.c:705:libcfs_debug_mark_buffer()) DEBUG MARKER: sanity-hsm test_15: @@@@@@ FAIL: could not archive file 00000100:00100000:2.0:1715207784.868060:0:3683:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800a03f3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3683:1798523510611904:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1715207784.868104:0:3684:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88009e0f4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3684:1798523510611968:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1715207784.868147:0:3683:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1715207784.868159:0:3684:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1715207784.868209:0:9919:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798523510611904 00000100:00100000:3.0:1715207784.868219:0:9919:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798523510611904 00000100:00100000:0.0:1715207784.868231:0:8276:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798523510611968 00000100:00100000:0.0:1715207784.868237:0:8276:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798523510611968 00000100:00100000:3.0:1715207784.868266:0:9919:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1652 00000100:00100000:3.0:1715207784.868276:0:9919:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f5c8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3683:x1798523510611904:12345-0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1715207784.868277:0:8276:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1727 00000100:00100000:0.0:1715207784.868284:0:8276:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e289880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3684:x1798523510611968:12345-0@lo:41:osp-pre-1-0.0 00000100:00080000:2.0:1715207784.868295:0:7120:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 older than 1715207754 00002000:00000024:3.0:1715207784.868310:0:9919:0:(ofd_obd.c:743:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3922501632 avail 3690979328 00000004:00000024:0.0:1715207784.868315:0:8276:0:(mdt_handler.c:569:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1316843520 00000100:00100000:0.0:1715207784.868361:0:8276:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e289880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3684:x1798523510611968:12345-0@lo:41:osp-pre-1-0.0 Request processed in 76us (201us total) trans 0 rc 0/0 00000100:00100000:0.0:1715207784.868369:0:8276:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1727 00000100:00100000:3.0:1715207784.868374:0:9919:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f5c8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3683:x1798523510611904:12345-0@lo:13:osp-pre-0-0.0 Request processed in 99us (228us total) trans 0 rc 0/0 00000100:00100000:3.0:1715207784.868382:0:9919:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1652 00000100:00100000:0.0:1715207784.868410:0:3684:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88009e0f4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3684:1798523510611968:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1715207784.868415:0:3683:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff8800a03f3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3683:1798523510611904:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1715207784.884040:0:3685:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88012f5cb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3685:1798523510612032:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1715207784.884098:0:3685:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1715207784.884131:0:9919:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798523510612032 00000100:00100000:0.0:1715207784.884140:0:9919:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798523510612032 00000100:00080000:2.0:1715207784.884166:0:7120:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 older than 1715207754 00000100:00100000:0.0:1715207784.884180:0:9919:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1653 00000100:00100000:0.0:1715207784.884188:0:9919:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f5c9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3685:x1798523510612032:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1715207784.884209:0:9919:0:(ofd_obd.c:743:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3922501632 avail 3690979328 00000100:00100000:0.0:1715207784.884255:0:9919:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f5c9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3685:x1798523510612032:12345-0@lo:13:osp-pre-0-1.0 Request processed in 67us (159us total) trans 0 rc 0/0 00000100:00100000:0.0:1715207784.884262:0:9919:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1653 00000100:00100000:2.0:1715207784.884448:0:3685:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88012f5cb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3685:1798523510612032:0@lo:13:osp-pre-0-1.0 Debug log: 927 lines, 927 kept, 0 dropped, 0 bad.