00010000:00010000:1.0F:1789136168.296741:0:17742:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0F:1789136168.810027:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c46212c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1876044666880640:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789136168.810118:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789136168.810185:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c46230c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1876044666881152:0@lo:400:kworker.0 00000100:00100000:0.0:1789136168.810210:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789136168.810226:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c47e7c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1876044666881664:0@lo:400:kworker.0 00000100:00100000:0.0:1789136168.810246:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789136168.810262:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c460ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3641:1876044666882176:0@lo:400:kworker.0 00000100:00100000:0.0:1789136168.810286:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789136168.810310:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:0.0:1789136168.810315:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c4623840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1876044666881024:0@lo:400:kworker.0 00000100:00100000:0.0:1789136168.810334:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789136168.810348:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c47e6940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1876044666881536:0@lo:400:kworker.0 00000100:00100000:0.0:1789136168.810382:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789136168.810399:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c460f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3641:1876044666882048:0@lo:400:kworker.0 00000100:00100000:0.0:1789136168.810417:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789136168.810472:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c4620000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:511c13c6-847f-45db-8965-d0deb75673dc:3638:1876044666880768:0@lo:400:kworker.0 00000100:00100000:0.0:1789136168.810501:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789136168.810533:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c4622580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3638:1876044666881280:0@lo:400:kworker.0 00000100:00100000:0.0:1789136168.810556:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789136168.810572:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c47e4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3638:1876044666881792:0@lo:400:kworker.0 00000100:00100000:0.0:1789136168.810594:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789136168.810610:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c460de00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3638:1876044666882304:0@lo:400:kworker.0 00000100:00100000:0.0:1789136168.810630:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789136168.810641:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:0.0:1789136168.810646:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c4622940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1876044666880896:0@lo:400:kworker.0 00000100:00100000:0.0:1789136168.810677:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789136168.810693:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7fa3a61c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1876044666881408:0@lo:400:kworker.0 00000100:00100000:0.0:1789136168.810711:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789136168.810724:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c460c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3638:1876044666881920:0@lo:400:kworker.0 00000100:00100000:0.0:1789136168.810743:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789136168.810765:0:19269:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666880640 00000100:00100000:0.0:1789136168.810772:0:19269:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666880640 00000100:00100000:0.0:1789136168.810825:0:19269:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1789136168.810834:0:19269:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c460cf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1876044666880640:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789136168.810884:0:19269:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923501056 avail 3691978752 00000100:00100000:0.0:1789136168.810928:0:19269:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c460cf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1876044666880640:12345-0@lo:13:osp-pre-1-0.0 Request processed in 95us (810us total) trans 0 rc 0/0 00000100:00100000:0.0:1789136168.810935:0:19269:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1789136168.810958:0:19265:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666881152 00000100:00100000:0.0:1789136168.810962:0:19265:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666881152 00000100:00100000:0.0:1789136168.810982:0:19265:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666881664 00000100:00100000:0.0:1789136168.810985:0:19265:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666881664 00000100:00100000:0.0:1789136168.810996:0:19265:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666881024 00000100:00100000:0.0:1789136168.810998:0:19265:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666881024 00000100:00100000:0.0:1789136168.811010:0:19265:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666881536 00000100:00100000:0.0:1789136168.811013:0:19265:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666881536 00000100:00100000:0.0:1789136168.811024:0:19265:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1789136168.811030:0:19265:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c460f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3641:x1876044666881152:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789136168.811059:0:19265:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c460f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3641:x1876044666881152:12345-0@lo:400:kworker.0 Request processed in 30us (849us total) trans 0 rc 0/0 00000100:00100000:0.0:1789136168.811066:0:19265:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1789136168.811077:0:19265:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1789136168.811082:0:19265:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c460e580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3641:x1876044666881664:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789136168.811112:0:19265:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c460e580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3641:x1876044666881664:12345-0@lo:400:kworker.0 Request processed in 30us (866us total) trans 0 rc 0/0 00000100:00100000:0.0:1789136168.811119:0:19265:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1789136168.811131:0:19265:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1789136168.811136:0:19265:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c460cb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3641:x1876044666881024:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789136168.811160:0:19265:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c460cb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3641:x1876044666881024:12345-0@lo:400:kworker.0 Request processed in 24us (826us total) trans 0 rc 0/0 00000100:00100000:0.0:1789136168.811166:0:19265:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1789136168.811175:0:19265:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1789136168.811181:0:19265:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c460d680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3641:x1876044666881536:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789136168.811204:0:19265:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c460d680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3641:x1876044666881536:12345-0@lo:400:kworker.0 Request processed in 23us (822us total) trans 0 rc 0/0 00000100:00100000:0.0:1789136168.811210:0:19265:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1789136168.811229:0:17754:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666882176 00000100:00100000:0.0:1789136168.811232:0:17754:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666882176 00000100:00100000:0.0:1789136168.811251:0:17754:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666882048 00000100:00100000:0.0:1789136168.811253:0:17754:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666882048 00000100:00100000:0.0:1789136168.811263:0:17754:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666881280 00000100:00100000:0.0:1789136168.811265:0:17754:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666881280 00000100:00100000:0.0:1789136168.811273:0:17754:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666881792 00000100:00100000:0.0:1789136168.811275:0:17754:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666881792 00000100:00100000:0.0:1789136168.811283:0:17754:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666882304 00000100:00100000:0.0:1789136168.811285:0:17754:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666882304 00000100:00100000:0.0:1789136168.811297:0:17754:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666881920 00000100:00100000:0.0:1789136168.811299:0:17754:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666881920 00000100:00100000:0.0:1789136168.811309:0:17754:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:0.0:1789136168.811314:0:17754:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c460d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3641:x1876044666882176:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789136168.811410:0:17754:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c460d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3641:x1876044666882176:12345-0@lo:400:kworker.0 Request processed in 94us (1122us total) trans 0 rc 0/0 00000100:00100000:0.0:1789136168.811420:0:17754:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:0.0:1789136168.811432:0:17754:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:0.0:1789136168.811452:0:17754:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c460e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3641:x1876044666882048:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789136168.811480:0:17754:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c460e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3641:x1876044666882048:12345-0@lo:400:kworker.0 Request processed in 43us (1062us total) trans 0 rc 0/0 00000100:00100000:0.0:1789136168.811485:0:17754:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:0.0:1789136168.811496:0:17754:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1789136168.811502:0:17754:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c460f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1876044666881280:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789136168.811529:0:17754:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c460f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1876044666881280:12345-0@lo:400:kworker.0 Request processed in 27us (973us total) trans 0 rc 0/0 00000100:00100000:0.0:1789136168.811535:0:17754:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1789136168.811545:0:17754:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:0.0:1789136168.811551:0:17754:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c460da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3638:x1876044666881792:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789136168.811575:0:17754:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c460da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3638:x1876044666881792:12345-0@lo:400:kworker.0 Request processed in 25us (981us total) trans 0 rc 0/0 00000100:00100000:0.0:1789136168.811581:0:17754:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:0.0:1789136168.811592:0:17754:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:0.0:1789136168.811598:0:17754:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c460e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3638:x1876044666882304:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789136168.811622:0:17754:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c460e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3638:x1876044666882304:12345-0@lo:400:kworker.0 Request processed in 24us (991us total) trans 0 rc 0/0 00000100:00100000:0.0:1789136168.811627:0:17754:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:0.0:1789136168.811637:0:17754:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:0.0:1789136168.811643:0:17754:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c460fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3638:x1876044666881920:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789136168.811666:0:17754:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c460fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3638:x1876044666881920:12345-0@lo:400:kworker.0 Request processed in 24us (923us total) trans 0 rc 0/0 00000100:00100000:0.0:1789136168.811679:0:17754:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:0.0:1789136168.811716:0:17759:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666880896 00000100:00100000:0.0:1789136168.811720:0:17759:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666880896 00000100:00100000:0.0:1789136168.811736:0:17759:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666881408 00000100:00100000:0.0:1789136168.811738:0:17759:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666881408 00000100:00100000:0.0:1789136168.811748:0:17759:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1789136168.811753:0:17759:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c460c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3638:x1876044666880896:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789136168.811782:0:17759:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c460c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3638:x1876044666880896:12345-0@lo:400:kworker.0 Request processed in 29us (1104us total) trans 0 rc 0/0 00000100:00100000:0.0:1789136168.811788:0:17759:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1789136168.811798:0:17759:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1789136168.811803:0:17759:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c460c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3638:x1876044666881408:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789136168.811827:0:17759:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c460c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3638:x1876044666881408:12345-0@lo:400:kworker.0 Request processed in 24us (1114us total) trans 0 rc 0/0 00000100:00100000:0.0:1789136168.811832:0:17759:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00080000:0.0:1789136168.811850:0:17749:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1789136168.811872:0:17749:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789136168.811875:0:17749:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789136168.811877:0:17749:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789136168.811927:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c4622940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1876044666880896:0@lo:400:kworker.0 00000100:00100000:0.0:1789136168.811939:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7fa3a61c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1876044666881408:0@lo:400:kworker.0 00000100:00100000:0.0:1789136168.811948:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c460c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3638:1876044666881920:0@lo:400:kworker.0 00000100:00100000:0.0:1789136168.811958:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c4622580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3638:1876044666881280:0@lo:400:kworker.0 00000100:00100000:0.0:1789136168.811968:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c47e4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3638:1876044666881792:0@lo:400:kworker.0 00010000:00080000:0.0:1789136168.811980:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90a6c460de00 x1876044666882304/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789136184 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789136168.811997:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c460de00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3638:1876044666882304:0@lo:400:kworker.0 00000100:00100000:0.0:1789136168.812037:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c4623840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1876044666881024:0@lo:400:kworker.0 00000100:00100000:0.0:1789136168.812047:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c47e6940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1876044666881536:0@lo:400:kworker.0 00010000:00080000:0.0:1789136168.812058:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90a6c460f840 x1876044666882048/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789136184 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789136168.812066:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c460f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3641:1876044666882048:0@lo:400:kworker.0 00000100:00100000:0.0:1789136168.812083:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c46212c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1876044666880640:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789136168.812090:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c46230c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1876044666881152:0@lo:400:kworker.0 00000100:00100000:0.0:1789136168.812099:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c47e7c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1876044666881664:0@lo:400:kworker.0 00000100:00100000:0.0:1789136168.812108:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c460ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3641:1876044666882176:0@lo:400:kworker.0 00000100:00100000:3.0F:1789136168.812277:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c5674780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1876044666882432:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1789136168.812317:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789136168.812354:0:19268:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666882432 00000100:00100000:3.0:1789136168.812358:0:19268:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666882432 00000100:00100000:3.0:1789136168.812386:0:19268:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1789136168.812392:0:19268:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c5677c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1876044666882432:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1789136168.812404:0:19268:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923501056 avail 3691978752 00000100:00100000:3.0:1789136168.812434:0:19268:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c5677c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1876044666882432:12345-0@lo:13:osp-pre-1-1.0 Request processed in 42us (117us total) trans 0 rc 0/0 00000100:00100000:3.0:1789136168.812455:0:19268:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1789136168.812486:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c5674780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1876044666882432:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1789136168.812524:0:17746:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666880768 00000100:00100000:3.0:1789136168.812528:0:17746:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666880768 00000100:00100000:3.0:1789136168.812552:0:17746:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 170 00000100:00100000:3.0:1789136168.812557:0:17746:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7fa9fb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:511c13c6-847f-45db-8965-d0deb75673dc+24:3638:x1876044666880768:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789136168.812584:0:17746:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7fa9fb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:511c13c6-847f-45db-8965-d0deb75673dc+24:3638:x1876044666880768:12345-0@lo:400:kworker.0 Request processed in 27us (2083us total) trans 0 rc 0/0 00000100:00100000:3.0:1789136168.812590:0:17746:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 170 00000100:00100000:0.0:1789136168.816567:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c4620000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:511c13c6-847f-45db-8965-d0deb75673dc:3638:1876044666880768:0@lo:400:kworker.0 00010000:00010000:1.0:1789136169.319971:0:17741:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789136169.833129:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789136169.833156:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c460f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1876044666882560:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789136169.833238:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789136169.833285:0:20582:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666882560 00000100:00100000:0.0:1789136169.833293:0:20582:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666882560 00000100:00100000:0.0:1789136169.833339:0:20582:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1789136169.833349:0:20582:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c460de00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1876044666882560:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789136169.833379:0:20582:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 4218880 granted 17886912 pending 0 free 3915853824 avail 3684331520 00000100:00100000:0.0:1789136169.833437:0:20582:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c460de00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1876044666882560:12345-0@lo:13:osp-pre-0-0.0 Request processed in 90us (200us total) trans 0 rc 0/0 00000100:00100000:0.0:1789136169.833458:0:20582:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1789136169.833505:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c460f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1876044666882560:0@lo:13:osp-pre-0-0.0 00000001:00080000:3.0:1789136169.844973:0:17733:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934622 is committed 00000020:00080000:3.0:1789136169.844994:0:17733:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff90a7efa56600 refcount 2 committed 0 result 0 batchid 4294967529 00000020:00080000:3.0:1789136169.845000:0:17733:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff90a7f04c8000 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff90a7efa56780 00000020:00080000:3.0:1789136169.845004:0:17733:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff90a7f04c8500 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff90a6c44e3c00 00000020:00080000:1.0:1789136169.845091:0:17795:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 4294967529 committed batchid 8 00000020:00080000:1.0:1789136169.845174:0:17795:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00010000:00010000:2.0F:1789136169.845400:0:3625:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1878400/0x559c8745c6de4368 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136169.845431:0:3625:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1878400/0x559c8745c6de4368 lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 17755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136169.845439:0:3625:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1878400/0x559c8745c6de4368 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136169.845445:0:3625:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a7d1878400 already unused, calling callback (ffffffffc19cc4f0) 00010000:00010000:2.0:1789136169.845450:0:3625:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1878400/0x559c8745c6de4368 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136169.845458:0:3625:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1878400/0x559c8745c6de4368 lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 17755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136169.845550:0:3625:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff90a7fa59e600) 00010000:00010000:2.0:1789136169.845554:0:3625:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789136169.845560:0:3625:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1878400/0x559c8745c6de4368 lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136169.845568:0:3625:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1878400/0x559c8745c6de4368 lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136170.347551:0:17742:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789136170.856422:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789136170.856469:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7dd6ee1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1876044666882688:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1789136170.856544:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789136170.856590:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789136170.856599:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7dd6ec3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1876044666882816:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1789136170.856627:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789136170.856671:0:19269:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666882816 00000100:00100000:2.0:1789136170.856678:0:19269:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666882816 00000100:00100000:2.0:1789136170.856733:0:19269:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1789136170.856760:0:19269:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7dd6ef840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1876044666882816:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1789136170.856787:0:19269:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 4218880 granted 17886912 pending 0 free 3915853824 avail 3684331520 00000100:00100000:2.0:1789136170.856836:0:19269:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7dd6ef840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1876044666882816:12345-0@lo:13:osp-pre-0-1.0 Request processed in 80us (208us total) trans 0 rc 0/0 00000100:00100000:2.0:1789136170.856843:0:19269:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1789136170.856912:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7dd6ec3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1876044666882816:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1789136170.860479:0:17759:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666882688 00000100:00100000:1.0:1789136170.860493:0:17759:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666882688 00000100:00100000:1.0:1789136170.860610:0:17759:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1789136170.860621:0:17759:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7dd6ef480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3640:x1876044666882688:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1789136170.861769:0:17759:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446293504 avail 1300054016 00000100:00100000:1.0:1789136170.861883:0:17759:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7dd6ef480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3640:x1876044666882688:12345-0@lo:41:osp-pre-0-1.0 Request processed in 1262us (5337us total) trans 0 rc 0/0 00000100:00100000:1.0:1789136170.861893:0:17759:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1789136170.861972:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7dd6ee1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1876044666882688:0@lo:41:osp-pre-0-1.0 00000100:00080000:1.0:1789136170.864487:0:17749:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000040:00080000:2.0:1789136170.991541:0:17787:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:2.0:1789136170.991551:0:17787:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1789136170.991570:0:17787:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:2.0:1789136170.991578:0:17787:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00010000:00010000:1.0:1789136171.369501:0:17741:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789136171.374066:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7dd6ec3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1876044666882944:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1789136171.374146:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789136171.374214:0:17759:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666882944 00000100:00100000:3.0:1789136171.374241:0:17759:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666882944 00000100:00100000:3.0:1789136171.374291:0:17759:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1789136171.374301:0:17759:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c56743c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3639:x1876044666882944:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1789136171.374339:0:17759:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:3.0:1789136171.374446:0:17759:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c56743c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3639:x1876044666882944:12345-0@lo:41:osp-pre-1-0.0 Request processed in 146us (299us total) trans 0 rc 0/0 00000100:00100000:3.0:1789136171.374454:0:17759:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1789136171.374504:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7dd6ec3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1876044666882944:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1789136171.775307:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:3.0:1789136171.775360:0:17754:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644765056 00000100:00100000:3.0:1789136171.775369:0:17754:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644765056 00000100:00100000:3.0:1789136171.775443:0:17754:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 65 00000100:00100000:3.0:1789136171.775453:0:17754:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c5677480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8615a57a-8113-4aad-917f-27cc7b9dd43a+13:15836:x1876044644765056:12345-192.168.201.31@tcp:60:lhsmtool_posix.0 00000100:00100000:3.0:1789136171.775553:0:17754:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c5677480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8615a57a-8113-4aad-917f-27cc7b9dd43a+13:15836:x1876044644765056:12345-192.168.201.31@tcp:60:lhsmtool_posix.0 Request processed in 100us (256us total) trans 0 rc 0/0 00000100:00100000:3.0:1789136171.775561:0:17754:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 65 00000100:00080000:3.0:1789136171.775582:0:17749:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789136171.809191:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:3.0:1789136171.809241:0:17753:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644765184 00000100:00100000:3.0:1789136171.809251:0:17753:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644765184 00000100:00100000:3.0:1789136171.809312:0:17753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 66 00000100:00100000:3.0:1789136171.809322:0:17753:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c5677840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8615a57a-8113-4aad-917f-27cc7b9dd43a+5:15836:x1876044644765184:12345-192.168.201.31@tcp:60:lhsmtool_posix.0 00000100:00100000:3.0:1789136171.809429:0:17753:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c5677840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8615a57a-8113-4aad-917f-27cc7b9dd43a+5:15836:x1876044644765184:12345-192.168.201.31@tcp:60:lhsmtool_posix.0 Request processed in 108us (248us total) trans 0 rc 0/0 00000100:00100000:3.0:1789136171.809437:0:17753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 66 00000100:00080000:3.0:1789136171.809458:0:17749:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1789136171.818258:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:0.0:1789136171.818400:0:17757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644765440 00000100:00100000:0.0:1789136171.818411:0:17757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644765440 00000100:00100000:0.0:1789136171.818482:0:17757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 12 00000100:00100000:0.0:1789136171.818492:0:17757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7dd6ee580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8615a57a-8113-4aad-917f-27cc7b9dd43a+13:15836:x1876044644765440:12345-192.168.201.31@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1789136171.818713:0:17757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7dd6ee580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8615a57a-8113-4aad-917f-27cc7b9dd43a+14:15836:x1876044644765440:12345-192.168.201.31@tcp:35:lhsmtool_posix.0 Request processed in 222us (464us total) trans 8589934623 rc 0/0 00000100:00100000:0.0:1789136171.818721:0:17757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 12 00010000:00010000:3.0:1789136172.397897:0:17742:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789136173.050070:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:2.0:1789136173.050113:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:2.0:1789136173.050143:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:2.0:1789136173.050183:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:2.0:1789136173.050204:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:2.0:1789136173.050227:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:0.0:1789136173.050757:0:17745:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644765568 00000100:00100000:0.0:1789136173.050767:0:17745:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644765568 00000100:00100000:0.0:1789136173.050828:0:17745:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 171 00000100:00100000:0.0:1789136173.050838:0:17745:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7fa9fb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d7d35a68-30a0-4475-a8ab-9673ac334408+13:2391:x1876044644765568:12345-192.168.201.31@tcp:400:kworker.0 00000100:00100000:0.0:1789136173.050932:0:17745:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7fa9fb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d7d35a68-30a0-4475-a8ab-9673ac334408+13:2391:x1876044644765568:12345-192.168.201.31@tcp:400:kworker.0 Request processed in 95us (871us total) trans 0 rc 0/0 00000100:00100000:0.0:1789136173.050940:0:17745:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 171 00000100:00100000:0.0:1789136173.050975:0:19265:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644765952 00000100:00100000:0.0:1789136173.050978:0:19265:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644765952 00000100:00100000:0.0:1789136173.051063:0:19265:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 41 00000100:00100000:0.0:1789136173.051071:0:19265:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7dd6ec3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8615a57a-8113-4aad-917f-27cc7b9dd43a+5:2391:x1876044644765952:12345-192.168.201.31@tcp:400:kworker.0 00000100:00100000:0.0:1789136173.051099:0:19265:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7dd6ec3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8615a57a-8113-4aad-917f-27cc7b9dd43a+5:2391:x1876044644765952:12345-192.168.201.31@tcp:400:kworker.0 Request processed in 29us (893us total) trans 0 rc 0/0 00000100:00100000:0.0:1789136173.051105:0:19265:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 41 00000100:00100000:1.0:1789136173.051143:0:17755:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644765824 00000100:00100000:1.0:1789136173.051149:0:17755:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644765824 00000100:00100000:1.0:1789136173.051174:0:17755:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644766080 00000100:00100000:1.0:1789136173.051176:0:17755:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644766080 00000100:00100000:1.0:1789136173.051187:0:17755:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644765696 00000100:00100000:1.0:1789136173.051190:0:17755:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644765696 00000100:00100000:1.0:1789136173.051200:0:17755:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644766208 00000100:00100000:1.0:1789136173.051202:0:17755:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644766208 00000100:00100000:1.0:1789136173.051215:0:17755:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 89 00000100:00100000:1.0:1789136173.051221:0:17755:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7dd6ed2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8615a57a-8113-4aad-917f-27cc7b9dd43a+5:2391:x1876044644765824:12345-192.168.201.31@tcp:400:kworker.0 00000100:00100000:1.0:1789136173.051273:0:17755:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7dd6ed2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8615a57a-8113-4aad-917f-27cc7b9dd43a+5:2391:x1876044644765824:12345-192.168.201.31@tcp:400:kworker.0 Request processed in 52us (1159us total) trans 0 rc 0/0 00000100:00100000:1.0:1789136173.051280:0:17755:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 89 00000100:00100000:1.0:1789136173.051295:0:17755:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 90 00000100:00100000:1.0:1789136173.051320:0:17755:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7dd6ec000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2a472c6c-d1e0-40bc-9d80-35f3f0adb443+6:2391:x1876044644766080:12345-192.168.201.31@tcp:400:kworker.0 00000100:00100000:1.0:1789136173.051346:0:17755:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7dd6ec000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2a472c6c-d1e0-40bc-9d80-35f3f0adb443+6:2391:x1876044644766080:12345-192.168.201.31@tcp:400:kworker.0 Request processed in 29us (1203us total) trans 0 rc 0/0 00000100:00100000:1.0:1789136173.051353:0:17755:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 90 00000100:00100000:1.0:1789136173.051378:0:17755:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 91 00000100:00100000:1.0:1789136173.051385:0:17755:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7dd6ecb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8615a57a-8113-4aad-917f-27cc7b9dd43a+14:2391:x1876044644765696:12345-192.168.201.31@tcp:400:kworker.0 00000100:00100000:1.0:1789136173.051414:0:17755:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7dd6ecb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8615a57a-8113-4aad-917f-27cc7b9dd43a+14:2391:x1876044644765696:12345-192.168.201.31@tcp:400:kworker.0 Request processed in 30us (1231us total) trans 0 rc 0/0 00000100:00100000:1.0:1789136173.051421:0:17755:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 91 00000100:00100000:1.0:1789136173.051443:0:17755:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 92 00000100:00100000:1.0:1789136173.051450:0:17755:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7dd6ee1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2a472c6c-d1e0-40bc-9d80-35f3f0adb443+5:2391:x1876044644766208:12345-192.168.201.31@tcp:400:kworker.0 00000100:00100000:1.0:1789136173.051472:0:17755:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7dd6ee1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2a472c6c-d1e0-40bc-9d80-35f3f0adb443+5:2391:x1876044644766208:12345-192.168.201.31@tcp:400:kworker.0 Request processed in 23us (1244us total) trans 0 rc 0/0 00000100:00100000:1.0:1789136173.051479:0:17755:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 92 00000100:00080000:3.0:1789136173.052199:0:17749:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789136173.052921:0:17749:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1789136173.052925:0:17749:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1789136173.416097:0:17741:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789136173.936413:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c5676580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1876044666883072:0@lo:13:osp-pre-1-1.0 00000001:00100000:2.0:1789136173.936428:0:19261:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 2a472c6c-d1e0-40bc-9d80-35f3f0adb443 00000020:00000080:2.0:1789136173.936439:0:19261:0:(genops.c:885:class_export_put()) final put ffff90a7d26b7800/2a472c6c-d1e0-40bc-9d80-35f3f0adb443 00000100:00100000:1.0:1789136173.936578:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789136173.936797:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c460f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1876044666883200:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789136173.936900:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00000080:3.0:1789136173.938827:0:16093:0:(genops.c:844:class_export_destroy()) destroying export ffff90a7d26b7800/2a472c6c-d1e0-40bc-9d80-35f3f0adb443 for lustre-OST0000 00000020:00000080:3.0:1789136173.939056:0:16093:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff90a7fa378000 for lustre-OST0000 00000100:00100000:3.0:1789136173.939122:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c56752c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:511c13c6-847f-45db-8965-d0deb75673dc:3638:1876044666883328:0@lo:400:kworker.0 00000100:00100000:3.0:1789136173.939251:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789136173.941980:0:19268:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666883072 00000100:00100000:1.0:1789136173.941994:0:19268:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666883072 00000100:00100000:0.0:1789136173.942246:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c56761c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3641:1876044666883712:0@lo:400:kworker.0 00000100:00100000:0.0:1789136173.942315:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789136173.942362:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7fa3bde00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3641:1876044666884224:0@lo:400:kworker.0 00000100:00100000:0.0:1789136173.942384:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789136173.942415:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:0.0:1789136173.942421:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c5674b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1876044666883584:0@lo:400:kworker.0 00000100:00100000:0.0:1789136173.942443:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789136173.942458:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7fa3bed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3641:1876044666884096:0@lo:400:kworker.0 00000100:00100000:0.0:1789136173.942490:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789136173.942505:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7fa3bf0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3641:1876044666884608:0@lo:400:kworker.0 00000100:00100000:0.0:1789136173.942524:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789136173.942563:0:17755:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666883712 00000100:00100000:0.0:1789136173.942567:0:17755:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666883712 00000100:00100000:0.0:1789136173.942748:0:17755:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666884224 00000100:00100000:0.0:1789136173.942753:0:17755:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666884224 00000100:00100000:0.0:1789136173.942769:0:17755:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666884096 00000100:00100000:0.0:1789136173.942771:0:17755:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666884096 00000100:00100000:0.0:1789136173.942779:0:17755:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666884608 00000100:00100000:0.0:1789136173.942781:0:17755:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666884608 00000100:00100000:0.0:1789136173.942796:0:17755:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:0.0:1789136173.942804:0:17755:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c460ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1876044666883712:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789136173.942880:0:17755:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c460ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1876044666883712:12345-0@lo:400:kworker.0 Request processed in 77us (566us total) trans 0 rc 0/0 00000100:00100000:0.0:1789136173.942888:0:17755:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:0.0:1789136173.942903:0:17755:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:0.0:1789136173.942909:0:17755:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7fa39a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3641:x1876044666884224:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789136173.942953:0:17755:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7fa39a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3641:x1876044666884224:12345-0@lo:400:kworker.0 Request processed in 44us (567us total) trans 0 rc 0/0 00000100:00100000:0.0:1789136173.942959:0:17755:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:0.0:1789136173.942976:0:17755:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:0.0:1789136173.942982:0:17755:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c47e6940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1876044666884096:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789136173.943008:0:17755:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c47e6940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1876044666884096:12345-0@lo:400:kworker.0 Request processed in 26us (518us total) trans 0 rc 0/0 00000100:00100000:0.0:1789136173.943013:0:17755:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:0.0:1789136173.943023:0:17755:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:0.0:1789136173.943028:0:17755:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c47e4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3641:x1876044666884608:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789136173.943049:0:17755:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c47e4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3641:x1876044666884608:12345-0@lo:400:kworker.0 Request processed in 21us (525us total) trans 0 rc 0/0 00000100:00100000:0.0:1789136173.943054:0:17755:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:0.0:1789136173.943072:0:19572:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666883584 00000100:00100000:0.0:1789136173.943075:0:19572:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666883584 00000100:00100000:0.0:1789136173.943100:0:19572:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1789136173.943105:0:19572:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c47e7c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3641:x1876044666883584:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789136173.943135:0:19572:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c47e7c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3641:x1876044666883584:12345-0@lo:400:kworker.0 Request processed in 30us (690us total) trans 0 rc 0/0 00000100:00100000:0.0:1789136173.943140:0:19572:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1789136173.943652:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c5674b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1876044666883584:0@lo:400:kworker.0 00000100:00100000:0.0:1789136173.943665:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7fa3bed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3641:1876044666884096:0@lo:400:kworker.0 00010000:00080000:0.0:1789136173.943676:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90a7fa3bf0c0 x1876044666884608/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789136189 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789136173.943703:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7fa3bf0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3641:1876044666884608:0@lo:400:kworker.0 00000100:00100000:0.0:1789136173.943716:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c56761c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3641:1876044666883712:0@lo:400:kworker.0 00000100:00100000:0.0:1789136173.943725:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7fa3bde00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3641:1876044666884224:0@lo:400:kworker.0 00000100:00100000:1.0:1789136173.944298:0:19268:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666883200 00000100:00100000:1.0:1789136173.944304:0:19268:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666883200 00000100:00100000:1.0:1789136173.944332:0:19268:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1789136173.944340:0:19268:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7c9678f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1876044666883072:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1789136173.944382:0:19268:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923501056 avail 3691978752 00000100:00100000:1.0:1789136173.944438:0:19268:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7c9678f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1876044666883072:12345-0@lo:13:osp-pre-1-1.0 Request processed in 99us (7861us total) trans 0 rc 0/0 00000100:00100000:1.0:1789136173.944452:0:19268:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1789136173.944469:0:19268:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1789136173.944475:0:19268:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c460c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1876044666883200:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789136173.944485:0:19268:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923501056 avail 3691978752 00000100:00100000:1.0:1789136173.944514:0:19268:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c460c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1876044666883200:12345-0@lo:13:osp-pre-1-0.0 Request processed in 40us (7615us total) trans 0 rc 0/0 00000100:00100000:1.0:1789136173.944520:0:19268:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00080000:2.0:1789136173.944760:0:17749:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789136173.944765:0:17749:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1789136173.944768:0:17749:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789136173.944770:0:17749:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789136173.944783:0:17747:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666883328 00000100:00100000:2.0:1789136173.944788:0:17747:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666883328 00000100:00100000:2.0:1789136173.944823:0:17747:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 172 00000100:00100000:2.0:1789136173.944830:0:17747:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7fa9fa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:511c13c6-847f-45db-8965-d0deb75673dc+24:3638:x1876044666883328:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789136173.944895:0:17747:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7fa9fa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:511c13c6-847f-45db-8965-d0deb75673dc+24:3638:x1876044666883328:12345-0@lo:400:kworker.0 Request processed in 65us (5644us total) trans 0 rc 0/0 00000100:00100000:2.0:1789136173.944902:0:17747:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 172 00000100:00100000:2.0:1789136173.944939:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c5674000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1876044666883456:0@lo:400:kworker.0 00000100:00100000:2.0:1789136173.944991:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789136173.945030:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7fa3bd680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1876044666883968:0@lo:400:kworker.0 00000100:00100000:2.0:1789136173.945072:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789136173.945094:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7fa3bcf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3639:1876044666884480:0@lo:400:kworker.0 00000100:00100000:2.0:1789136173.945122:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789136173.945337:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c56752c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:511c13c6-847f-45db-8965-d0deb75673dc:3638:1876044666883328:0@lo:400:kworker.0 00000100:00100000:3.0:1789136173.945358:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c5676d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1876044666883840:0@lo:400:kworker.0 00000100:00100000:3.0:1789136173.945387:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789136173.945405:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7fa3be940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3638:1876044666884352:0@lo:400:kworker.0 00000100:00100000:3.0:1789136173.945426:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789136173.945720:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c5676580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1876044666883072:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1789136173.945754:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c460f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1876044666883200:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789136173.945917:0:17758:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666883456 00000100:00100000:1.0:1789136173.945922:0:17758:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666883456 00000100:00100000:1.0:1789136173.945945:0:17758:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666883840 00000100:00100000:1.0:1789136173.945948:0:17758:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666883840 00000100:00100000:1.0:1789136173.945961:0:17758:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1789136173.945967:0:17758:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7dd6efc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3639:x1876044666883456:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789136173.946018:0:17758:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7dd6efc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3639:x1876044666883456:12345-0@lo:400:kworker.0 Request processed in 50us (1027us total) trans 0 rc 0/0 00000100:00100000:1.0:1789136173.946025:0:17758:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1789136173.946041:0:17758:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1789136173.946047:0:17758:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7fa3bda40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3638:x1876044666883840:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789136173.946077:0:17758:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7fa3bda40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3638:x1876044666883840:12345-0@lo:400:kworker.0 Request processed in 31us (689us total) trans 0 rc 0/0 00000100:00100000:1.0:1789136173.946083:0:17758:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1789136173.946118:0:18920:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666884480 00000100:00100000:1.0:1789136173.946122:0:18920:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666884480 00000100:00100000:1.0:1789136173.946174:0:18920:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666884352 00000100:00100000:1.0:1789136173.946178:0:18920:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666884352 00000100:00100000:1.0:1789136173.946195:0:18920:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:1.0:1789136173.946201:0:18920:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7ff5d43c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3639:x1876044666884480:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789136173.946234:0:18920:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7ff5d43c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3639:x1876044666884480:12345-0@lo:400:kworker.0 Request processed in 34us (1112us total) trans 0 rc 0/0 00000100:00100000:1.0:1789136173.946241:0:18920:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:1.0:1789136173.946253:0:18920:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:1.0:1789136173.946259:0:18920:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7fa3bc780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3638:x1876044666884352:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789136173.946286:0:18920:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7fa3bc780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3638:x1876044666884352:12345-0@lo:400:kworker.0 Request processed in 27us (859us total) trans 0 rc 0/0 00000100:00100000:1.0:1789136173.946291:0:18920:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:2.0:1789136173.946837:0:19266:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666883968 00000100:00100000:2.0:1789136173.946843:0:19266:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666883968 00000100:00100000:2.0:1789136173.946905:0:19266:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1789136173.946912:0:19266:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c10983c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3639:x1876044666883968:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789136173.946948:0:19266:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c10983c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3639:x1876044666883968:12345-0@lo:400:kworker.0 Request processed in 37us (1876us total) trans 0 rc 0/0 00000100:00100000:2.0:1789136173.946955:0:19266:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00080000:2.0:1789136173.946974:0:17749:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789136173.946978:0:17749:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1789136173.946980:0:17749:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789136173.947533:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c5674000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1876044666883456:0@lo:400:kworker.0 00000100:00100000:2.0:1789136173.947547:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7fa3bd680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1876044666883968:0@lo:400:kworker.0 00000100:00100000:2.0:1789136173.947557:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7fa3bcf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3639:1876044666884480:0@lo:400:kworker.0 00000001:00100000:1.0:1789136173.948552:0:20083:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 2a472c6c-d1e0-40bc-9d80-35f3f0adb443 00000020:00000080:1.0:1789136173.948560:0:20083:0:(genops.c:885:class_export_put()) final put ffff90a7fa379800/2a472c6c-d1e0-40bc-9d80-35f3f0adb443 00000001:00100000:1.0:1789136173.948759:0:20083:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 8615a57a-8113-4aad-917f-27cc7b9dd43a 00000020:00000080:1.0:1789136173.948763:0:20083:0:(genops.c:885:class_export_put()) final put ffff90a7d0670000/8615a57a-8113-4aad-917f-27cc7b9dd43a 00000020:00000080:2.0:1789136173.948841:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff90a7fa379800/2a472c6c-d1e0-40bc-9d80-35f3f0adb443 for lustre-OST0001 00000020:00000080:2.0:1789136173.948918:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff90a7d0670000/8615a57a-8113-4aad-917f-27cc7b9dd43a for lustre-OST0001 00000020:00000080:2.0:1789136173.948945:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff90a7fa378800 for lustre-OST0001 00000020:00000080:2.0:1789136173.948950:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff90a7c6311000 for lustre-OST0001 00000100:00100000:3.0:1789136173.949374:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c5676d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1876044666883840:0@lo:400:kworker.0 00010000:00080000:3.0:1789136173.949393:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90a7fa3be940 x1876044666884352/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789136189 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789136173.949404:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7fa3be940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3638:1876044666884352:0@lo:400:kworker.0 00010000:00010000:3.0:1789136174.442053:0:17742:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1789136174.729558:0:21142:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1d: Test Project ID with remote access ========================================================== 10:16:12 (1789136172) 00000100:00100000:2.0:1789136174.952844:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789136174.952893:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c5676d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1876044666884736:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789136174.952994:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789136174.953143:0:19268:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666884736 00000100:00100000:0.0:1789136174.953152:0:19268:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666884736 00000100:00100000:0.0:1789136174.953207:0:19268:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1789136174.953218:0:19268:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7fa35bc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1876044666884736:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789136174.953247:0:19268:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 4218880 granted 17886912 pending 0 free 3915853824 avail 3684331520 00000100:00100000:0.0:1789136174.953303:0:19268:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7fa35bc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1876044666884736:12345-0@lo:13:osp-pre-0-0.0 Request processed in 87us (309us total) trans 0 rc 0/0 00000100:00100000:0.0:1789136174.953311:0:19268:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1789136174.953426:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c5676d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1876044666884736:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1789136175.470665:0:17741:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789136175.976261:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789136175.976286:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7fa35a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1876044666884864:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1789136175.976372:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789136175.976429:0:17758:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666884864 00000100:00100000:2.0:1789136175.976436:0:17758:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666884864 00000100:00100000:2.0:1789136175.976490:0:17758:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1789136175.976499:0:17758:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7fa3583c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3639:x1876044666884864:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1789136175.976536:0:17758:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446293504 avail 1300054016 00000100:00100000:0.0:1789136175.976680:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c5674000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1876044666884992:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1789136175.976712:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789136175.976745:0:19269:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666884992 00000100:00100000:0.0:1789136175.976749:0:19269:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666884992 00000100:00100000:0.0:1789136175.976801:0:19269:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1789136175.976809:0:19269:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c5676580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1876044666884992:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1789136175.976823:0:19269:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 4218880 granted 17886912 pending 0 free 3915853824 avail 3684331520 00000100:00100000:0.0:1789136175.976884:0:19269:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c5676580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1876044666884992:12345-0@lo:13:osp-pre-0-1.0 Request processed in 76us (170us total) trans 0 rc 0/0 00000100:00100000:0.0:1789136175.976892:0:19269:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1789136175.976939:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c5674000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1876044666884992:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1789136175.977170:0:17758:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7fa3583c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3639:x1876044666884864:12345-0@lo:41:osp-pre-0-1.0 Request processed in 671us (797us total) trans 0 rc 0/0 00000100:00100000:2.0:1789136175.977177:0:17758:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00080000:2.0:1789136175.977200:0:17749:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789136175.977301:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7fa35a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1876044666884864:0@lo:41:osp-pre-0-1.0 00000001:00080000:1.0:1789136175.986680:0:17733:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934623 is committed 00000020:00080000:1.0:1789136175.986700:0:17733:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 4294967529 batchid updated 00000020:00080000:2.0:1789136175.986929:0:17795:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4294967529 00000020:00080000:2.0:1789136175.986942:0:17795:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4294967529 00000100:00100000:0.0:1789136176.488685:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789136176.488719:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7fa35b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1876044666885120:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1789136176.488822:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789136176.488960:0:17758:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666885120 00000100:00100000:2.0:1789136176.488971:0:17758:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666885120 00000100:00100000:2.0:1789136176.489040:0:17758:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1789136176.489051:0:17758:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c5674000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3641:x1876044666885120:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1789136176.489098:0:17758:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00010000:00010000:0.0:1789136176.492965:0:17742:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789136176.499568:0:17758:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c5674000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3641:x1876044666885120:12345-0@lo:41:osp-pre-1-0.0 Request processed in 10508us (10737us total) trans 0 rc 0/0 00000100:00100000:2.0:1789136176.499596:0:17758:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1789136176.499651:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7fa35b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1876044666885120:0@lo:41:osp-pre-1-0.0 00000040:00080000:0.0:1789136177.270622:0:18511:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1789136177.512122:0:17741:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789136178.177398:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:2.0:1789136178.177452:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:2.0:1789136178.177491:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:2.0:1789136178.177526:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:2.0:1789136178.177549:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:2.0:1789136178.177583:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:2.0:1789136178.177613:0:20655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644766720 00000100:00100000:2.0:1789136178.177622:0:20655:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644766720 00000100:00100000:2.0:1789136178.177702:0:20655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 44 00000100:00100000:2.0:1789136178.177716:0:20655:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7fa358b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:8615a57a-8113-4aad-917f-27cc7b9dd43a+5:2390:x1876044644766720:12345-192.168.201.31@tcp:400:kworker.0 00000100:00100000:2.0:1789136178.177796:0:20655:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7fa358b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:8615a57a-8113-4aad-917f-27cc7b9dd43a+5:2390:x1876044644766720:12345-192.168.201.31@tcp:400:kworker.0 Request processed in 84us (244us total) trans 0 rc 0/0 00000100:00100000:2.0:1789136178.177804:0:20655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 44 00000100:00100000:2.0:1789136178.177831:0:17755:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644766592 00000100:00100000:2.0:1789136178.177835:0:17755:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644766592 00000100:00100000:2.0:1789136178.177888:0:17755:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644766848 00000100:00100000:2.0:1789136178.177892:0:17755:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644766848 00000100:00100000:2.0:1789136178.177905:0:17755:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644766464 00000100:00100000:2.0:1789136178.177908:0:17755:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644766464 00000100:00100000:2.0:1789136178.177917:0:17755:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644766976 00000100:00100000:2.0:1789136178.177919:0:17755:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644766976 00000100:00100000:2.0:1789136178.177932:0:17755:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 99 00000100:00100000:2.0:1789136178.177937:0:17755:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7fa35a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8615a57a-8113-4aad-917f-27cc7b9dd43a+5:2390:x1876044644766592:12345-192.168.201.31@tcp:400:kworker.0 00000100:00100000:3.0:1789136178.178071:0:17746:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644766336 00000100:00100000:3.0:1789136178.178075:0:17746:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644766336 00000100:00100000:3.0:1789136178.178112:0:17746:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 173 00000100:00100000:3.0:1789136178.178119:0:17746:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7fa9fa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d7d35a68-30a0-4475-a8ab-9673ac334408+13:2390:x1876044644766336:12345-192.168.201.31@tcp:400:kworker.0 00000100:00100000:3.0:1789136178.178156:0:17746:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7fa9fa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d7d35a68-30a0-4475-a8ab-9673ac334408+13:2390:x1876044644766336:12345-192.168.201.31@tcp:400:kworker.0 Request processed in 37us (771us total) trans 0 rc 0/0 00000100:00100000:3.0:1789136178.178175:0:17746:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 173 00000100:00080000:3.0:1789136178.178215:0:17749:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789136178.178219:0:17749:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1789136178.178221:0:17749:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789136178.178413:0:18920:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 100 00000100:00100000:1.0:1789136178.178423:0:18920:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7fa3592c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2a472c6c-d1e0-40bc-9d80-35f3f0adb443+6:2390:x1876044644766848:12345-192.168.201.31@tcp:400:kworker.0 00000100:00100000:1.0:1789136178.178453:0:18920:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7fa3592c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2a472c6c-d1e0-40bc-9d80-35f3f0adb443+6:2390:x1876044644766848:12345-192.168.201.31@tcp:400:kworker.0 Request processed in 33us (961us total) trans 0 rc 0/0 00000100:00100000:1.0:1789136178.178459:0:18920:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 100 00000100:00100000:1.0:1789136178.178476:0:18920:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 101 00000100:00100000:1.0:1789136178.178482:0:18920:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7fa358000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8615a57a-8113-4aad-917f-27cc7b9dd43a+13:2390:x1876044644766464:12345-192.168.201.31@tcp:400:kworker.0 00000100:00100000:1.0:1789136178.178519:0:18920:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7fa358000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8615a57a-8113-4aad-917f-27cc7b9dd43a+13:2390:x1876044644766464:12345-192.168.201.31@tcp:400:kworker.0 Request processed in 37us (992us total) trans 0 rc 0/0 00000100:00100000:1.0:1789136178.178526:0:18920:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 101 00000100:00100000:1.0:1789136178.178538:0:18920:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 102 00000100:00100000:1.0:1789136178.178544:0:18920:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7fa359680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2a472c6c-d1e0-40bc-9d80-35f3f0adb443+5:2390:x1876044644766976:12345-192.168.201.31@tcp:400:kworker.0 00000100:00100000:1.0:1789136178.178564:0:18920:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7fa359680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2a472c6c-d1e0-40bc-9d80-35f3f0adb443+5:2390:x1876044644766976:12345-192.168.201.31@tcp:400:kworker.0 Request processed in 21us (982us total) trans 0 rc 0/0 00000100:00100000:1.0:1789136178.178570:0:18920:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 102 00000100:00100000:2.0:1789136178.181240:0:17755:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7fa35a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8615a57a-8113-4aad-917f-27cc7b9dd43a+5:2390:x1876044644766592:12345-192.168.201.31@tcp:400:kworker.0 Request processed in 3286us (3771us total) trans 0 rc 0/0 00000100:00100000:2.0:1789136178.181284:0:17755:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 99 00010000:00010000:0.0:1789136178.536534:0:17742:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789136179.050606:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789136179.050634:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c460f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1876044666885248:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789136179.050743:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789136179.050825:0:20582:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666885248 00000100:00100000:1.0:1789136179.050832:0:20582:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666885248 00000100:00100000:1.0:1789136179.050910:0:20582:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1789136179.050920:0:20582:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7fa7de580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1876044666885248:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789136179.050953:0:20582:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923501056 avail 3691978752 00000100:00100000:1.0:1789136179.051001:0:20582:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7fa7de580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1876044666885248:12345-0@lo:13:osp-pre-1-0.0 Request processed in 83us (259us total) trans 0 rc 0/0 00000100:00100000:1.0:1789136179.051009:0:20582:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00080000:1.0:1789136179.051031:0:17749:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789136179.051063:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c460f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1876044666885248:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789136179.051769:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789136179.051784:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7fa3be1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1876044666885376:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1789136179.051825:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789136179.051993:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c56761c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:511c13c6-847f-45db-8965-d0deb75673dc:3639:1876044666885504:0@lo:400:kworker.0 00000100:00100000:0.0:1789136179.052020:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789136179.052042:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7fa3a61c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1876044666886016:0@lo:400:kworker.0 00000100:00100000:0.0:1789136179.052061:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789136179.052074:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c46212c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3639:1876044666886528:0@lo:400:kworker.0 00000100:00100000:0.0:1789136179.052093:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789136179.052109:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1789136179.052114:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c5676d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3639:1876044666885888:0@lo:400:kworker.0 00000100:00100000:0.0:1789136179.052131:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789136179.052144:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c46230c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3639:1876044666886400:0@lo:400:kworker.0 00000100:00100000:0.0:1789136179.052160:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789136179.052181:0:17759:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666886016 00000100:00100000:0.0:1789136179.052185:0:17759:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666886016 00000100:00100000:0.0:1789136179.052213:0:17759:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:0.0:1789136179.052219:0:17759:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c4622940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3639:x1876044666886016:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789136179.052287:0:17759:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c4622940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3639:x1876044666886016:12345-0@lo:400:kworker.0 Request processed in 68us (224us total) trans 0 rc 0/0 00000100:00100000:0.0:1789136179.052295:0:17759:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:0.0:1789136179.052314:0:17753:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666886528 00000100:00100000:0.0:1789136179.052317:0:17753:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666886528 00000100:00100000:0.0:1789136179.052343:0:17753:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666885888 00000100:00100000:0.0:1789136179.052345:0:17753:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666885888 00000100:00100000:0.0:1789136179.052354:0:17753:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666886400 00000100:00100000:0.0:1789136179.052356:0:17753:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666886400 00000100:00100000:0.0:1789136179.052367:0:17753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:0.0:1789136179.052372:0:17753:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7f6689680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3639:x1876044666886528:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789136179.052397:0:17753:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7f6689680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3639:x1876044666886528:12345-0@lo:400:kworker.0 Request processed in 25us (303us total) trans 0 rc 0/0 00000100:00100000:0.0:1789136179.052403:0:17753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:0.0:1789136179.052411:0:17753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:0.0:1789136179.052416:0:17753:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7f6689e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3639:x1876044666885888:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789136179.052435:0:17753:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7f6689e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3639:x1876044666885888:12345-0@lo:400:kworker.0 Request processed in 19us (304us total) trans 0 rc 0/0 00000100:00100000:0.0:1789136179.052440:0:17753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:0.0:1789136179.052448:0:17753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:0.0:1789136179.052452:0:17753:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7f6688f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3639:x1876044666886400:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789136179.052473:0:17753:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7f6688f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3639:x1876044666886400:12345-0@lo:400:kworker.0 Request processed in 20us (312us total) trans 0 rc 0/0 00000100:00100000:0.0:1789136179.052478:0:17753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:0.0:1789136179.052498:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c5674b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1876044666885632:0@lo:400:kworker.0 00000100:00100000:0.0:1789136179.052519:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789136179.052541:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c4620b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1876044666886144:0@lo:400:kworker.0 00000100:00100000:0.0:1789136179.052564:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789136179.052580:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c4623840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3640:1876044666886656:0@lo:400:kworker.0 00000100:00100000:0.0:1789136179.052599:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789136179.052613:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:0.0:1789136179.052618:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c5674780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1876044666885760:0@lo:400:kworker.0 00000100:00100000:0.0:1789136179.052637:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789136179.052649:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c4620000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3640:1876044666886272:0@lo:400:kworker.0 00000100:00100000:0.0:1789136179.052667:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789136179.052820:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c4622580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3640:1876044666886784:0@lo:400:kworker.0 00000100:00100000:0.0:1789136179.052842:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789136179.052889:0:19267:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666886144 00000100:00100000:0.0:1789136179.052893:0:19267:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666886144 00000100:00100000:0.0:1789136179.052918:0:19267:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666885760 00000100:00100000:0.0:1789136179.052921:0:19267:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666885760 00000100:00100000:0.0:1789136179.052934:0:19267:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1789136179.052940:0:19267:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7f6688780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3640:x1876044666886144:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789136179.052973:0:19267:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7f6688780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3640:x1876044666886144:12345-0@lo:400:kworker.0 Request processed in 33us (408us total) trans 0 rc 0/0 00000100:00100000:0.0:1789136179.052979:0:19267:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1789136179.052990:0:19267:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1789136179.052994:0:19267:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7f66883c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3640:x1876044666885760:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789136179.053016:0:19267:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7f66883c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3640:x1876044666885760:12345-0@lo:400:kworker.0 Request processed in 22us (379us total) trans 0 rc 0/0 00000100:00100000:0.0:1789136179.053021:0:19267:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1789136179.053034:0:17754:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666886656 00000100:00100000:0.0:1789136179.053043:0:17754:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666886656 00000100:00100000:0.0:1789136179.053063:0:17754:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666886272 00000100:00100000:0.0:1789136179.053065:0:17754:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666886272 00000100:00100000:0.0:1789136179.053074:0:17754:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666886784 00000100:00100000:0.0:1789136179.053076:0:17754:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666886784 00000100:00100000:0.0:1789136179.053088:0:17754:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:0.0:1789136179.053093:0:17754:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7f668bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3640:x1876044666886656:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789136179.053123:0:17754:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7f668bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3640:x1876044666886656:12345-0@lo:400:kworker.0 Request processed in 30us (523us total) trans 0 rc 0/0 00000100:00100000:0.0:1789136179.053129:0:17754:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:0.0:1789136179.053139:0:17754:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:0.0:1789136179.053145:0:17754:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7f668b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3640:x1876044666886272:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789136179.053170:0:17754:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7f668b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3640:x1876044666886272:12345-0@lo:400:kworker.0 Request processed in 26us (501us total) trans 0 rc 0/0 00000100:00100000:0.0:1789136179.053175:0:17754:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:0.0:1789136179.053185:0:17754:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:0.0:1789136179.053190:0:17754:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7f668b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3640:x1876044666886784:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789136179.053215:0:17754:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7f668b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3640:x1876044666886784:12345-0@lo:400:kworker.0 Request processed in 25us (372us total) trans 0 rc 0/0 00000100:00100000:0.0:1789136179.053222:0:17754:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:0.0:1789136179.053238:0:17759:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666885632 00000100:00100000:0.0:1789136179.053241:0:17759:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666885632 00000100:00100000:0.0:1789136179.053272:0:17759:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:0.0:1789136179.053278:0:17759:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7f6689a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3640:x1876044666885632:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789136179.053306:0:17759:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7f6689a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3640:x1876044666885632:12345-0@lo:400:kworker.0 Request processed in 29us (786us total) trans 0 rc 0/0 00000100:00100000:0.0:1789136179.053312:0:17759:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:0.0:1789136179.053360:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c5676d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3639:1876044666885888:0@lo:400:kworker.0 00000100:00100000:0.0:1789136179.053370:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c46230c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3639:1876044666886400:0@lo:400:kworker.0 00000100:00100000:0.0:1789136179.053380:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7fa3a61c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1876044666886016:0@lo:400:kworker.0 00010000:00080000:0.0:1789136179.053391:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90a6c46212c0 x1876044666886528/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789136195 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789136179.053402:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c46212c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3639:1876044666886528:0@lo:400:kworker.0 00000100:00100000:0.0:1789136179.053432:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c5674780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1876044666885760:0@lo:400:kworker.0 00000100:00100000:0.0:1789136179.053440:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c4620000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3640:1876044666886272:0@lo:400:kworker.0 00010000:00080000:0.0:1789136179.053449:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90a6c4622580 x1876044666886784/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789136195 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789136179.053457:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c4622580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3640:1876044666886784:0@lo:400:kworker.0 00000100:00100000:0.0:1789136179.053465:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c5674b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1876044666885632:0@lo:400:kworker.0 00000100:00100000:0.0:1789136179.053473:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c4620b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1876044666886144:0@lo:400:kworker.0 00000100:00100000:0.0:1789136179.053481:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c4623840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3640:1876044666886656:0@lo:400:kworker.0 00000100:00100000:3.0:1789136179.053688:0:19268:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666885376 00000100:00100000:3.0:1789136179.053693:0:19268:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666885376 00000100:00100000:3.0:1789136179.053735:0:19268:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1789136179.053742:0:19268:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c56752c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1876044666885376:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1789136179.053769:0:19268:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923501056 avail 3691978752 00000100:00100000:3.0:1789136179.053813:0:19268:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c56752c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1876044666885376:12345-0@lo:13:osp-pre-1-1.0 Request processed in 71us (1988us total) trans 0 rc 0/0 00000100:00100000:3.0:1789136179.053821:0:19268:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1789136179.053890:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7fa3be1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1876044666885376:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1789136179.054194:0:17745:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666885504 00000100:00100000:2.0:1789136179.054200:0:17745:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666885504 00000100:00100000:2.0:1789136179.054242:0:17745:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 174 00000100:00100000:2.0:1789136179.054250:0:17745:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7fa9f9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:511c13c6-847f-45db-8965-d0deb75673dc+24:3639:x1876044666885504:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789136179.054312:0:17745:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7fa9f9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:511c13c6-847f-45db-8965-d0deb75673dc+24:3639:x1876044666885504:12345-0@lo:400:kworker.0 Request processed in 63us (2291us total) trans 0 rc 0/0 00000100:00100000:2.0:1789136179.054318:0:17745:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 174 00000100:00100000:0.0:1789136179.054418:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c56761c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:511c13c6-847f-45db-8965-d0deb75673dc:3639:1876044666885504:0@lo:400:kworker.0 00000100:00080000:1.0:1789136179.054499:0:17749:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789136179.054506:0:17749:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789136179.054510:0:17749:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789136179.054512:0:17749:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:2.0:1789136179.560268:0:17741:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789136180.072306:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7f66892c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1876044666886912:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789136180.072411:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789136180.072583:0:19269:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666886912 00000100:00100000:0.0:1789136180.072592:0:19269:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666886912 00000100:00100000:0.0:1789136180.072654:0:19269:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1789136180.072664:0:19269:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7fa7dd2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1876044666886912:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789136180.072695:0:19269:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 4218880 granted 17886912 pending 0 free 3915853824 avail 3684331520 00000100:00100000:0.0:1789136180.072750:0:19269:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7fa7dd2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1876044666886912:12345-0@lo:13:osp-pre-0-0.0 Request processed in 87us (339us total) trans 0 rc 0/0 00000100:00100000:0.0:1789136180.072781:0:19269:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1789136180.072907:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7f66892c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1876044666886912:0@lo:13:osp-pre-0-0.0 00000040:00080000:0.0:1789136180.200556:0:17787:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:0.0:1789136180.200566:0:17787:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1789136180.200587:0:17787:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:0.0:1789136180.200598:0:17787:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00010000:00010000:0.0:1789136180.584142:0:17742:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789136180.978634:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:1.0:1789136180.978899:0:17756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644767232 00000100:00100000:1.0:1789136180.978911:0:17756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644767232 00000100:00100000:1.0:1789136180.978988:0:17756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 13 00000100:00100000:1.0:1789136180.978999:0:17756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7fa3be1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8615a57a-8113-4aad-917f-27cc7b9dd43a+13:16597:x1876044644767232:12345-192.168.201.31@tcp:35:umount.0 00000001:00080000:1.0:1789136180.979279:0:17756:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934624 00000001:00080000:1.0:1789136180.979376:0:17756:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934625 00000100:00100000:1.0:1789136180.979515:0:17756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7fa3be1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8615a57a-8113-4aad-917f-27cc7b9dd43a+16:16597:x1876044644767232:12345-192.168.201.31@tcp:35:umount.0 Request processed in 517us (891us total) trans 8589934626 rc 0/0 00000100:00100000:1.0:1789136180.979524:0:17756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 13 00000020:00080000:1.0:1789136180.979530:0:17756:0:(tgt_main.c:785:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00080000:2.0:1789136180.983965:0:17749:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789136180.989549:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:0.0:1789136180.989600:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:0.0:1789136180.989654:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:2.0:1789136180.989763:0:17740:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644767360 00000100:00100000:2.0:1789136180.989773:0:17740:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644767360 00000100:00100000:2.0:1789136180.989823:0:17740:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644767616 00000100:00100000:2.0:1789136180.989826:0:17740:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644767616 00000100:00100000:2.0:1789136180.989840:0:17740:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644767488 00000100:00100000:2.0:1789136180.989843:0:17740:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644767488 00000100:00100000:2.0:1789136180.989902:0:17740:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 3 00000100:00100000:2.0:1789136180.989913:0:17740:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7f668a1c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d7d35a68-30a0-4475-a8ab-9673ac334408+15:2391:x1876044644767360:12345-192.168.201.31@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789136180.989930:0:17740:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789136180.989949:0:17740:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90a7e1c9ea00/0x559c8745c6de4074 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x44801000000000 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08d19 expref: 15 pid: 17745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136180.989967:0:17740:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789136180.990018:0:17740:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7f668a1c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d7d35a68-30a0-4475-a8ab-9673ac334408+14:2391:x1876044644767360:12345-192.168.201.31@tcp:103:ldlm_bl.0 Request processed in 107us (481us total) trans 0 rc 0/0 00000100:00100000:2.0:1789136180.990025:0:17740:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 3 00000100:00100000:2.0:1789136180.990043:0:17740:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 4 00000100:00100000:2.0:1789136180.990059:0:17740:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7f6bc1850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d7d35a68-30a0-4475-a8ab-9673ac334408+13:2391:x1876044644767616:12345-192.168.201.31@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789136180.990067:0:17740:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789136180.990076:0:17740:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90a7e1c9f800/0x559c8745c6de4138 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08e00 expref: 13 pid: 17747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136180.990086:0:17740:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789136180.990106:0:17740:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7f6bc1850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d7d35a68-30a0-4475-a8ab-9673ac334408+12:2391:x1876044644767616:12345-192.168.201.31@tcp:103:ldlm_bl.0 Request processed in 48us (505us total) trans 0 rc 0/0 00000100:00100000:2.0:1789136180.990111:0:17740:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 4 00000100:00100000:2.0:1789136180.990160:0:17740:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 5 00000100:00100000:2.0:1789136180.990167:0:17740:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7f6688b40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d7d35a68-30a0-4475-a8ab-9673ac334408+11:2391:x1876044644767488:12345-192.168.201.31@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789136180.990173:0:17740:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789136180.990181:0:17740:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90a6c3caf800/0x559c8745c6de407b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08d4a expref: 11 pid: 17745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136180.990190:0:17740:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789136180.990206:0:17740:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7f6688b40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d7d35a68-30a0-4475-a8ab-9673ac334408+10:2391:x1876044644767488:12345-192.168.201.31@tcp:103:ldlm_bl.0 Request processed in 41us (552us total) trans 0 rc 0/0 00000100:00100000:2.0:1789136180.990213:0:17740:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 5 00000100:00100000:3.0:1789136181.012930:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:0.0:1789136181.013194:0:19572:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644767744 00000100:00100000:0.0:1789136181.013204:0:19572:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644767744 00000100:00100000:0.0:1789136181.013302:0:19572:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 35 00000100:00100000:0.0:1789136181.013313:0:19572:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7fa3bc3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8615a57a-8113-4aad-917f-27cc7b9dd43a+5:2388:x1876044644767744:12345-192.168.201.31@tcp:9:umount.0 00000020:00000080:0.0:1789136181.013352:0:19572:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x559c8745c6de4097 00000100:00080000:0.0:1789136181.013363:0:19572:0:(import.c:65:import_set_state_nolock()) ffff90a7d0673800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1789136181.013418:0:19572:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934600 00000100:00100000:0.0:1789136181.013580:0:19572:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7fa3bc3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8615a57a-8113-4aad-917f-27cc7b9dd43a+2:2388:x1876044644767744:12345-192.168.201.31@tcp:9:umount.0 Request processed in 269us (661us total) trans 0 rc 0/0 00000100:00100000:0.0:1789136181.013588:0:19572:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 35 00000100:00080000:2.0:1789136181.013976:0:17749:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1789136181.014163:0:17741:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789136181.039096:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:2.0:1789136181.039192:0:17754:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644768640 00000100:00100000:2.0:1789136181.039201:0:17754:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644768640 00000100:00100000:2.0:1789136181.039276:0:17754:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 67 00000100:00100000:2.0:1789136181.039287:0:17754:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7f668ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8615a57a-8113-4aad-917f-27cc7b9dd43a+16:2388:x1876044644768640:12345-192.168.201.31@tcp:39:umount.0 00000020:00000080:2.0:1789136181.039322:0:17754:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x559c8745c6de4089 00000020:00010000:2.0:1789136181.039339:0:17754:0:(genops.c:1921:obd_stale_export_put()) Put export ffff90a6c4c41000: total 0 00000100:00080000:2.0:1789136181.039343:0:17754:0:(import.c:65:import_set_state_nolock()) ffff90a6c4c42000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1789136181.039392:0:17754:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934626 00000100:00100000:2.0:1789136181.039566:0:17754:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7f668ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8615a57a-8113-4aad-917f-27cc7b9dd43a+15:2388:x1876044644768640:12345-192.168.201.31@tcp:39:umount.0 Request processed in 279us (476us total) trans 8589934627 rc 0/0 00000100:00100000:2.0:1789136181.039574:0:17754:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 67 00000020:00010000:3.0:1789136181.040143:0:17742:0:(genops.c:1907:obd_stale_export_get()) Get export ffff90a6c4c41000: total 0 00010000:00010000:3.0:1789136181.040149:0:17742:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789136181.040267:0:17742:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff90a6c4c41000, canceled 0 locks, left on hash table 8. 00010000:00010000:3.0:1789136181.040307:0:17742:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff90a7c3817100) 00010000:00010000:3.0:1789136181.040311:0:17742:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789136181.040320:0:17742:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a7e1c9e000/0x559c8745c6de4154 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08e07 expref: 14 pid: 17754 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136181.040395:0:17742:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff90a7e0aa7700) 00010000:00010000:3.0:1789136181.040398:0:17742:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1789136181.040403:0:17742:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1879a00/0x559c8745c6de4234 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08e46 expref: 13 pid: 18920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136181.040450:0:17742:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff90a7c3817500) 00010000:00010000:3.0:1789136181.040453:0:17742:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1789136181.040458:0:17742:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3cae600/0x559c8745c6de42e3 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08e85 expref: 12 pid: 17754 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136181.040471:0:17742:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff90a7c3817500) 00010000:00010000:3.0:1789136181.040474:0:17742:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1789136181.040477:0:17742:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1878600/0x559c8745c6de42b2 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08e70 expref: 11 pid: 17755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136181.040489:0:17742:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90a7c3817d00) 00010000:00010000:3.0:1789136181.040491:0:17742:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789136181.040494:0:17742:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a7e1c9f600/0x559c8745c6de41af lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08e1c expref: 10 pid: 17753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136181.040505:0:17742:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff90a7c3817500) 00010000:00010000:3.0:1789136181.040507:0:17742:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1789136181.040510:0:17742:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3caea00/0x559c8745c6de4399 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08ebd expref: 9 pid: 17753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136181.040524:0:17742:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff90a7e0aa7600) 00010000:00010000:3.0:1789136181.040527:0:17742:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789136181.040530:0:17742:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c167d800/0x559c8745c6de4170 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08e0e expref: 8 pid: 18920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136181.040544:0:17742:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff90a7fa59e600) 00010000:00010000:3.0:1789136181.040547:0:17742:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1789136181.040558:0:17742:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3cafe00/0x559c8745c6de433e lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08e9a expref: 7 pid: 17753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136181.040574:0:17742:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff90a6c4c41000, canceled 8 locks, left on hash table 0. 00010000:00010000:3.0:1789136181.040588:0:17742:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789136181.040590:0:17742:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789136181.040592:0:17742:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789136181.073133:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:2.0:1789136181.073252:0:18920:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644768768 00000100:00100000:2.0:1789136181.073262:0:18920:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644768768 00000100:00100000:2.0:1789136181.073345:0:18920:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 68 00000100:00100000:2.0:1789136181.073357:0:18920:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7f668b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8615a57a-8113-4aad-917f-27cc7b9dd43a+5:2388:x1876044644768768:12345-192.168.201.31@tcp:39:umount.0 00000020:00000080:2.0:1789136181.073402:0:18920:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x559c8745c6de4090 00000100:00080000:2.0:1789136181.073420:0:18920:0:(import.c:65:import_set_state_nolock()) ffff90a6c4c43000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1789136181.073466:0:18920:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 2, last_transno is 8589934592 00000100:00100000:2.0:1789136181.073693:0:18920:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7f668b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8615a57a-8113-4aad-917f-27cc7b9dd43a+3:2388:x1876044644768768:12345-192.168.201.31@tcp:39:umount.0 Request processed in 338us (569us total) trans 8589934593 rc 0/0 00000100:00100000:2.0:1789136181.073702:0:18920:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 68 00010000:00010000:0.0:1789136181.073796:0:17741:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1789136181.074000:0:17749:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1789136181.096250:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7f668a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1876044666887040:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1789136181.096331:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789136181.096409:0:20582:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666887040 00000100:00100000:3.0:1789136181.096417:0:20582:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666887040 00000100:00100000:3.0:1789136181.096490:0:20582:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1789136181.096502:0:20582:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7fa3bf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1876044666887040:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1789136181.096529:0:20582:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3915853824 avail 3684331520 00000100:00100000:3.0:1789136181.096573:0:20582:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7fa3bf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1876044666887040:12345-0@lo:13:osp-pre-0-1.0 Request processed in 73us (241us total) trans 0 rc 0/0 00000100:00100000:3.0:1789136181.096580:0:20582:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1789136181.096628:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7f668a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1876044666887040:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1789136181.097205:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7fa35ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1876044666887168:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1789136181.097258:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789136181.097402:0:17759:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666887168 00000100:00100000:2.0:1789136181.097407:0:17759:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666887168 00000100:00100000:2.0:1789136181.097446:0:17759:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:2.0:1789136181.097461:0:17759:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7f6688000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3640:x1876044666887168:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1789136181.097487:0:17759:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446293504 avail 1300054016 00000100:00100000:2.0:1789136181.097526:0:17759:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7f6688000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3640:x1876044666887168:12345-0@lo:41:osp-pre-0-1.0 Request processed in 73us (268us total) trans 0 rc 0/0 00000100:00100000:2.0:1789136181.097532:0:17759:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:0.0:1789136181.097655:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7fa35ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1876044666887168:0@lo:41:osp-pre-0-1.0 00000100:00080000:1.0:1789136181.100720:0:17749:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1789136181.608539:0:17742:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789136181.609719:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7fa359e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1876044666887296:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1789136181.609797:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789136181.609921:0:17759:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666887296 00000100:00100000:2.0:1789136181.609929:0:17759:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666887296 00000100:00100000:2.0:1789136181.609995:0:17759:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:2.0:1789136181.610004:0:17759:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7fa3bf840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3641:x1876044666887296:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1789136181.610038:0:17759:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446461440 avail 1300221952 00000100:00100000:2.0:1789136181.610123:0:17759:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7fa3bf840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3641:x1876044666887296:12345-0@lo:41:osp-pre-1-0.0 Request processed in 119us (326us total) trans 0 rc 0/0 00000100:00100000:2.0:1789136181.610129:0:17759:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:3.0:1789136181.610225:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7fa359e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1876044666887296:0@lo:41:osp-pre-1-0.0 00010000:00010000:0.0:1789136182.633822:0:17741:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789136183.283028:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:1.0:1789136183.283078:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:2.0:1789136183.283414:0:17754:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644769024 00000100:00100000:2.0:1789136183.283426:0:17754:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644769024 00000100:00100000:1.0:1789136183.283603:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00080000:3.0:1789136183.283967:0:17749:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789136183.284001:0:17747:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644768896 00000100:00100000:3.0:1789136183.284006:0:17747:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644768896 00000100:00100000:3.0:1789136183.284047:0:17747:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 175 00000100:00100000:3.0:1789136183.284057:0:17747:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7fa9f9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d7d35a68-30a0-4475-a8ab-9673ac334408+10:2389:x1876044644768896:12345-192.168.201.31@tcp:400:kworker.0 00000100:00100000:3.0:1789136183.284169:0:17747:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7fa9f9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d7d35a68-30a0-4475-a8ab-9673ac334408+10:2389:x1876044644768896:12345-192.168.201.31@tcp:400:kworker.0 Request processed in 102us (1078us total) trans 0 rc 0/0 00000100:00100000:3.0:1789136183.284186:0:17747:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 175 00000100:00100000:2.0:1789136183.297782:0:17754:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644769152 00000100:00100000:2.0:1789136183.297799:0:17754:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644769152 00000100:00100000:2.0:1789136183.297938:0:17754:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 109 00000100:00100000:2.0:1789136183.297958:0:17754:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7fa7dc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2a472c6c-d1e0-40bc-9d80-35f3f0adb443+6:2389:x1876044644769024:12345-192.168.201.31@tcp:400:kworker.0 00000100:00100000:2.0:1789136183.298055:0:17754:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7fa7dc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2a472c6c-d1e0-40bc-9d80-35f3f0adb443+6:2389:x1876044644769024:12345-192.168.201.31@tcp:400:kworker.0 Request processed in 107us (15037us total) trans 0 rc 0/0 00000100:00100000:2.0:1789136183.298062:0:17754:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 109 00000100:00100000:2.0:1789136183.298081:0:17754:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 110 00000100:00100000:2.0:1789136183.298088:0:17754:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7fa7dcb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2a472c6c-d1e0-40bc-9d80-35f3f0adb443+5:2389:x1876044644769152:12345-192.168.201.31@tcp:400:kworker.0 00000100:00100000:2.0:1789136183.298113:0:17754:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7fa7dcb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2a472c6c-d1e0-40bc-9d80-35f3f0adb443+5:2389:x1876044644769152:12345-192.168.201.31@tcp:400:kworker.0 Request processed in 26us (14512us total) trans 0 rc 0/0 00000100:00100000:2.0:1789136183.298120:0:17754:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 110 00000100:00080000:1.0:1789136183.298451:0:17749:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:3.0:1789136183.661291:0:17742:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789136184.168308:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7fa3bcb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1876044666887808:0@lo:400:kworker.0 00000100:00100000:3.0:1789136184.168378:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789136184.168441:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7fa3bd680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1876044666888320:0@lo:400:kworker.0 00000100:00100000:3.0:1789136184.168462:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789136184.168477:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7fa349a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3641:1876044666888832:0@lo:400:kworker.0 00000100:00100000:3.0:1789136184.168503:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789136184.168528:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:3.0:1789136184.168534:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7fa3bc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1876044666887680:0@lo:400:kworker.0 00000100:00100000:3.0:1789136184.168555:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789136184.168573:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7fa3bcf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1876044666888192:0@lo:400:kworker.0 00000100:00100000:3.0:1789136184.168593:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789136184.168607:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7fa3bed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3641:1876044666888704:0@lo:400:kworker.0 00000100:00100000:3.0:1789136184.168627:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789136184.168656:0:19265:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666887808 00000100:00100000:3.0:1789136184.168663:0:19265:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666887808 00000100:00100000:3.0:1789136184.168710:0:19265:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666888320 00000100:00100000:3.0:1789136184.168713:0:19265:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666888320 00000100:00100000:3.0:1789136184.168725:0:19265:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666887680 00000100:00100000:3.0:1789136184.168727:0:19265:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666887680 00000100:00100000:3.0:1789136184.168739:0:19265:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666888192 00000100:00100000:3.0:1789136184.168741:0:19265:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666888192 00000100:00100000:3.0:1789136184.168755:0:19265:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1789136184.168761:0:19265:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7fa34bc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3641:x1876044666887808:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789136184.168818:0:19265:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7fa34bc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3641:x1876044666887808:12345-0@lo:400:kworker.0 Request processed in 56us (439us total) trans 0 rc 0/0 00000100:00100000:3.0:1789136184.168826:0:19265:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1789136184.168843:0:19265:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1789136184.168848:0:19265:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7fa34a1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3641:x1876044666888320:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789136184.168899:0:19265:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7fa34a1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3641:x1876044666888320:12345-0@lo:400:kworker.0 Request processed in 50us (435us total) trans 0 rc 0/0 00000100:00100000:3.0:1789136184.168905:0:19265:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1789136184.168915:0:19265:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1789136184.168920:0:19265:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7fa34b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3641:x1876044666887680:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789136184.168945:0:19265:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7fa34b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3641:x1876044666887680:12345-0@lo:400:kworker.0 Request processed in 25us (389us total) trans 0 rc 0/0 00000100:00100000:3.0:1789136184.168951:0:19265:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1789136184.168961:0:19265:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1789136184.168968:0:19265:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7fa34b840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3641:x1876044666888192:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789136184.168992:0:19265:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7fa34b840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3641:x1876044666888192:12345-0@lo:400:kworker.0 Request processed in 25us (398us total) trans 0 rc 0/0 00000100:00100000:3.0:1789136184.168998:0:19265:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1789136184.169017:0:17755:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666888832 00000100:00100000:3.0:1789136184.169021:0:17755:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666888832 00000100:00100000:3.0:1789136184.169044:0:17755:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666888704 00000100:00100000:3.0:1789136184.169047:0:17755:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666888704 00000100:00100000:3.0:1789136184.169062:0:17755:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:3.0:1789136184.169068:0:17755:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7fa3483c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3641:x1876044666888832:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789136184.169098:0:17755:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7fa3483c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3641:x1876044666888832:12345-0@lo:400:kworker.0 Request processed in 30us (595us total) trans 0 rc 0/0 00000100:00100000:3.0:1789136184.169112:0:17755:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:3.0:1789136184.169123:0:17755:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:3.0:1789136184.169128:0:17755:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7fa34a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3641:x1876044666888704:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789136184.169151:0:17755:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7fa34a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3641:x1876044666888704:12345-0@lo:400:kworker.0 Request processed in 23us (523us total) trans 0 rc 0/0 00000100:00100000:3.0:1789136184.169155:0:17755:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00080000:3.0:1789136184.169182:0:17749:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1789136184.169186:0:17749:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789136184.169188:0:17749:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789136184.169190:0:17749:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789136184.169452:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7fa3be580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:511c13c6-847f-45db-8965-d0deb75673dc:3638:1876044666887424:0@lo:400:kworker.0 00000100:00100000:0.0:1789136184.169487:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789136184.169521:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7fa3bfc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3638:1876044666887936:0@lo:400:kworker.0 00000100:00100000:0.0:1789136184.169545:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789136184.169562:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7fa3bde00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3638:1876044666888448:0@lo:400:kworker.0 00000100:00100000:0.0:1789136184.169583:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789136184.169593:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7fa348780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3638:1876044666888960:0@lo:400:kworker.0 00000100:00100000:0.0:1789136184.169610:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789136184.169623:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:0.0:1789136184.169629:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7fa3bd2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1876044666887552:0@lo:400:kworker.0 00000100:00100000:0.0:1789136184.169651:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789136184.169665:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7fa3be940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1876044666888064:0@lo:400:kworker.0 00000100:00100000:0.0:1789136184.169684:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789136184.169697:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7fa3bf0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3638:1876044666888576:0@lo:400:kworker.0 00000100:00100000:0.0:1789136184.169713:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789136184.169739:0:17753:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666887936 00000100:00100000:0.0:1789136184.169743:0:17753:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666887936 00000100:00100000:0.0:1789136184.169762:0:17753:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666888448 00000100:00100000:0.0:1789136184.169765:0:17753:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666888448 00000100:00100000:0.0:1789136184.169774:0:17753:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666888960 00000100:00100000:0.0:1789136184.169775:0:17753:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666888960 00000100:00100000:0.0:1789136184.169794:0:17753:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666888576 00000100:00100000:0.0:1789136184.169796:0:17753:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666888576 00000100:00100000:0.0:1789136184.169807:0:17753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:0.0:1789136184.169812:0:17753:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7f668a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1876044666887936:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789136184.169847:0:17753:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7f668a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1876044666887936:12345-0@lo:400:kworker.0 Request processed in 34us (301us total) trans 0 rc 0/0 00000100:00100000:0.0:1789136184.169882:0:17753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:0.0:1789136184.169896:0:17753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:0.0:1789136184.169902:0:17753:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7f668a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3638:x1876044666888448:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789136184.169932:0:17753:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7f668a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3638:x1876044666888448:12345-0@lo:400:kworker.0 Request processed in 31us (347us total) trans 0 rc 0/0 00000100:00100000:0.0:1789136184.169938:0:17753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:0.0:1789136184.169948:0:17753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:0.0:1789136184.169953:0:17753:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7f668a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3638:x1876044666888960:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789136184.169978:0:17753:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7f668a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3638:x1876044666888960:12345-0@lo:400:kworker.0 Request processed in 25us (366us total) trans 0 rc 0/0 00000100:00100000:0.0:1789136184.169983:0:17753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:0.0:1789136184.169993:0:17753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:0.0:1789136184.169999:0:17753:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7fa3a61c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3638:x1876044666888576:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789136184.170023:0:17753:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7fa3a61c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3638:x1876044666888576:12345-0@lo:400:kworker.0 Request processed in 25us (309us total) trans 0 rc 0/0 00000100:00100000:0.0:1789136184.170029:0:17753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:0.0:1789136184.170046:0:17746:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666887424 00000100:00100000:0.0:1789136184.170050:0:17746:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666887424 00000100:00100000:0.0:1789136184.170075:0:17746:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 176 00000100:00100000:0.0:1789136184.170081:0:17746:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7fa9f8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:511c13c6-847f-45db-8965-d0deb75673dc+24:3638:x1876044666887424:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789136184.170110:0:17746:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7fa9f8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:511c13c6-847f-45db-8965-d0deb75673dc+24:3638:x1876044666887424:12345-0@lo:400:kworker.0 Request processed in 30us (622us total) trans 0 rc 0/0 00000100:00100000:0.0:1789136184.170115:0:17746:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 176 00000100:00080000:0.0:1789136184.170136:0:17749:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789136184.170139:0:17749:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1789136184.170192:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7fa3bf0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3638:1876044666888576:0@lo:400:kworker.0 00000100:00100000:0.0:1789136184.170201:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7fa3be580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:511c13c6-847f-45db-8965-d0deb75673dc:3638:1876044666887424:0@lo:400:kworker.0 00000100:00100000:0.0:1789136184.170210:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7fa3bfc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3638:1876044666887936:0@lo:400:kworker.0 00000100:00100000:0.0:1789136184.170216:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7fa3bde00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3638:1876044666888448:0@lo:400:kworker.0 00010000:00080000:0.0:1789136184.170227:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90a7fa348780 x1876044666888960/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789136200 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789136184.170236:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7fa348780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3638:1876044666888960:0@lo:400:kworker.0 00000100:00100000:1.0:1789136184.170633:0:17758:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666887552 00000100:00100000:1.0:1789136184.170638:0:17758:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666887552 00000100:00100000:1.0:1789136184.170659:0:17758:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666888064 00000100:00100000:1.0:1789136184.170662:0:17758:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666888064 00000100:00100000:1.0:1789136184.170675:0:17758:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:1.0:1789136184.170682:0:17758:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7f66892c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3638:x1876044666887552:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789136184.170724:0:17758:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7f66892c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3638:x1876044666887552:12345-0@lo:400:kworker.0 Request processed in 42us (1072us total) trans 0 rc 0/0 00000100:00100000:1.0:1789136184.170730:0:17758:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:1.0:1789136184.170753:0:17758:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:1.0:1789136184.170760:0:17758:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7fa3a52c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3638:x1876044666888064:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789136184.170791:0:17758:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7fa3a52c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3638:x1876044666888064:12345-0@lo:400:kworker.0 Request processed in 32us (1105us total) trans 0 rc 0/0 00000100:00100000:1.0:1789136184.170797:0:17758:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:1.0:1789136184.170824:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7fa3bd2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1876044666887552:0@lo:400:kworker.0 00000100:00100000:1.0:1789136184.170835:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7fa3be940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1876044666888064:0@lo:400:kworker.0 00000100:00100000:1.0:1789136184.170848:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789136184.170873:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7fa7dd680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1876044666889088:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1789136184.170904:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789136184.170934:0:19269:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666889088 00000100:00100000:1.0:1789136184.170937:0:19269:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666889088 00000100:00100000:1.0:1789136184.170965:0:19269:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1789136184.170972:0:19269:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7fa7ded00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1876044666889088:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1789136184.170994:0:19269:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923501056 avail 3691978752 00000100:00100000:1.0:1789136184.171029:0:19269:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7fa7ded00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1876044666889088:12345-0@lo:13:osp-pre-1-1.0 Request processed in 57us (124us total) trans 0 rc 0/0 00000100:00100000:1.0:1789136184.171036:0:19269:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1789136184.171066:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7fa7dd680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1876044666889088:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1789136184.171156:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7fa3bc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1876044666887680:0@lo:400:kworker.0 00000100:00100000:3.0:1789136184.171366:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7fa3bcf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1876044666888192:0@lo:400:kworker.0 00010000:00080000:3.0:1789136184.171380:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90a7fa3bed00 x1876044666888704/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789136200 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789136184.171391:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7fa3bed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3641:1876044666888704:0@lo:400:kworker.0 00000100:00100000:3.0:1789136184.171403:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7fa3bcb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1876044666887808:0@lo:400:kworker.0 00000100:00100000:3.0:1789136184.171412:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7fa3bd680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1876044666888320:0@lo:400:kworker.0 00000100:00100000:3.0:1789136184.171422:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7fa349a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3641:1876044666888832:0@lo:400:kworker.0 00000100:00100000:2.0:1789136184.172595:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7fa3bd680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1876044666889216:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789136184.172651:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789136184.172745:0:19268:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666889216 00000100:00100000:0.0:1789136184.172751:0:19268:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666889216 00000100:00100000:0.0:1789136184.172796:0:19268:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1789136184.172806:0:19268:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7fa35a940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1876044666889216:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789136184.172826:0:19268:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923501056 avail 3691978752 00000100:00100000:0.0:1789136184.172900:0:19268:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7fa35a940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1876044666889216:12345-0@lo:13:osp-pre-1-0.0 Request processed in 95us (248us total) trans 0 rc 0/0 00000100:00100000:0.0:1789136184.172907:0:19268:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1789136184.173677:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7fa3bd680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1876044666889216:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1789136184.680675:0:17741:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789136185.131753:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:3.0:1789136185.131938:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:3.0:1789136185.134763:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:2.0:1789136185.136817:0:17740:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644769280 00000100:00100000:2.0:1789136185.136835:0:17740:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644769280 00000100:00100000:1.0:1789136185.151446:0:17738:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644769408 00000100:00100000:1.0:1789136185.151469:0:17738:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644769408 00000100:00100000:1.0:1789136185.151564:0:17738:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644769536 00000100:00100000:1.0:1789136185.151568:0:17738:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644769536 00000100:00100000:1.0:1789136185.151601:0:17738:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 6 00000100:00100000:1.0:1789136185.151625:0:17738:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7fa349a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d7d35a68-30a0-4475-a8ab-9673ac334408+12:2389:x1876044644769280:12345-192.168.201.31@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789136185.151646:0:17738:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789136185.151691:0:17738:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90a7ff5f5400/0x559c8745c6de40b3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x44801000000000 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08d89 expref: 12 pid: 17746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136185.151725:0:17738:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789136185.151817:0:17738:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7fa349a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d7d35a68-30a0-4475-a8ab-9673ac334408+11:2389:x1876044644769280:12345-192.168.201.31@tcp:103:ldlm_bl.0 Request processed in 194us (20080us total) trans 0 rc 0/0 00000100:00100000:1.0:1789136185.151826:0:17738:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 6 00000100:00100000:1.0:1789136185.151897:0:17738:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 7 00000100:00100000:1.0:1789136185.151905:0:17738:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7fa3492c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d7d35a68-30a0-4475-a8ab-9673ac334408+10:2389:x1876044644769408:12345-192.168.201.31@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789136185.151914:0:17738:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789136185.151924:0:17738:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90a7ff5f5000/0x559c8745c6de40ba lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08dba expref: 10 pid: 17746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136185.151934:0:17738:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789136185.151951:0:17738:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7fa3492c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d7d35a68-30a0-4475-a8ab-9673ac334408+9:2389:x1876044644769408:12345-192.168.201.31@tcp:103:ldlm_bl.0 Request processed in 48us (20014us total) trans 0 rc 0/0 00000100:00100000:1.0:1789136185.151959:0:17738:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 7 00000100:00100000:1.0:1789136185.152563:0:17738:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 8 00000100:00100000:1.0:1789136185.152572:0:17738:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7fa348000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d7d35a68-30a0-4475-a8ab-9673ac334408+8:2390:x1876044644769536:12345-192.168.201.31@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789136185.152583:0:17738:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789136185.152596:0:17738:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90a7c167c800/0x559c8745c6de4131 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08df9 expref: 8 pid: 17747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136185.152620:0:17738:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789136185.152663:0:17738:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7fa348000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d7d35a68-30a0-4475-a8ab-9673ac334408+7:2390:x1876044644769536:12345-192.168.201.31@tcp:103:ldlm_bl.0 Request processed in 92us (17915us total) trans 0 rc 0/0 00000100:00100000:1.0:1789136185.152670:0:17738:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 8 00000100:00100000:2.0:1789136185.193314:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789136185.193351:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7fa3bcb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1876044666889344:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789136185.193472:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789136185.193646:0:20582:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666889344 00000100:00100000:1.0:1789136185.193657:0:20582:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666889344 00000100:00100000:1.0:1789136185.193728:0:20582:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1789136185.193739:0:20582:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7fa358f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1876044666889344:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789136185.193778:0:20582:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3915853824 avail 3684331520 00000100:00100000:1.0:1789136185.193840:0:20582:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7fa358f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1876044666889344:12345-0@lo:13:osp-pre-0-0.0 Request processed in 103us (370us total) trans 0 rc 0/0 00000100:00100000:1.0:1789136185.193877:0:20582:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1789136185.198098:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7fa3bcb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1876044666889344:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789136185.221777:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:0.0:1789136185.222013:0:17753:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644769792 00000100:00100000:0.0:1789136185.222027:0:17753:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644769792 00000100:00100000:0.0:1789136185.222138:0:17753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 69 00000100:00100000:0.0:1789136185.222161:0:17753:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7fa348b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2a472c6c-d1e0-40bc-9d80-35f3f0adb443+6:2388:x1876044644769792:12345-192.168.201.31@tcp:39:umount.0 00000020:00000080:0.0:1789136185.222220:0:17753:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x559c8745c6de40c8 00000020:00010000:0.0:1789136185.222231:0:17753:0:(genops.c:1921:obd_stale_export_put()) Put export ffff90a7fa372800: total 0 00000100:00080000:0.0:1789136185.222237:0:17753:0:(import.c:65:import_set_state_nolock()) ffff90a7fa373000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1789136185.222279:0:17753:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934627 00000100:00100000:0.0:1789136185.222478:0:17753:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7fa348b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2a472c6c-d1e0-40bc-9d80-35f3f0adb443+5:2388:x1876044644769792:12345-192.168.201.31@tcp:39:umount.0 Request processed in 320us (716us total) trans 8589934628 rc 0/0 00000100:00100000:0.0:1789136185.222508:0:17753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 69 00000020:00010000:2.0:1789136185.222797:0:17742:0:(genops.c:1907:obd_stale_export_get()) Get export ffff90a7fa372800: total 0 00010000:00010000:2.0:1789136185.222932:0:17742:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff90a7fa372800, canceled 0 locks, left on hash table 1. 00010000:00010000:2.0:1789136185.222991:0:17742:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90a7c3817d00) 00010000:00010000:2.0:1789136185.222995:0:17742:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789136185.223006:0:17742:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c167ca00/0x559c8745c6de41bd lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08e23 expref: 4 pid: 17754 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136185.223031:0:17742:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff90a7fa372800, canceled 1 locks, left on hash table 0. 00010000:00010000:2.0:1789136185.223046:0:17742:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789136185.223048:0:17742:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789136185.223050:0:17742:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1789136185.223253:0:17749:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789136185.247281:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:2.0:1789136185.247411:0:17754:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644769920 00000100:00100000:2.0:1789136185.247425:0:17754:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644769920 00000100:00100000:2.0:1789136185.247537:0:17754:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 70 00000100:00100000:2.0:1789136185.247549:0:17754:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7fa349680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2a472c6c-d1e0-40bc-9d80-35f3f0adb443+5:2388:x1876044644769920:12345-192.168.201.31@tcp:39:umount.0 00000020:00000080:2.0:1789136185.247613:0:17754:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x559c8745c6de40cf 00000100:00080000:2.0:1789136185.247627:0:17754:0:(import.c:65:import_set_state_nolock()) ffff90a7c6317000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1789136185.247662:0:17754:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 2, last_transno is 8589934593 00000100:00100000:2.0:1789136185.247834:0:17754:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7fa349680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2a472c6c-d1e0-40bc-9d80-35f3f0adb443+3:2388:x1876044644769920:12345-192.168.201.31@tcp:39:umount.0 Request processed in 286us (571us total) trans 8589934594 rc 0/0 00000100:00100000:2.0:1789136185.247843:0:17754:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 70 00010000:00010000:2.0:1789136185.247943:0:17741:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1789136185.249127:0:17749:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1789136185.328027:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:2.0:1789136185.328405:0:17745:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644770176 00000100:00100000:2.0:1789136185.328419:0:17745:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644770176 00000100:00100000:2.0:1789136185.328489:0:17745:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 177 00000100:00100000:2.0:1789136185.328501:0:17745:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7fa9f9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d7d35a68-30a0-4475-a8ab-9673ac334408+7:2388:x1876044644770176:12345-192.168.201.31@tcp:251:umount.0 00000020:00000080:2.0:1789136185.328576:0:17745:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x559c8745c6de4066 00000020:00010000:2.0:1789136185.328616:0:17745:0:(genops.c:1921:obd_stale_export_put()) Put export ffff90a6c4c40800: total 0 00000100:00080000:2.0:1789136185.328622:0:17745:0:(import.c:65:import_set_state_nolock()) ffff90a6c4c43800 : changing import state from FULL to CLOSED 00000100:00100000:2.0:1789136185.328732:0:17745:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7fa9f9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d7d35a68-30a0-4475-a8ab-9673ac334408+3:2388:x1876044644770176:12345-192.168.201.31@tcp:251:umount.0 Request processed in 232us (721us total) trans 0 rc 0/0 00000100:00100000:2.0:1789136185.328741:0:17745:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 177 00000020:00010000:3.0:1789136185.330503:0:17742:0:(genops.c:1907:obd_stale_export_get()) Get export ffff90a6c4c40800: total 0 00010000:00010000:3.0:1789136185.330517:0:17742:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789136185.330601:0:17742:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff90a6c4c40800, canceled 0 locks, left on hash table 1. 00010000:00010000:3.0:1789136185.331317:0:17742:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90a7c167ce00/0x559c8745c6de406d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08d12 expref: 2 pid: 17747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136185.331342:0:17742:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff90a6c4c40800, canceled 1 locks, left on hash table 0. 00000020:00000080:3.0:1789136185.331360:0:17742:0:(genops.c:885:class_export_put()) final put ffff90a6c4c40800/d7d35a68-30a0-4475-a8ab-9673ac334408 00010000:00010000:3.0:1789136185.331381:0:17742:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789136185.331384:0:17742:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789136185.331386:0:17742:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1789136185.332305:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff90a6c4c40800/d7d35a68-30a0-4475-a8ab-9673ac334408 for MGS 00000020:00000080:2.0:1789136185.332374:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff90a6c4c43800 for MGS 00010000:00010000:2.0:1789136185.707150:0:17741:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789136186.216702:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7fa35b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1876044666889472:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1789136186.216783:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789136186.216891:0:17758:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666889472 00000100:00100000:2.0:1789136186.216899:0:17758:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666889472 00000100:00100000:2.0:1789136186.216945:0:17758:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:2.0:1789136186.216954:0:17758:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7fa7dd680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3638:x1876044666889472:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1789136186.216988:0:17758:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446293504 avail 1300054016 00000100:00100000:2.0:1789136186.217045:0:17758:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7fa7dd680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3638:x1876044666889472:12345-0@lo:41:osp-pre-0-1.0 Request processed in 92us (262us total) trans 0 rc 0/0 00000100:00100000:2.0:1789136186.217052:0:17758:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:2.0:1789136186.217093:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7fa35b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1876044666889472:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1789136186.217644:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7fa35b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1876044666889600:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1789136186.217683:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789136186.217755:0:19269:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666889600 00000100:00100000:2.0:1789136186.217760:0:19269:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666889600 00000100:00100000:2.0:1789136186.217807:0:19269:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1789136186.217815:0:19269:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7fa349e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1876044666889600:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1789136186.217832:0:19269:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3915853824 avail 3684331520 00000100:00100000:2.0:1789136186.217894:0:19269:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7fa349e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1876044666889600:12345-0@lo:13:osp-pre-0-1.0 Request processed in 81us (210us total) trans 0 rc 0/0 00000100:00100000:2.0:1789136186.217900:0:19269:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1789136186.217938:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7fa35b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1876044666889600:0@lo:13:osp-pre-0-1.0 00000100:00080000:3.0:1789136186.217996:0:17749:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1789136186.734419:0:17742:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789136186.741018:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7fa3bcf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1876044666889728:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1789136186.741112:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789136186.741617:0:17758:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666889728 00000100:00100000:0.0:1789136186.741625:0:17758:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666889728 00000100:00100000:0.0:1789136186.741684:0:17758:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1789136186.741693:0:17758:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7fa34a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3640:x1876044666889728:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1789136186.741724:0:17758:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1789136186.741775:0:17758:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7fa34a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3640:x1876044666889728:12345-0@lo:41:osp-pre-1-0.0 Request processed in 83us (663us total) trans 0 rc 0/0 00000100:00100000:0.0:1789136186.741782:0:17758:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:3.0:1789136186.741929:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7fa3bcf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1876044666889728:0@lo:41:osp-pre-1-0.0 00000001:00100000:0.0:1789136186.742706:0:19261:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 8615a57a-8113-4aad-917f-27cc7b9dd43a 00000020:00000080:0.0:1789136186.742713:0:19261:0:(genops.c:885:class_export_put()) final put ffff90a7d0675000/8615a57a-8113-4aad-917f-27cc7b9dd43a 00000020:00000080:3.0:1789136186.743127:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff90a7d0675000/8615a57a-8113-4aad-917f-27cc7b9dd43a for lustre-OST0000 00000020:00000080:3.0:1789136186.743165:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff90a7d0673800 for lustre-OST0000 00000001:00100000:2.0:1789136186.743697:0:17733:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 2a472c6c-d1e0-40bc-9d80-35f3f0adb443 00000001:00080000:2.0:1789136186.743721:0:17733:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934628 is committed 00000020:00000080:2.0:1789136186.743725:0:17733:0:(genops.c:885:class_export_put()) final put ffff90a7fa372800/2a472c6c-d1e0-40bc-9d80-35f3f0adb443 00000001:00100000:2.0:1789136186.743741:0:17733:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 8615a57a-8113-4aad-917f-27cc7b9dd43a 00000001:00080000:2.0:1789136186.743747:0:17733:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934627 is committed 00000020:00000080:2.0:1789136186.743753:0:17733:0:(genops.c:885:class_export_put()) final put ffff90a6c4c41000/8615a57a-8113-4aad-917f-27cc7b9dd43a 00000020:00000080:0.0:1789136186.744230:0:487:0:(genops.c:844:class_export_destroy()) destroying export ffff90a7fa372800/2a472c6c-d1e0-40bc-9d80-35f3f0adb443 for lustre-MDT0000 00000020:00000080:0.0:1789136186.744291:0:487:0:(genops.c:844:class_export_destroy()) destroying export ffff90a6c4c41000/8615a57a-8113-4aad-917f-27cc7b9dd43a for lustre-MDT0000 00000020:00000080:0.0:1789136186.744323:0:487:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff90a7fa373000 for lustre-MDT0000 00000020:00000080:0.0:1789136186.744328:0:487:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff90a6c4c42000 for lustre-MDT0000 00000001:00100000:0.0:1789136186.750992:0:18489:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of 2a472c6c-d1e0-40bc-9d80-35f3f0adb443 00000001:00080000:0.0:1789136186.751010:0:18489:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 8589934594 is committed 00000020:00000080:0.0:1789136186.751016:0:18489:0:(genops.c:885:class_export_put()) final put ffff90a7c6317800/2a472c6c-d1e0-40bc-9d80-35f3f0adb443 00000001:00100000:0.0:1789136186.751231:0:18489:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of 8615a57a-8113-4aad-917f-27cc7b9dd43a 00000001:00080000:0.0:1789136186.751237:0:18489:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 8589934593 is committed 00000020:00000080:0.0:1789136186.751240:0:18489:0:(genops.c:885:class_export_put()) final put ffff90a6c4c46800/8615a57a-8113-4aad-917f-27cc7b9dd43a 00000020:00000080:3.0:1789136186.753785:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff90a7c6317800/2a472c6c-d1e0-40bc-9d80-35f3f0adb443 for lustre-MDT0001 00000020:00000080:3.0:1789136186.753866:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff90a7c6317000 for lustre-MDT0001 00000020:00000080:3.0:1789136186.756008:0:487:0:(genops.c:844:class_export_destroy()) destroying export ffff90a6c4c46800/8615a57a-8113-4aad-917f-27cc7b9dd43a for lustre-MDT0001 00000020:00000080:3.0:1789136186.756086:0:487:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff90a6c4c43000 for lustre-MDT0001 00000040:00080000:0.0:1789136187.496771:0:18511:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1789136187.752191:0:17741:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:0.0:1789136188.184467:0:21338:0:(tgt_mount.c:2192:server_umount_begin()) umount -f 00000020:01000004:0.0:1789136188.200367:0:21338:0:(tgt_mount.c:2062:server_put_super()) server put_super lustre-MDT0000 00010000:00010000:0.0:1789136188.200430:0:21338:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.131@tcp lock: ffff90a7ff5f4c00/0x559c8745c6de3c22 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x559c8745c6de3c29 expref: -99 pid: 17732 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136188.200465:0:21338:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.131@tcp lock: ffff90a7ff5f4c00/0x559c8745c6de3c22 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x559c8745c6de3c29 expref: -99 pid: 17732 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136188.200472:0:21338:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.131@tcp lock: ffff90a7ff5f4c00/0x559c8745c6de3c22 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0x559c8745c6de3c29 expref: -99 pid: 17732 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136188.200479:0:21338:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.131@tcp lock: ffff90a7ff5f4c00/0x559c8745c6de3c22 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0x559c8745c6de3c29 expref: -99 pid: 17732 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136188.200505:0:21338:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:0.0:1789136188.200510:0:21338:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:0.0:1789136188.200538:0:21338:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1789136188.200542:0:21338:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 3 00000100:00080000:0.0:1789136188.200547:0:21338:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00080000:0.0:1789136188.200570:0:21338:0:(import.c:65:import_set_state_nolock()) ffff90a7fa65d000 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00000100:00100000:1.0:1789136188.200631:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7fa3be940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3637:1876044666889856:0@lo:39:umount.0 00000100:00100000:1.0:1789136188.200717:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1789136188.201042:0:17742:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789136188.201057:0:17742:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.131@tcp lock: ffff90a7ff5f4c00/0x559c8745c6de3c22 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000400000000 nid: local remote: 0x559c8745c6de3c29 expref: -99 pid: 17732 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136188.201066:0:17742:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a7ff5f4c00 already unused, calling callback (ffffffffc13bbc20) 10000000:00010000:3.0:1789136188.201069:0:17742:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.131@tcp lock: ffff90a7ff5f4c00/0x559c8745c6de3c22 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000400000000 nid: local remote: 0x559c8745c6de3c29 expref: -99 pid: 17732 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136188.201078:0:17742:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.131@tcp lock: ffff90a7ff5f4c00/0x559c8745c6de3c22 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1008400000000 nid: local remote: 0x559c8745c6de3c29 expref: -99 pid: 17732 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789136188.201084:0:17742:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.131@tcp lock: ffff90a7ff5f4c00/0x559c8745c6de3c22 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1009400000000 nid: local remote: 0x559c8745c6de3c29 expref: -99 pid: 17732 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789136188.201101:0:17742:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1789136188.201103:0:17742:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:3.0:1789136188.201106:0:17742:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:3.0:1789136188.201133:0:17742:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.131@tcp lock: ffff90a7ff5f4c00/0x559c8745c6de3c22 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0x559c8745c6de3c29 expref: -99 pid: 17732 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136188.201139:0:17742:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789136188.201170:0:17742:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.131@tcp lock: ffff90a7ff5f4c00/0x559c8745c6de3c22 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0x559c8745c6de3c29 expref: -99 pid: 17732 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136188.201177:0:17742:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.131@tcp lock: ffff90a7ff5f4c00/0x559c8745c6de3c22 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0x559c8745c6de3c29 expref: -99 pid: 17732 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136188.201191:0:17742:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789136188.201192:0:17742:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789136188.201194:0:17742:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789136188.201201:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789136188.201214:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7fa348f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:511c13c6-847f-45db-8965-d0deb75673dc:3640:1876044666889984:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789136188.201255:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789136188.201311:0:17738:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666889984 00000100:00100000:3.0:1789136188.201317:0:17738:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666889984 00000100:00100000:3.0:1789136188.201370:0:17738:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1789136188.201379:0:17738:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7fa34b0c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:511c13c6-847f-45db-8965-d0deb75673dc+24:3640:x1876044666889984:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789136188.201397:0:17738:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789136188.201420:0:17738:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90a6c3caec00/0x559c8745c6de3c29 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x559c8745c6de3c22 expref: 24 pid: 17746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136188.201436:0:17738:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789136188.201470:0:17738:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7fa34b0c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:511c13c6-847f-45db-8965-d0deb75673dc+23:3640:x1876044666889984:12345-0@lo:103:ldlm_bl.0 Request processed in 92us (214us total) trans 0 rc 0/0 00000100:00100000:3.0:1789136188.201478:0:17738:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1789136188.201520:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7fa348f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:511c13c6-847f-45db-8965-d0deb75673dc:3640:1876044666889984:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789136188.202602:0:17753:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666889856 00000100:00100000:1.0:1789136188.202609:0:17753:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666889856 00000100:00100000:1.0:1789136188.202651:0:17753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1789136188.202674:0:17753:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7fa7dde00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3637:x1876044666889856:12345-0@lo:39:umount.0 00000020:00000080:1.0:1789136188.202699:0:17753:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x559c8745c6de3c53 00000100:00080000:1.0:1789136188.202707:0:17753:0:(import.c:65:import_set_state_nolock()) ffff90a7fa659000 : changing import state from FULL to CLOSED 00000100:00100000:1.0:1789136188.202770:0:17753:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7fa7dde00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+1:3637:x1876044666889856:12345-0@lo:39:umount.0 Request processed in 97us (2053us total) trans 0 rc 0/0 00000100:00100000:1.0:1789136188.202777:0:17753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000020:00000080:1.0:1789136188.202787:0:17753:0:(genops.c:885:class_export_put()) final put ffff90a7fa65f000/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:1.0:1789136188.202812:0:16093:0:(genops.c:844:class_export_destroy()) destroying export ffff90a7fa65f000/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000 00000020:00000080:1.0:1789136188.202887:0:16093:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff90a7fa659000 for lustre-MDT0000 00000100:00080000:1.0:1789136188.202917:0:3637:0:(import.c:65:import_set_state_nolock()) ffff90a7fa65d000 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:1.0:1789136188.202926:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7fa3be940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3637:1876044666889856:0@lo:39:umount.0 00000100:00080000:0.0:1789136188.203011:0:21338:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1789136188.203015:0:21338:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:0.0:1789136188.203019:0:21338:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:0.0:1789136188.203897:0:21338:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.131@tcp lock: ffff90a7d1878000/0x559c8745c6de3b73 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x559c8745c6de3b7a expref: -99 pid: 17732 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136188.203912:0:21338:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.131@tcp lock: ffff90a7d1878000/0x559c8745c6de3b73 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x559c8745c6de3b7a expref: -99 pid: 17732 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136188.203919:0:21338:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.131@tcp lock: ffff90a7d1878000/0x559c8745c6de3b73 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000400000000 nid: local remote: 0x559c8745c6de3b7a expref: -99 pid: 17732 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136188.203925:0:21338:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.131@tcp lock: ffff90a7d1878000/0x559c8745c6de3b73 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000400000000 nid: local remote: 0x559c8745c6de3b7a expref: -99 pid: 17732 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136188.203956:0:21338:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789136188.203963:0:21338:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.131@tcp lock: ffff90a7e1c9fc00/0x559c8745c6de3f8d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x559c8745c6de3f94 expref: -99 pid: 17750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136188.203969:0:21338:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.131@tcp lock: ffff90a7e1c9fc00/0x559c8745c6de3f8d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x559c8745c6de3f94 expref: -99 pid: 17750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136188.203975:0:21338:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.131@tcp lock: ffff90a7e1c9fc00/0x559c8745c6de3f8d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x559c8745c6de3f94 expref: -99 pid: 17750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136188.203980:0:21338:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.131@tcp lock: ffff90a7e1c9fc00/0x559c8745c6de3f8d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x559c8745c6de3f94 expref: -99 pid: 17750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136188.203988:0:21338:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1789136188.203992:0:21338:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.131@tcp lock: ffff90a7ff5f5600/0x559c8745c6de4123 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x559c8745c6de412a expref: -99 pid: 17750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136188.203997:0:21338:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.131@tcp lock: ffff90a7ff5f5600/0x559c8745c6de4123 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x559c8745c6de412a expref: -99 pid: 17750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136188.204003:0:21338:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.131@tcp lock: ffff90a7ff5f5600/0x559c8745c6de4123 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x559c8745c6de412a expref: -99 pid: 17750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136188.204008:0:21338:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.131@tcp lock: ffff90a7ff5f5600/0x559c8745c6de4123 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x559c8745c6de412a expref: -99 pid: 17750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136188.204015:0:21338:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:0.0:1789136188.204019:0:21338:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.131@tcp lock: ffff90a7d1878800/0x559c8745c6de3b65 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x559c8745c6de3b6c expref: -99 pid: 17732 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136188.204032:0:21338:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.131@tcp lock: ffff90a7d1878800/0x559c8745c6de3b65 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x559c8745c6de3b6c expref: -99 pid: 17732 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136188.204037:0:21338:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.131@tcp lock: ffff90a7d1878800/0x559c8745c6de3b65 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x559c8745c6de3b6c expref: -99 pid: 17732 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136188.204043:0:21338:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.131@tcp lock: ffff90a7d1878800/0x559c8745c6de3b65 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x559c8745c6de3b6c expref: -99 pid: 17732 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136188.204049:0:21338:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 10000000:01000000:0.0:1789136188.204053:0:21338:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0000 (0) 00000020:01000004:0.0:1789136188.204081:0:21338:0:(tgt_mount.c:2112:server_put_super()) stopping lustre-MDT0000 00000020:01000000:0.0:1789136188.204085:0:21338:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000 (flags='F') 00000020:00000080:0.0:1789136188.204102:0:21338:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1789136188.204108:0:21338:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000: forcing exports to disconnect: 4/9 00000020:00080000:0.0:1789136188.204113:0:21338:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff90a6c47ce000 lustre-MDT0000-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1789136188.204119:0:21338:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff90a6c3ba7000 lustre-MDT0000-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1789136188.204123:0:21338:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff90a7ff5c4800 lustre-MDT0000-lwp-MDT0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1789136188.204127:0:21338:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff90a7d0677800 lustre-MDT0001-mdtlov_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1789136188.204132:0:21338:0:(genops.c:1553:class_disconnect_exports()) OBD device 5 (ffff90a6c3a43490) has exports, disconnecting them 00000020:00080000:0.0:1789136188.204136:0:21338:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff90a6c47ce000), last request at 1789136184 00000020:00000080:0.0:1789136188.204142:0:21338:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x559c8745c6de3f5c 00000100:00080000:0.0:1789136188.204160:0:21338:0:(import.c:65:import_set_state_nolock()) ffff90a7d28fa800 : changing import state from FULL to CLOSED 00000020:00080000:0.0:1789136188.204205:0:21338:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff90a6c47ce000): rc 0 00000020:00000080:0.0:1789136188.204207:0:21338:0:(genops.c:885:class_export_put()) final put ffff90a6c47ce000/lustre-MDT0000-lwp-OST0001_UUID 00000020:00080000:0.0:1789136188.204214:0:21338:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff90a6c3ba7000), last request at 1789136184 00000020:00000080:0.0:1789136188.204225:0:21338:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x559c8745c6de3df7 00000100:00080000:0.0:1789136188.204230:0:21338:0:(import.c:65:import_set_state_nolock()) ffff90a6c3ba0000 : changing import state from FULL to CLOSED 00000020:00080000:0.0:1789136188.204237:0:21338:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff90a6c3ba7000): rc 0 00000020:00000080:0.0:1789136188.204238:0:21338:0:(genops.c:885:class_export_put()) final put ffff90a6c3ba7000/lustre-MDT0000-lwp-OST0000_UUID 00000020:00080000:0.0:1789136188.204242:0:21338:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff90a7ff5c4800), last request at 1789136094 00000020:00000080:0.0:1789136188.204245:0:21338:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x559c8745c6de3d41 00000100:00080000:0.0:1789136188.204248:0:21338:0:(import.c:65:import_set_state_nolock()) ffff90a7c2b6b000 : changing import state from FULL to CLOSED 00000020:00080000:0.0:1789136188.204252:0:21338:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff90a7ff5c4800): rc 0 00000020:00000080:0.0:1789136188.204253:0:21338:0:(genops.c:885:class_export_put()) final put ffff90a7ff5c4800/lustre-MDT0000-lwp-MDT0001_UUID 00000020:00080000:0.0:1789136188.204256:0:21338:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff90a7d0677800), last request at 1789136094 00000020:00000080:0.0:1789136188.204259:0:21338:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x559c8745c6de3cd8 00000100:00080000:0.0:1789136188.204262:0:21338:0:(import.c:65:import_set_state_nolock()) ffff90a7c96ae000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1789136188.204268:0:21338:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934628 00000020:00080000:0.0:1789136188.204342:0:21338:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff90a7d0677800): rc 0 00000004:00000080:0.0:1789136188.204347:0:21338:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=400866e7 len=0 karg=ffffbb1d41c37ae0 00000100:00080000:0.0:1789136188.204363:0:21338:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:0.0:1789136188.204366:0:21338:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 3 00000100:00080000:0.0:1789136188.205154:0:21338:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000100:00080000:0.0:1789136188.205181:0:21338:0:(import.c:65:import_set_state_nolock()) ffff90a6c3a2e000 lustre-MDT0001_UUID: changing import state from FULL to CONNECTING 00000020:00000080:1.0:1789136188.206076:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff90a6c47ce000/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000 00000020:00000080:1.0:1789136188.206146:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff90a6c3ba7000/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000 00000020:00000080:1.0:1789136188.206164:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff90a7ff5c4800/lustre-MDT0000-lwp-MDT0001_UUID for lustre-MDT0000 00000020:00000080:1.0:1789136188.206185:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff90a7d28fa800 for lustre-MDT0000 00000020:00000080:1.0:1789136188.206191:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff90a6c3ba0000 for lustre-MDT0000 00000020:00000080:1.0:1789136188.206194:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff90a7c2b6b000 for lustre-MDT0000 00010000:00010000:1.0:1789136188.206210:0:17742:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:1.0:1789136188.206218:0:17742:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.131@tcp lock: ffff90a7d1878000/0x559c8745c6de3b73 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000400000000 nid: local remote: 0x559c8745c6de3b7a expref: -99 pid: 17732 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136188.206229:0:17742:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a7d1878000 already unused, calling callback (ffffffffc13bbc20) 10000000:00010000:1.0:1789136188.206233:0:17742:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.131@tcp lock: ffff90a7d1878000/0x559c8745c6de3b73 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000400000000 nid: local remote: 0x559c8745c6de3b7a expref: -99 pid: 17732 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136188.206244:0:17742:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.131@tcp lock: ffff90a7d1878000/0x559c8745c6de3b73 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1008400000000 nid: local remote: 0x559c8745c6de3b7a expref: -99 pid: 17732 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789136188.206252:0:17742:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.131@tcp lock: ffff90a7d1878000/0x559c8745c6de3b73 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1009400000000 nid: local remote: 0x559c8745c6de3b7a expref: -99 pid: 17732 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789136188.206258:0:17742:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1789136188.206260:0:17742:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0000: stopping, won't requeue 10000000:01000000:1.0:1789136188.206263:0:17742:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0000 00010000:00010000:1.0:1789136188.206296:0:17742:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.131@tcp lock: ffff90a7d1878000/0x559c8745c6de3b73 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0x559c8745c6de3b7a expref: -99 pid: 17732 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136188.206302:0:17742:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789136188.206323:0:17742:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.131@tcp lock: ffff90a7d1878000/0x559c8745c6de3b73 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0x559c8745c6de3b7a expref: -99 pid: 17732 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136188.206349:0:17742:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.131@tcp lock: ffff90a7d1878000/0x559c8745c6de3b73 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0x559c8745c6de3b7a expref: -99 pid: 17732 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136188.206361:0:17742:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1789136188.206365:0:17742:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.131@tcp lock: ffff90a7e1c9fc00/0x559c8745c6de3f8d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x559c8745c6de3f94 expref: -99 pid: 17750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136188.206371:0:17742:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a7e1c9fc00 already unused, calling callback (ffffffffc13bbc20) 10000000:00010000:1.0:1789136188.206375:0:17742:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.131@tcp lock: ffff90a7e1c9fc00/0x559c8745c6de3f8d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x559c8745c6de3f94 expref: -99 pid: 17750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136188.206381:0:17742:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.131@tcp lock: ffff90a7e1c9fc00/0x559c8745c6de3f8d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x559c8745c6de3f94 expref: -99 pid: 17750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789136188.206387:0:17742:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.131@tcp lock: ffff90a7e1c9fc00/0x559c8745c6de3f8d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x559c8745c6de3f94 expref: -99 pid: 17750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789136188.206392:0:17742:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:1.0:1789136188.206395:0:17742:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 10000000:01000000:1.0:1789136188.206397:0:17742:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00010000:00010000:1.0:1789136188.206411:0:17742:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.131@tcp lock: ffff90a7e1c9fc00/0x559c8745c6de3f8d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x559c8745c6de3f94 expref: -99 pid: 17750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136188.206416:0:17742:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789136188.206423:0:17742:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.131@tcp lock: ffff90a7e1c9fc00/0x559c8745c6de3f8d lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x559c8745c6de3f94 expref: -99 pid: 17750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136188.206430:0:17742:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.131@tcp lock: ffff90a7e1c9fc00/0x559c8745c6de3f8d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x559c8745c6de3f94 expref: -99 pid: 17750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136188.206451:0:17742:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1789136188.206454:0:17742:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.131@tcp lock: ffff90a7ff5f5600/0x559c8745c6de4123 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x559c8745c6de412a expref: -99 pid: 17750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136188.206459:0:17742:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a7ff5f5600 already unused, calling callback (ffffffffc13bbc20) 10000000:00010000:1.0:1789136188.206462:0:17742:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.131@tcp lock: ffff90a7ff5f5600/0x559c8745c6de4123 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x559c8745c6de412a expref: -99 pid: 17750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136188.206469:0:17742:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.131@tcp lock: ffff90a7ff5f5600/0x559c8745c6de4123 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0x559c8745c6de412a expref: -99 pid: 17750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789136188.206474:0:17742:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.131@tcp lock: ffff90a7ff5f5600/0x559c8745c6de4123 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0x559c8745c6de412a expref: -99 pid: 17750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789136188.206479:0:17742:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:1.0:1789136188.206481:0:17742:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:1.0:1789136188.206483:0:17742:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:1.0:1789136188.206497:0:17742:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.131@tcp lock: ffff90a7ff5f5600/0x559c8745c6de4123 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x559c8745c6de412a expref: -99 pid: 17750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136188.206503:0:17742:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789136188.206522:0:17742:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.131@tcp lock: ffff90a7ff5f5600/0x559c8745c6de4123 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x559c8745c6de412a expref: -99 pid: 17750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136188.206529:0:17742:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.131@tcp lock: ffff90a7ff5f5600/0x559c8745c6de4123 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x559c8745c6de412a expref: -99 pid: 17750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136188.206537:0:17742:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789136188.206540:0:17742:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.131@tcp lock: ffff90a7d1878800/0x559c8745c6de3b65 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x559c8745c6de3b6c expref: -99 pid: 17732 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136188.206551:0:17742:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a7d1878800 already unused, calling callback (ffffffffc13bbc20) 10000000:00010000:1.0:1789136188.206554:0:17742:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.131@tcp lock: ffff90a7d1878800/0x559c8745c6de3b65 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x559c8745c6de3b6c expref: -99 pid: 17732 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136188.206561:0:17742:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.131@tcp lock: ffff90a7d1878800/0x559c8745c6de3b65 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x559c8745c6de3b6c expref: -99 pid: 17732 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789136188.206567:0:17742:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.131@tcp lock: ffff90a7d1878800/0x559c8745c6de3b65 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x559c8745c6de3b6c expref: -99 pid: 17732 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789136188.206572:0:17742:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:1.0:1789136188.206574:0:17742:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 10000000:01000000:1.0:1789136188.206576:0:17742:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 00010000:00010000:1.0:1789136188.206591:0:17742:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.131@tcp lock: ffff90a7d1878800/0x559c8745c6de3b65 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x559c8745c6de3b6c expref: -99 pid: 17732 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136188.206596:0:17742:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789136188.206602:0:17742:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.131@tcp lock: ffff90a7d1878800/0x559c8745c6de3b65 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x559c8745c6de3b6c expref: -99 pid: 17732 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136188.206607:0:17742:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.131@tcp lock: ffff90a7d1878800/0x559c8745c6de3b65 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x559c8745c6de3b6c expref: -99 pid: 17732 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136188.206616:0:17742:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789136188.206618:0:17742:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789136188.206620:0:17742:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789136188.206638:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7fa7de940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:511c13c6-847f-45db-8965-d0deb75673dc:3638:1876044666890240:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789136188.209308:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789136188.209380:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789136188.209408:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7fa7dcf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:511c13c6-847f-45db-8965-d0deb75673dc:3638:1876044666890368:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789136188.209443:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789136188.209475:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7fa7dda40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:511c13c6-847f-45db-8965-d0deb75673dc:3641:1876044666890624:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789136188.209499:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789136188.209515:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789136188.209523:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7fa7df0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:511c13c6-847f-45db-8965-d0deb75673dc:3641:1876044666890496:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789136188.209542:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789136188.209561:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7fa3bd2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3637:1876044666890112:0@lo:39:umount.0 00000100:00100000:1.0:1789136188.209590:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789136188.209625:0:17758:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666890112 00000100:00100000:1.0:1789136188.209633:0:17758:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666890112 00000100:00100000:1.0:1789136188.209769:0:17758:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:1.0:1789136188.209779:0:17758:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7fa7dc3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3637:x1876044666890112:12345-0@lo:39:umount.0 00000020:00000080:1.0:1789136188.209809:0:17758:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x559c8745c6de3d6b 00000100:00080000:1.0:1789136188.209818:0:17758:0:(import.c:65:import_set_state_nolock()) ffff90a7f08dc000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1789136188.209936:0:17758:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 2, last_transno is 8589934594 00000100:00100000:1.0:1789136188.210072:0:17758:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7fa7dc3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+3:3637:x1876044666890112:12345-0@lo:39:umount.0 Request processed in 294us (480us total) trans 8589934595 rc 0/0 00000100:00100000:1.0:1789136188.210079:0:17758:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00080000:1.0:1789136188.210131:0:3637:0:(import.c:65:import_set_state_nolock()) ffff90a6c3a2e000 lustre-MDT0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:1.0:1789136188.210138:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7fa3bd2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3637:1876044666890112:0@lo:39:umount.0 00010000:00010000:1.0:1789136188.210152:0:17742:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789136188.210211:0:17739:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666890240 00000100:00100000:0.0:1789136188.210216:0:17739:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666890240 00000100:00100000:0.0:1789136188.210244:0:17739:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666890368 00000100:00100000:0.0:1789136188.210247:0:17739:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666890368 00000100:00100000:0.0:1789136188.210259:0:17739:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666890624 00000100:00100000:0.0:1789136188.210262:0:17739:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666890624 00000100:00100000:0.0:1789136188.210272:0:17739:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666890496 00000100:00100000:0.0:1789136188.210275:0:17739:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666890496 00000100:00100000:0.0:1789136188.210287:0:17739:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1789136188.210294:0:17739:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7fa7dc780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:511c13c6-847f-45db-8965-d0deb75673dc+26:3638:x1876044666890240:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789136188.210316:0:17739:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789136188.210333:0:17739:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90a6c2d3f200/0x559c8745c6de3b7a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x559c8745c6de3b73 expref: 26 pid: 17747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136188.210348:0:17739:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789136188.210387:0:17739:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7fa7dc780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:511c13c6-847f-45db-8965-d0deb75673dc+25:3638:x1876044666890240:12345-0@lo:103:ldlm_bl.0 Request processed in 93us (1088us total) trans 0 rc 0/0 00000100:00100000:0.0:1789136188.210394:0:17739:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1789136188.210408:0:17739:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1789136188.210414:0:17739:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7f6bc1450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:511c13c6-847f-45db-8965-d0deb75673dc+24:3638:x1876044666890368:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789136188.210424:0:17739:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789136188.210432:0:17739:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90a7ff5f4600/0x559c8745c6de3f94 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x559c8745c6de3f8d expref: 24 pid: 17747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136188.210441:0:17739:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789136188.210463:0:17739:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7f6bc1450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:511c13c6-847f-45db-8965-d0deb75673dc+23:3638:x1876044666890368:12345-0@lo:103:ldlm_bl.0 Request processed in 49us (1020us total) trans 0 rc 0/0 00000100:00100000:0.0:1789136188.210469:0:17739:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1789136188.210504:0:17739:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1789136188.210510:0:17739:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7fa7dfc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:511c13c6-847f-45db-8965-d0deb75673dc+22:3641:x1876044666890624:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789136188.210517:0:17739:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789136188.210526:0:17739:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90a6c3cae000/0x559c8745c6de3b6c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x559c8745c6de3b65 expref: 22 pid: 17745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136188.210534:0:17739:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789136188.210558:0:17739:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7fa7dfc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:511c13c6-847f-45db-8965-d0deb75673dc+21:3641:x1876044666890624:12345-0@lo:103:ldlm_bl.0 Request processed in 49us (1059us total) trans 0 rc 0/0 00000100:00100000:0.0:1789136188.210574:0:17739:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1789136188.210585:0:17739:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1789136188.210590:0:17739:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7fa7de1c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:511c13c6-847f-45db-8965-d0deb75673dc+20:3641:x1876044666890496:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789136188.210597:0:17739:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789136188.210605:0:17739:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90a7e1c9f200/0x559c8745c6de412a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x559c8745c6de4123 expref: 20 pid: 17747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136188.210613:0:17739:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789136188.210634:0:17739:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7fa7de1c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:511c13c6-847f-45db-8965-d0deb75673dc+19:3641:x1876044666890496:12345-0@lo:103:ldlm_bl.0 Request processed in 44us (1092us total) trans 0 rc 0/0 00000100:00100000:0.0:1789136188.210640:0:17739:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00010000:00010000:3.0:1789136188.211234:0:17741:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789136188.211315:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7fa7df0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:511c13c6-847f-45db-8965-d0deb75673dc:3641:1876044666890496:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789136188.211325:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7fa7dda40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:511c13c6-847f-45db-8965-d0deb75673dc:3641:1876044666890624:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789136188.211353:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7fa7dcf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:511c13c6-847f-45db-8965-d0deb75673dc:3638:1876044666890368:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789136188.211372:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7fa7de940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:511c13c6-847f-45db-8965-d0deb75673dc:3638:1876044666890240:0@lo:103:ldlm_bl.0 00000100:00080000:0.0:1789136188.214014:0:21338:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:0.0:1789136188.214023:0:21338:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934598 gen 3 00000004:00080000:0.0:1789136188.214040:0:21338:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:0.0:1789136188.214124:0:21338:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:0.0:1789136188.214151:0:21338:0:(import.c:65:import_set_state_nolock()) ffff90a7e761e800 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00080000:0.0:1789136188.214178:0:21338:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:0.0:1789136188.214180:0:21338:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934594 gen 3 00000004:00080000:0.0:1789136188.214189:0:21338:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:0.0:1789136188.214247:0:21338:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:0.0:1789136188.214257:0:21338:0:(import.c:65:import_set_state_nolock()) ffff90a7f6293800 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000020:00080000:0.0:1789136188.214298:0:21338:0:(genops.c:1558:class_disconnect_exports()) OBD device 5 (ffff90a6c3a43490) has no exports 00000100:00100000:1.0:1789136188.214405:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7fa3bde00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3637:1876044666890752:0@lo:9:umount.0 00000100:00100000:1.0:1789136188.214473:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789136188.214516:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7fa3bfc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3637:1876044666890880:0@lo:9:umount.0 00000100:00100000:1.0:1789136188.214541:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789136188.219575:0:19265:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666890752 00000100:00100000:0.0:1789136188.219592:0:19265:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666890752 00000100:00100000:0.0:1789136188.219704:0:19265:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666890880 00000100:00100000:0.0:1789136188.219709:0:19265:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666890880 00000100:00100000:0.0:1789136188.219737:0:19265:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1789136188.219749:0:19265:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7fa7de940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3637:x1876044666890752:12345-0@lo:9:umount.0 00000020:00000080:0.0:1789136188.219811:0:19265:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x559c8745c6de3e3d 00000100:00080000:0.0:1789136188.219827:0:19265:0:(import.c:65:import_set_state_nolock()) ffff90a6c3ba7800 : changing import state from FULL to CLOSED 00000100:00080000:1.0:1789136188.220012:0:17749:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789136188.220016:0:17749:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789136188.220118:0:19267:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1789136188.220129:0:19267:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7fa7dcf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3637:x1876044666890880:12345-0@lo:9:umount.0 00000020:00000080:3.0:1789136188.220151:0:19267:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x559c8745c6de3f9b 00000100:00080000:3.0:1789136188.220163:0:19267:0:(import.c:65:import_set_state_nolock()) ffff90a7f6b2f800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1789136188.220243:0:19267:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934594 00000100:00100000:3.0:1789136188.220462:0:19267:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7fa7dcf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+2:3637:x1876044666890880:12345-0@lo:9:umount.0 Request processed in 335us (5919us total) trans 0 rc 0/0 00000100:00100000:3.0:1789136188.220470:0:19267:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00080000:3.0:1789136188.220515:0:3637:0:(import.c:65:import_set_state_nolock()) ffff90a7f6293800 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:3.0:1789136188.220528:0:3637:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:3.0:1789136188.220530:0:3637:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1789136188.220533:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7fa3bfc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3637:1876044666890880:0@lo:9:umount.0 00010000:00010000:1.0:1789136188.220986:0:17742:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00000004:0.0:1789136188.221084:0:19265:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934600 00000100:00100000:0.0:1789136188.221200:0:19265:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7fa7de940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+2:3637:x1876044666890752:12345-0@lo:9:umount.0 Request processed in 1454us (6726us total) trans 0 rc 0/0 00000100:00100000:0.0:1789136188.221208:0:19265:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00080000:3.0:1789136188.221403:0:3637:0:(import.c:65:import_set_state_nolock()) ffff90a7e761e800 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:3.0:1789136188.221440:0:3637:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:3.0:1789136188.221442:0:3637:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1789136188.221446:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7fa3bde00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3637:1876044666890752:0@lo:9:umount.0 00010000:00010000:1.0:1789136188.222466:0:17741:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:0.0:1789136188.239528:0:21338:0:(genops.c:1558:class_disconnect_exports()) OBD device 5 (ffff90a6c3a43490) has no exports 00000020:00000080:0.0:1789136188.386716:0:21338:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x559c8745c6de3bc0 00000020:00000080:0.0:1789136188.386739:0:21338:0:(genops.c:885:class_export_put()) final put ffff90a7ff551000/lustre-QMT0000_UUID 00000020:01000000:0.0:1789136188.387367:0:21338:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-QMT0000 (flags='') 00000020:00000080:1.0:1789136188.387451:0:16093:0:(genops.c:844:class_export_destroy()) destroying export ffff90a7ff551000/lustre-QMT0000_UUID for lustre-QMT0000 00000020:00000080:1.0:1789136188.387478:0:21338:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1789136188.387488:0:21338:0:(obd_config.c:956:class_cleanup()) lustre-QMT0000: forcing exports to disconnect: 0/1 00000020:00080000:1.0:1789136188.387492:0:21338:0:(genops.c:1558:class_disconnect_exports()) OBD device 7 (ffff90a6c3a44ed8) has no exports 00000020:00000080:1.0:1789136188.388194:0:21338:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x559c8745c6de3bb9 00000020:00000080:1.0:1789136188.388204:0:21338:0:(genops.c:885:class_export_put()) final put ffff90a7d1852000/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1789136188.388283:0:21338:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1789136188.388296:0:21338:0:(obd_config.c:883:class_detach()) detach on obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:1.0:1789136188.388300:0:21338:0:(genops.c:885:class_export_put()) final put ffff90a7ff556000/lustre-QMT0000_UUID 00000020:00000080:1.0:1789136188.388304:0:21338:0:(genops.c:844:class_export_destroy()) destroying export ffff90a7ff556000/lustre-QMT0000_UUID for lustre-QMT0000 00000020:01000000:1.0:1789136188.388312:0:21338:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-QMT0000 (lustre-QMT0000_UUID) 00000020:00000080:2.0:1789136188.388508:0:16093:0:(genops.c:844:class_export_destroy()) destroying export ffff90a7d1852000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:00010000:1.0:1789136188.776808:0:17742:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789136189.288273:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789136189.288298:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7fa7dda40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1876044666891008:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1789136189.288384:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789136189.288572:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7fa7df840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1876044666891392:0@lo:400:kworker.0 00000100:00100000:1.0:1789136189.288605:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789136189.288627:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7f662e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3641:1876044666891904:0@lo:400:kworker.0 00000100:00100000:0.0:1789136189.288646:0:19268:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666891008 00000100:00100000:1.0:1789136189.288651:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789136189.288654:0:19268:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666891008 00000100:00100000:1.0:1789136189.288671:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:1.0:1789136189.288677:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7fa7df480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1876044666891264:0@lo:400:kworker.0 00000100:00100000:0.0:1789136189.288707:0:19268:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1789136189.288709:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789136189.288716:0:19268:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7fa348f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1876044666891008:12345-0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1789136189.288725:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7f662de00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3641:1876044666891776:0@lo:400:kworker.0 00000100:00100000:1.0:1789136189.288744:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00000024:0.0:1789136189.288745:0:19268:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923501056 avail 3691978752 00000100:00100000:1.0:1789136189.288768:0:20655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666891392 00000100:00100000:1.0:1789136189.288771:0:20655:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666891392 00000100:00100000:0.0:1789136189.288783:0:19268:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7fa348f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1876044666891008:12345-0@lo:13:osp-pre-1-1.0 Request processed in 69us (399us total) trans 0 rc 0/0 00000100:00100000:0.0:1789136189.288791:0:19268:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1789136189.288805:0:20655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1789136189.288812:0:20655:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7f662f0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3641:x1876044666891392:12345-0@lo:400:kworker.0 00000100:00080000:0.0:1789136189.288833:0:17749:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789136189.288837:0:17749:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789136189.288847:0:20655:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7f662f0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3641:x1876044666891392:12345-0@lo:400:kworker.0 Request processed in 36us (241us total) trans 0 rc 0/0 00000100:00100000:0.0:1789136189.288895:0:18920:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666891904 00000100:00100000:0.0:1789136189.288900:0:18920:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666891904 00000100:00100000:0.0:1789136189.288927:0:18920:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666891776 00000100:00100000:0.0:1789136189.288930:0:18920:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666891776 00000100:00100000:2.0:1789136189.288955:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7fa7dc780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3638:1876044666891520:0@lo:400:kworker.0 00000100:00100000:0.0:1789136189.288960:0:18920:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:0.0:1789136189.288969:0:18920:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7f662fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3641:x1876044666891776:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789136189.289008:0:18920:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7f662fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3641:x1876044666891776:12345-0@lo:400:kworker.0 Request processed in 41us (263us total) trans 0 rc 0/0 00000100:00100000:2.0:1789136189.289020:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789136189.289030:0:18920:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:0.0:1789136189.289049:0:18920:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666891520 00000100:00100000:2.0:1789136189.289054:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7f662cf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3638:1876044666892032:0@lo:400:kworker.0 00000100:00100000:0.0:1789136189.289055:0:18920:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666891520 00000100:00100000:0.0:1789136189.289082:0:18920:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1789136189.289088:0:18920:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7f662da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3641:x1876044666891904:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789136189.289093:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7fa7df0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:511c13c6-847f-45db-8965-d0deb75673dc:3639:1876044666891136:0@lo:400:kworker.0 00000020:00080000:0.0:1789136189.289094:0:18920:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:2.0:1789136189.289100:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789136189.289134:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789136189.289153:0:17755:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666892032 00000100:00100000:2.0:1789136189.289158:0:17755:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666892032 00000100:00100000:3.0:1789136189.289177:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c460f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3639:1876044666891648:0@lo:400:kworker.0 00000100:00100000:2.0:1789136189.289188:0:17755:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:2.0:1789136189.289198:0:17755:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7fa358780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3638:x1876044666892032:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789136189.289205:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789136189.289244:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7fa7dda40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1876044666891008:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1789136189.289247:0:17755:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7fa358780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3638:x1876044666892032:12345-0@lo:400:kworker.0 Request processed in 49us (144us total) trans 0 rc 0/0 00000100:00100000:2.0:1789136189.289256:0:17755:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:2.0:1789136189.289274:0:17755:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666891648 00000100:00100000:2.0:1789136189.289277:0:17755:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666891648 00000100:00100000:3.0:1789136189.289288:0:17754:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1789136189.289288:0:18920:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7f662da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3641:x1876044666891904:12345-0@lo:400:kworker.0 Request processed in 199us (635us total) trans 0 rc -107/-107 00000100:00100000:3.0:1789136189.289294:0:17754:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7fa359a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3638:x1876044666891520:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789136189.289296:0:18920:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1789136189.289313:0:18920:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000020:00080000:3.0:1789136189.289317:0:17754:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:0.0:1789136189.289318:0:18920:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7fa349a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3639:x1876044666891648:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789136189.289322:0:17758:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666891264 00000020:00080000:0.0:1789136189.289323:0:18920:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:2.0:1789136189.289329:0:17758:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666891264 00000100:00100000:3.0:1789136189.289346:0:17754:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7fa359a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3638:x1876044666891520:12345-0@lo:400:kworker.0 Request processed in 50us (328us total) trans 0 rc -107/-107 00000100:00100000:3.0:1789136189.289353:0:17754:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1789136189.289353:0:18920:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7fa349a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3639:x1876044666891648:12345-0@lo:400:kworker.0 Request processed in 35us (150us total) trans 0 rc -107/-107 00000100:00100000:0.0:1789136189.289359:0:18920:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1789136189.289363:0:17758:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:2.0:1789136189.289370:0:17758:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7f662c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3641:x1876044666891264:12345-0@lo:400:kworker.0 00000020:00080000:2.0:1789136189.289377:0:17758:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:0.0:1789136189.289381:0:17747:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666891136 00000100:00100000:0.0:1789136189.289386:0:17747:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666891136 00000100:00080000:3.0:1789136189.289399:0:3638:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-MDT0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:3.0:1789136189.289405:0:3638:0:(import.c:65:import_set_state_nolock()) ffff90a7d0676000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:3.0:1789136189.289410:0:3638:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00100000:2.0:1789136189.289415:0:17758:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7f662c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3641:x1876044666891264:12345-0@lo:400:kworker.0 Request processed in 43us (703us total) trans 0 rc -107/-107 00000100:00100000:0.0:1789136189.289427:0:17747:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 178 00000100:00100000:0.0:1789136189.289435:0:17747:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7fa9fa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:511c13c6-847f-45db-8965-d0deb75673dc+19:3639:x1876044666891136:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789136189.289468:0:17747:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7fa9fa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:511c13c6-847f-45db-8965-d0deb75673dc+19:3639:x1876044666891136:12345-0@lo:400:kworker.0 Request processed in 35us (335us total) trans 0 rc 0/0 00000100:00100000:0.0:1789136189.289474:0:17747:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 178 00000100:00080000:0.0:1789136189.289495:0:17749:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1789136189.289792:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7fa7df0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:511c13c6-847f-45db-8965-d0deb75673dc:3639:1876044666891136:0@lo:400:kworker.0 00000100:00080000:0.0:1789136189.289806:0:3639:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0000 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:0.0:1789136189.289965:0:3639:0:(import.c:65:import_set_state_nolock()) ffff90a7ff596800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:0.0:1789136189.289977:0:3639:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0000: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:0.0:1789136189.289983:0:3639:0:(import.c:65:import_set_state_nolock()) ffff90a7ff596800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1789136189.289987:0:3639:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 560 00000100:00080000:0.0:1789136189.289993:0:3639:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff90a7ff596800 using connection 192.168.201.131@tcp/0@lo 00000100:00100000:0.0:1789136189.290019:0:3639:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff90a7fa3be580 x1876044666892160/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1789136189.290041:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c460f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3639:1876044666891648:0@lo:400:kworker.0 00000100:00100000:2.0:1789136189.290168:0:17758:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:2.0:1789136189.290203:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7fa3be580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3637:1876044666892160:0@lo:38:ptlrpcd_00_01.0 00000100:00100000:2.0:1789136189.290237:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789136189.290269:0:17755:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666892160 00000100:00100000:2.0:1789136189.290273:0:17755:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666892160 00000100:00100000:2.0:1789136189.290294:0:17755:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1789136189.290299:0:17755:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7fa359e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3637:x1876044666892160:12345-0@lo:38:ptlrpcd_00_01.0 00010000:02000000:2.0:1789136189.290511:0:17755:0:(ldlm_lib.c:1241:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:1.0:1789136189.297934:0:20655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00080000:1.0:1789136189.298030:0:3641:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-osp-MDT0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:1.0:1789136189.298037:0:3641:0:(import.c:65:import_set_state_nolock()) ffff90a6c44b9800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:1.0:1789136189.298041:0:3641:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:1.0:1789136189.298047:0:3641:0:(import.c:65:import_set_state_nolock()) ffff90a6c44b9800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1789136189.298051:0:3641:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 542 00000100:00080000:1.0:1789136189.298059:0:3641:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff90a6c44b9800 using connection 192.168.201.131@tcp/0@lo 00000100:00100000:1.0:1789136189.298106:0:3641:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff90a7f662e1c0 x1876044666892288/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1789136189.298136:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7fa7df480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1876044666891264:0@lo:400:kworker.0 00010000:00080000:1.0:1789136189.298154:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90a7f662de00 x1876044666891776/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789136205 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789136189.298165:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7f662de00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3641:1876044666891776:0@lo:400:kworker.0 00000100:00100000:1.0:1789136189.298176:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7fa7df840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1876044666891392:0@lo:400:kworker.0 00000100:00080000:1.0:1789136189.298209:0:3641:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:1.0:1789136189.298212:0:3641:0:(import.c:65:import_set_state_nolock()) ffff90a6c47ca800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:1.0:1789136189.298215:0:3641:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:1.0:1789136189.298219:0:3641:0:(import.c:65:import_set_state_nolock()) ffff90a6c47ca800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1789136189.298222:0:3641:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 580 00000100:00080000:1.0:1789136189.298226:0:3641:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff90a6c47ca800 using connection 192.168.201.131@tcp/0@lo 00000100:00100000:1.0:1789136189.298240:0:3641:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff90a7f662c3c0 x1876044666892416/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1789136189.298249:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7f662e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3641:1876044666891904:0@lo:400:kworker.0 00000100:00100000:1.0:1789136189.298290:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7f662e1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3637:1876044666892288:0@lo:38:ptlrpcd_00_03.0 00000100:00100000:1.0:1789136189.298351:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789136189.298380:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7f662c3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3637:1876044666892416:0@lo:38:ptlrpcd_00_03.0 00000100:00100000:1.0:1789136189.298406:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789136189.298443:0:17759:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666892288 00000100:00100000:1.0:1789136189.298449:0:17759:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666892288 00000100:00100000:1.0:1789136189.298476:0:17759:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:1.0:1789136189.298482:0:17759:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7f662e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3637:x1876044666892288:12345-0@lo:38:ptlrpcd_00_03.0 00010000:02000000:1.0:1789136189.298496:0:17759:0:(ldlm_lib.c:1241:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:1.0:1789136189.298537:0:17759:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7f662e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3637:x1876044666892288:12345-0@lo:38:ptlrpcd_00_03.0 Request processed in 53us (185us total) trans 0 rc -19/-19 00000100:00100000:1.0:1789136189.298544:0:17759:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00080000:1.0:1789136189.298567:0:3637:0:(import.c:65:import_set_state_nolock()) ffff90a6c44b9800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1789136189.298571:0:3637:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1789136189.298574:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7f662e1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3637:1876044666892288:0@lo:38:ptlrpcd_00_03.0 00000100:00100000:1.0:1789136189.298600:0:18920:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666892416 00000100:00100000:1.0:1789136189.298604:0:18920:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666892416 00000100:00100000:1.0:1789136189.298625:0:18920:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1789136189.298629:0:18920:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7f662de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3637:x1876044666892416:12345-0@lo:38:ptlrpcd_00_03.0 00010000:02000000:1.0:1789136189.298636:0:18920:0:(ldlm_lib.c:1241:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:1.0:1789136189.298661:0:18920:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7f662de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3637:x1876044666892416:12345-0@lo:38:ptlrpcd_00_03.0 Request processed in 31us (254us total) trans 0 rc -19/-19 00000100:00100000:1.0:1789136189.298666:0:18920:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00080000:1.0:1789136189.298687:0:3637:0:(import.c:65:import_set_state_nolock()) ffff90a6c47ca800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1789136189.298690:0:3637:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1789136189.298693:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7f662c3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3637:1876044666892416:0@lo:38:ptlrpcd_00_03.0 00000100:00080000:3.0:1789136189.316166:0:3638:0:(import.c:65:import_set_state_nolock()) ffff90a7d0676000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1789136189.316178:0:3638:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 542 00000100:00080000:3.0:1789136189.316191:0:3638:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff90a7d0676000 using connection 192.168.201.131@tcp/0@lo 00000100:00100000:3.0:1789136189.316249:0:3638:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff90a7fa3492c0 x1876044666892544/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1789136189.316288:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7fa7dc780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3638:1876044666891520:0@lo:400:kworker.0 00010000:00080000:3.0:1789136189.316324:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90a7f662cf00 x1876044666892032/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789136205 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789136189.316337:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7f662cf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3638:1876044666892032:0@lo:400:kworker.0 00000100:00100000:1.0:1789136189.317834:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7fa3492c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3637:1876044666892544:0@lo:38:ptlrpcd_00_00.0 00000100:00100000:1.0:1789136189.317940:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789136189.320015:0:18920:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666892544 00000100:00100000:3.0:1789136189.320030:0:18920:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666892544 00000100:00100000:3.0:1789136189.320096:0:18920:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:3.0:1789136189.320105:0:18920:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7f662c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3637:x1876044666892544:12345-0@lo:38:ptlrpcd_00_00.0 00010000:02000000:3.0:1789136189.320125:0:18920:0:(ldlm_lib.c:1241:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:3.0:1789136189.320206:0:18920:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7f662c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3637:x1876044666892544:12345-0@lo:38:ptlrpcd_00_00.0 Request processed in 101us (2266us total) trans 0 rc -19/-19 00000100:00100000:3.0:1789136189.320214:0:18920:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00080000:1.0:1789136189.320525:0:3637:0:(import.c:65:import_set_state_nolock()) ffff90a7d0676000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1789136189.320531:0:3637:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1789136189.320535:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7fa3492c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3637:1876044666892544:0@lo:38:ptlrpcd_00_00.0 00000100:00100000:3.0:1789136189.354848:0:17755:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7fa359e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3637:x1876044666892160:12345-0@lo:38:ptlrpcd_00_01.0 Request processed in 64538us (64600us total) trans 0 rc -19/-19 00000100:00100000:3.0:1789136189.354892:0:17755:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00080000:1.0:1789136189.368305:0:3637:0:(import.c:65:import_set_state_nolock()) ffff90a7ff596800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1789136189.368334:0:3637:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1789136189.368340:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7fa3be580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3637:1876044666892160:0@lo:38:ptlrpcd_00_01.0 00010000:00010000:1.0:1789136189.800814:0:17741:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789136190.824221:0:17742:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789136191.337207:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7fa35ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1876044666892672:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1789136191.337283:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789136191.337453:0:20582:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666892672 00000100:00100000:2.0:1789136191.337462:0:20582:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666892672 00000100:00100000:2.0:1789136191.337549:0:20582:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1789136191.337562:0:20582:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7fa3bf0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1876044666892672:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1789136191.337594:0:20582:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3915853824 avail 3684331520 00000100:00100000:2.0:1789136191.337645:0:20582:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7fa3bf0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1876044666892672:12345-0@lo:13:osp-pre-0-1.0 Request processed in 87us (362us total) trans 0 rc 0/0 00000100:00100000:2.0:1789136191.337653:0:20582:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1789136191.337702:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7fa35ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1876044666892672:0@lo:13:osp-pre-0-1.0 00000100:00080000:0.0:1789136191.338013:0:17749:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1789136191.848062:0:17741:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789136192.872441:0:17742:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789136193.897410:0:17741:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1789136193.901277:0:18489:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00080000:0.0:1789136193.901369:0:18489:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 8589934595 is committed 00000020:00000080:0.0:1789136193.901375:0:18489:0:(genops.c:885:class_export_put()) final put ffff90a7f0960000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1789136193.901446:0:16093:0:(genops.c:844:class_export_destroy()) destroying export ffff90a7f0960000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001 00000020:00000080:1.0:1789136193.901503:0:16093:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff90a7f08dc000 for lustre-MDT0001 00000001:00100000:1.0:1789136193.901690:0:20083:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1789136193.901695:0:20083:0:(genops.c:885:class_export_put()) final put ffff90a7f6b2f000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1789136193.903047:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff90a7f6b2f000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001 00000020:00000080:2.0:1789136193.903102:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff90a7f6b2f800 for lustre-OST0001 00000001:00100000:3.0:1789136193.909633:0:19261:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1789136193.909643:0:19261:0:(genops.c:885:class_export_put()) final put ffff90a6c3ba4000/lustre-MDT0000-mdtlov_UUID 00000001:00100000:0.0:1789136193.909974:0:17733:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000020:00000080:0.0:1789136193.909978:0:17733:0:(genops.c:885:class_export_put()) final put ffff90a7d0677800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:1.0:1789136193.915123:0:16093:0:(genops.c:844:class_export_destroy()) destroying export ffff90a6c3ba4000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000 00000020:00000080:1.0:1789136193.915193:0:16093:0:(genops.c:844:class_export_destroy()) destroying export ffff90a7d0677800/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000 00000020:00000080:1.0:1789136193.915229:0:16093:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff90a6c3ba7800 for lustre-OST0000 00000020:00000080:1.0:1789136193.915235:0:16093:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff90a7c96ae000 for lustre-MDT0000 00000100:00080000:2.0:1789136194.408628:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1789136194.408635:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1789136194.408639:0:38:0:(import.c:65:import_set_state_nolock()) ffff90a6c44b9800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1789136194.408647:0:38:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 637 00000100:00080000:2.0:1789136194.408668:0:38:0:(import.c:589:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1789136194.408675:0:38:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff90a6c44b9800 using connection 192.168.201.131@tcp/0@lo 00000100:00100000:2.0:1789136194.408698:0:38:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff90a7fa35b840 x1876044666892928/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1789136194.408769:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1789136194.408773:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1789136194.408776:0:38:0:(import.c:65:import_set_state_nolock()) ffff90a7d0676000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1789136194.408780:0:38:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 637 00000100:00080000:2.0:1789136194.408783:0:38:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1789136194.408787:0:38:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff90a7d0676000 using connection 192.168.201.131@tcp/0@lo 00000100:00100000:2.0:1789136194.408801:0:38:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff90a7fa39a940 x1876044666893312/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1789136194.408810:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1789136194.408813:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1789136194.408815:0:38:0:(import.c:65:import_set_state_nolock()) ffff90a7ff596800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1789136194.408818:0:38:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 637 00000100:00080000:2.0:1789136194.408821:0:38:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1789136194.408824:0:38:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff90a7ff596800 using connection 192.168.201.131@tcp/0@lo 00000100:00100000:2.0:1789136194.408834:0:38:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff90a7fa39b0c0 x1876044666893440/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1789136194.408849:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1789136194.408873:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1789136194.408875:0:38:0:(import.c:65:import_set_state_nolock()) ffff90a6c47ca800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1789136194.408878:0:38:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 637 00000100:00080000:2.0:1789136194.408887:0:38:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1789136194.408890:0:38:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff90a6c47ca800 using connection 192.168.201.131@tcp/0@lo 00000100:00100000:2.0:1789136194.408904:0:38:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff90a6c10992c0 x1876044666893696/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1789136194.408955:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7fa398780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3639:1876044666893568:0@lo:400:kworker.0 00000100:00100000:2.0:1789136194.409035:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789136194.409101:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789136194.409107:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7fa35a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1876044666893184:0@lo:400:kworker.0 00000100:00100000:2.0:1789136194.409135:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789136194.409582:0:19265:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666893184 00000100:00100000:0.0:1789136194.409592:0:19265:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666893184 00000100:00100000:0.0:1789136194.409663:0:19265:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1789136194.409672:0:19265:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7c14b6d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3639:x1876044666893184:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789136194.409734:0:19265:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7c14b6d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3639:x1876044666893184:12345-0@lo:400:kworker.0 Request processed in 63us (597us total) trans 0 rc 0/0 00000100:00100000:0.0:1789136194.409742:0:19265:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1789136194.409782:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7fa35b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3637:1876044666892928:0@lo:38:kworker.0 00000100:00100000:0.0:1789136194.409813:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789136194.409832:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7fa39a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3637:1876044666893312:0@lo:38:kworker.0 00000100:00100000:0.0:1789136194.409896:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789136194.409913:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7fa39b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3637:1876044666893440:0@lo:38:kworker.0 00000100:00100000:0.0:1789136194.409935:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789136194.409949:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c10992c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3637:1876044666893696:0@lo:38:kworker.0 00000100:00100000:0.0:1789136194.409997:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789136194.410047:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7fa35a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1876044666893184:0@lo:400:kworker.0 00000100:00100000:3.0:1789136194.410316:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7fa35ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:511c13c6-847f-45db-8965-d0deb75673dc:3640:1876044666892800:0@lo:400:kworker.0 00000100:00100000:3.0:1789136194.410351:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789136194.410380:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7c14b4b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3640:1876044666893824:0@lo:400:kworker.0 00000100:00100000:3.0:1789136194.410400:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789136194.410413:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789136194.410418:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7fa35b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1876044666893056:0@lo:400:kworker.0 00000100:00100000:3.0:1789136194.410449:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789136194.410475:0:18920:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666893568 00000100:00100000:3.0:1789136194.410479:0:18920:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666893568 00000100:00100000:3.0:1789136194.410567:0:18920:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666893312 00000100:00100000:3.0:1789136194.410570:0:18920:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666893312 00000100:00100000:3.0:1789136194.410579:0:18920:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666893440 00000100:00100000:3.0:1789136194.410582:0:18920:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666893440 00000100:00100000:3.0:1789136194.410588:0:18920:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666893696 00000100:00100000:3.0:1789136194.410591:0:18920:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666893696 00000100:00100000:3.0:1789136194.410597:0:18920:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666893824 00000100:00100000:3.0:1789136194.410599:0:18920:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666893824 00000100:00100000:3.0:1789136194.410613:0:18920:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:3.0:1789136194.410621:0:18920:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7c14b5680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3639:x1876044666893568:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789136194.410660:0:18920:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7c14b5680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3639:x1876044666893568:12345-0@lo:400:kworker.0 Request processed in 41us (1626us total) trans 0 rc 0/0 00000100:00100000:3.0:1789136194.410666:0:18920:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00100000:3.0:1789136194.410678:0:18920:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:3.0:1789136194.410684:0:18920:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7fa348000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3640:x1876044666893824:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789136194.410715:0:18920:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7fa348000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3640:x1876044666893824:12345-0@lo:400:kworker.0 Request processed in 32us (314us total) trans 0 rc 0/0 00000100:00100000:3.0:1789136194.410721:0:18920:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00100000:3.0:1789136194.410733:0:18920:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:3.0:1789136194.410737:0:18920:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7fa3bde00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3637:x1876044666893312:12345-0@lo:38:kworker.0 00010000:02000000:3.0:1789136194.410763:0:18920:0:(ldlm_lib.c:1241:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:1.0:1789136194.413302:0:17754:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:1.0:1789136194.413317:0:17754:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7fa3bfc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3637:x1876044666893440:12345-0@lo:38:kworker.0 00010000:02000000:1.0:1789136194.413336:0:17754:0:(ldlm_lib.c:1241:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:1.0:1789136194.413436:0:17754:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7fa3bfc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3637:x1876044666893440:12345-0@lo:38:kworker.0 Request processed in 120us (3499us total) trans 0 rc -19/-19 00000100:00100000:1.0:1789136194.413443:0:17754:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:1.0:1789136194.413469:0:17754:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:1.0:1789136194.413473:0:17754:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7fa3be940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3637:x1876044666893696:12345-0@lo:38:kworker.0 00010000:02000000:1.0:1789136194.413480:0:17754:0:(ldlm_lib.c:1241:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:1.0:1789136194.413505:0:17754:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7fa3be940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3637:x1876044666893696:12345-0@lo:38:kworker.0 Request processed in 31us (3509us total) trans 0 rc -19/-19 00000100:00100000:1.0:1789136194.413510:0:17754:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:1.0:1789136194.413528:0:17759:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666892928 00000100:00100000:1.0:1789136194.413535:0:17759:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666892928 00000100:00100000:1.0:1789136194.413563:0:17759:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:1.0:1789136194.413567:0:17759:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7fa3be580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3637:x1876044666892928:12345-0@lo:38:kworker.0 00010000:02000000:1.0:1789136194.413573:0:17759:0:(ldlm_lib.c:1241:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:1.0:1789136194.413599:0:17759:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7fa3be580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3637:x1876044666892928:12345-0@lo:38:kworker.0 Request processed in 31us (3785us total) trans 0 rc -19/-19 00000100:00100000:1.0:1789136194.413604:0:17759:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00080000:1.0:1789136194.413649:0:3637:0:(import.c:65:import_set_state_nolock()) ffff90a6c44b9800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1789136194.413654:0:3637:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1789136194.413659:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7fa35b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3637:1876044666892928:0@lo:38:kworker.0 00000100:00080000:1.0:1789136194.413690:0:3637:0:(import.c:65:import_set_state_nolock()) ffff90a7ff596800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1789136194.413694:0:3637:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1789136194.413699:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7fa39b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3637:1876044666893440:0@lo:38:kworker.0 00000100:00080000:1.0:1789136194.413708:0:3637:0:(import.c:65:import_set_state_nolock()) ffff90a6c47ca800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1789136194.413711:0:3637:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1789136194.413714:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c10992c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3637:1876044666893696:0@lo:38:kworker.0 00000100:00100000:1.0:1789136194.413794:0:17746:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666892800 00000100:00100000:1.0:1789136194.413798:0:17746:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666892800 00000100:00100000:1.0:1789136194.413830:0:17746:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 179 00000100:00100000:1.0:1789136194.413837:0:17746:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7fa9fbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:511c13c6-847f-45db-8965-d0deb75673dc+19:3640:x1876044666892800:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789136194.413905:0:17746:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7fa9fbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:511c13c6-847f-45db-8965-d0deb75673dc+19:3640:x1876044666892800:12345-0@lo:400:kworker.0 Request processed in 68us (3552us total) trans 0 rc 0/0 00000100:00100000:1.0:1789136194.413912:0:17746:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 179 00000100:00100000:1.0:1789136194.413974:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7fa35ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:511c13c6-847f-45db-8965-d0deb75673dc:3640:1876044666892800:0@lo:400:kworker.0 00010000:00080000:1.0:1789136194.414006:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90a7c14b4b40 x1876044666893824/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789136210 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789136194.414017:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7c14b4b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3640:1876044666893824:0@lo:400:kworker.0 00000100:00100000:1.0:1789136194.414041:0:19266:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666893056 00000100:00100000:1.0:1789136194.414045:0:19266:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666893056 00000100:00100000:1.0:1789136194.414075:0:19266:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1789136194.414081:0:19266:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7fa34b0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3640:x1876044666893056:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789136194.414116:0:19266:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7fa34b0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3640:x1876044666893056:12345-0@lo:400:kworker.0 Request processed in 35us (3666us total) trans 0 rc 0/0 00000100:00100000:1.0:1789136194.414121:0:19266:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1789136194.414157:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7fa35b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1876044666893056:0@lo:400:kworker.0 00000100:00100000:0.0:1789136194.415661:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789136194.415684:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7fa3bed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1876044666893952:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1789136194.415741:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789136194.415802:0:19269:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666893952 00000100:00100000:0.0:1789136194.415808:0:19269:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666893952 00000100:00100000:0.0:1789136194.415850:0:19269:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1789136194.415888:0:19269:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7fa3bcf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1876044666893952:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1789136194.415914:0:19269:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923501056 avail 3691978752 00000100:00100000:0.0:1789136194.415956:0:19269:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7fa3bcf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1876044666893952:12345-0@lo:13:osp-pre-1-1.0 Request processed in 69us (214us total) trans 0 rc 0/0 00000100:00100000:0.0:1789136194.415962:0:19269:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00010000:00080000:0.0:1789136194.416018:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90a7fa398780 x1876044666893568/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789136210 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789136194.416034:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7fa398780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3639:1876044666893568:0@lo:400:kworker.0 00000100:00100000:0.0:1789136194.416071:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7fa3bed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1876044666893952:0@lo:13:osp-pre-1-1.0 00000100:00080000:1.0:1789136194.419476:0:17749:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789136194.419489:0:17749:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1789136194.419493:0:17749:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789136194.455257:0:18920:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7fa3bde00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3637:x1876044666893312:12345-0@lo:38:kworker.0 Request processed in 44496us (45338us total) trans 0 rc -19/-19 00000100:00100000:2.0:1789136194.455273:0:18920:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00080000:1.0:1789136194.455446:0:3637:0:(import.c:65:import_set_state_nolock()) ffff90a7d0676000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1789136194.455452:0:3637:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1789136194.455456:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7fa39a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3637:1876044666893312:0@lo:38:kworker.0 00000020:01000000:1.0:1789136194.472016:0:21338:0:(lprocfs_status_server.c:345:lprocfs_free_client_stats()) stat ffff90a7f64e3000 - data ffff90a6c244c1b0/ffff90a7c4eea800 00000020:01000000:1.0:1789136194.472205:0:21338:0:(lprocfs_status_server.c:345:lprocfs_free_client_stats()) stat ffff90a7c33ded20 - data ffff90a7cee3e438/ffff90a7fc1e2400 00000001:00000004:1.0:1789136194.479272:0:21338:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934628 00000100:00080000:3.0:1789136194.578661:0:21338:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:3.0:1789136194.578669:0:21338:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:3.0:1789136194.578684:0:21338:0:(client.c:3163:ptlrpc_free_committed()) @@@ free request with old gen req@ffff90a7fa3bd2c0 x1876044666890112/t8589934595(8589934595) o39->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/224 e 0 to 0 dl 1789136198 ref 1 fl Complete:RNQU/204/0 rc 0/0 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789136194.578729:0:21338:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00080000:3.0:1789136194.598070:0:21338:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:3.0:1789136194.598087:0:21338:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934598 gen 4 00000004:00080000:3.0:1789136194.598104:0:21338:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1789136194.598107:0:21338:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:1.0:1789136194.601415:0:17777:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:1.0:1789136194.601423:0:17777:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xa:0x0] index 2 count 1 00000040:00080000:1.0:1789136194.601440:0:17777:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 2 count 2 00000100:00080000:3.0:1789136194.605537:0:21338:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:3.0:1789136194.605546:0:21338:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934594 gen 4 00000004:00080000:3.0:1789136194.605568:0:21338:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1789136194.605571:0:21338:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:0.0:1789136194.606883:0:17779:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:0.0:1789136194.606890:0:17779:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xc:0x0] index 1 count 1 00000040:00080000:0.0:1789136194.606903:0:17779:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 2 count 2 00000020:00000080:1.0:1789136194.611192:0:21338:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x559c8745c6de3b88 00000020:00000080:1.0:1789136194.611205:0:21338:0:(genops.c:885:class_export_put()) final put ffff90a6c3a2f800/lustre-MDT0000-osd_UUID 00000020:00000080:3.0:1789136194.611847:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff90a6c3a2f800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1789136194.613776:0:21338:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x559c8745c6de3b9d 00000020:00000080:1.0:1789136194.613790:0:21338:0:(genops.c:885:class_export_put()) final put ffff90a7ff555800/lustre-MDT0000-mdtlov_UUID 00000020:01000000:1.0:1789136194.613808:0:21338:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-mdtlov (flags='') 00000020:00000080:1.0:1789136194.613814:0:21338:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1789136194.613822:0:21338:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:1.0:1789136194.613826:0:21338:0:(genops.c:1558:class_disconnect_exports()) OBD device 4 (ffff90a6c3a40000) has no exports 00000004:01000000:1.0:1789136194.614024:0:21338:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:1.0:1789136194.614034:0:21338:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x559c8745c6de3bff 00000020:00000080:1.0:1789136194.614038:0:21338:0:(genops.c:885:class_export_put()) final put ffff90a7f6296800/lustre-MDT0000-mdtlov_UUID 00000020:01000000:1.0:1789136194.614043:0:21338:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0000 (flags='') 00000020:00000080:1.0:1789136194.614046:0:21338:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1789136194.614051:0:21338:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:1.0:1789136194.614053:0:21338:0:(genops.c:1558:class_disconnect_exports()) OBD device 10 (ffff90a7f64b1a48) has no exports 00000020:00000080:1.0:1789136194.614060:0:21338:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x559c8745c6de3bf8 00000020:00000080:1.0:1789136194.614064:0:21338:0:(genops.c:885:class_export_put()) final put ffff90a7f6291000/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1789136194.616021:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff90a7ff555800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:00000080:0.0:1789136194.616057:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff90a7f6296800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:00000080:0.0:1789136194.616062:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff90a7f6291000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:1.0:1789136194.618471:0:21338:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0000: client import never connected 00000100:00080000:1.0:1789136194.618479:0:21338:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:1.0:1789136194.618484:0:21338:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934594 gen 5 00000004:00080000:1.0:1789136194.618491:0:21338:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1789136194.618493:0:21338:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1789136194.618597:0:21338:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1789136194.618607:0:21338:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1789136194.618616:0:21338:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x559c8745c6de3bea 00000020:00000080:1.0:1789136194.618626:0:21338:0:(genops.c:885:class_export_put()) final put ffff90a7f6290800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1789136194.628131:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff90a7f6293800 for lustre-OST0001-osc-MDT0000 00000020:00000080:0.0:1789136194.628153:0:38:0:(genops.c:885:class_export_put()) final put ffff90a7f6292800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1789136194.628158:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff90a7f6292800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:01000000:0.0:1789136194.628165:0:38:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:01000000:1.0:1789136194.629457:0:21338:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0000 (flags='') 00000020:00000080:1.0:1789136194.629488:0:21338:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1789136194.629497:0:21338:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:1.0:1789136194.629501:0:21338:0:(genops.c:1558:class_disconnect_exports()) OBD device 9 (ffff90a7efa18000) has no exports 00000020:00000080:1.0:1789136194.629511:0:21338:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x559c8745c6de3be3 00000020:00000080:1.0:1789136194.629520:0:21338:0:(genops.c:885:class_export_put()) final put ffff90a7e761c000/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1789136194.634683:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff90a7f6290800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:00000080:0.0:1789136194.636942:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff90a7e761c000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:1.0:1789136194.642755:0:21338:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0000: client import never connected 00000100:00080000:1.0:1789136194.642764:0:21338:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:1.0:1789136194.642768:0:21338:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934598 gen 5 00000004:00080000:1.0:1789136194.642775:0:21338:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1789136194.642778:0:21338:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1789136194.642912:0:21338:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1789136194.642923:0:21338:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000004:01000000:1.0:1789136194.642939:0:21338:0:(lod_lov.c:59:lod_putref()) destroying 1 ltd desc 00000020:00000080:1.0:1789136194.642946:0:21338:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x559c8745c6de3bd5 00000020:00000080:1.0:1789136194.642955:0:21338:0:(genops.c:885:class_export_put()) final put ffff90a7e761b000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1789136194.646485:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff90a7e761e800 for lustre-OST0000-osc-MDT0000 00000020:00000080:0.0:1789136194.646501:0:38:0:(genops.c:885:class_export_put()) final put ffff90a7e761d800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1789136194.646504:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff90a7e761d800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:01000000:0.0:1789136194.646512:0:38:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:01000000:1.0:1789136194.650259:0:21338:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-osp-MDT0000 (flags='') 00000020:00000080:1.0:1789136194.650275:0:21338:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1789136194.650286:0:21338:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-osp-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:1.0:1789136194.650291:0:21338:0:(genops.c:1558:class_disconnect_exports()) OBD device 8 (ffff90a6c2b90000) has no exports 00000020:00000080:1.0:1789136194.650299:0:21338:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x559c8745c6de3bce 00000020:00000080:1.0:1789136194.650310:0:21338:0:(genops.c:885:class_export_put()) final put ffff90a6c3a2a000/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1789136194.650938:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff90a7e761b000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001-osp-MDT0000 00000020:00000080:0.0:1789136194.650948:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff90a6c3a2a000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:0.0:1789136194.655194:0:21338:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0001-osp-MDT0000: client import never connected 00000100:00080000:0.0:1789136194.655204:0:21338:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:0.0:1789136194.655210:0:21338:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:0.0:1789136194.655220:0:21338:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1789136194.655305:0:21338:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1789136194.655316:0:21338:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1789136194.655343:0:21338:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1789136194.655346:0:21338:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1789136194.655352:0:21338:0:(genops.c:885:class_export_put()) final put ffff90a6c3a2b000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1789136194.655357:0:21338:0:(genops.c:844:class_export_destroy()) destroying export ffff90a6c3a2b000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:0.0:1789136194.655364:0:21338:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-mdtlov (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1789136194.655460:0:21338:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x559c8745c6de3ba4 00000020:00000080:0.0:1789136194.655467:0:21338:0:(genops.c:885:class_export_put()) final put ffff90a7ff554800/lustre-MDD0000_UUID 00000020:01000000:0.0:1789136194.655485:0:21338:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDD0000 (flags='') 00000020:00000080:0.0:1789136194.655489:0:21338:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1789136194.655494:0:21338:0:(obd_config.c:956:class_cleanup()) lustre-MDD0000: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1789136194.655497:0:21338:0:(genops.c:1558:class_disconnect_exports()) OBD device 6 (ffff90a6c3a41a48) has no exports 00000020:00000080:0.0:1789136194.655516:0:21338:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1789136194.655519:0:21338:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000020:00000080:0.0:1789136194.655523:0:21338:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x559c8745c6de3bab 00000020:00000080:0.0:1789136194.655527:0:21338:0:(genops.c:885:class_export_put()) final put ffff90a7ff555000/lustre-MDT0000-osd_UUID 00000020:01000004:0.0:1789136194.655538:0:21338:0:(tgt_mount.c:187:server_put_mount()) put mount ffff90a7d8b2f000 from lustre-MDT0000, refs=3 00000020:01000004:0.0:1789136194.655542:0:21338:0:(obd_mount.c:710:lustre_put_lsi()) put ffff90a7d8b2f000 3 00000020:01000004:0.0:1789136194.655545:0:21338:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff90a7d8b2f000 from lustre-MDT0000 00000020:00000080:0.0:1789136194.655560:0:21338:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1789136194.655563:0:21338:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:00000080:0.0:1789136194.655565:0:21338:0:(genops.c:885:class_export_put()) final put ffff90a6c3a2f000/lustre-MDT0000_UUID 00000020:00000080:0.0:1789136194.655567:0:21338:0:(genops.c:844:class_export_destroy()) destroying export ffff90a6c3a2f000/lustre-MDT0000_UUID for lustre-MDT0000 00000020:01000000:0.0:1789136194.655573:0:21338:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000 (lustre-MDT0000_UUID) 00000020:01000004:0.0:1789136194.655601:0:21338:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 3 references. 00000020:01000004:0.0:1789136194.655605:0:21338:0:(tgt_mount.c:255:server_stop_mgs()) Stop MGS service MGS 00000020:01000000:0.0:1789136194.655608:0:21338:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGS (flags='F') 00000020:00000080:0.0:1789136194.655611:0:21338:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1789136194.655613:0:21338:0:(obd_config.c:956:class_cleanup()) MGS: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1789136194.655620:0:21338:0:(genops.c:1819:print_export_data()) MGS: ACTIVE ffff90a7ff56b800 511c13c6-847f-45db-8965-d0deb75673dc 0@lo 18 (0 0 13) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1789136194.655626:0:21338:0:(genops.c:1553:class_disconnect_exports()) OBD device 1 (ffff90a7f64b4ed8) has exports, disconnecting them 00000020:00080000:0.0:1789136194.655629:0:21338:0:(genops.c:1528:class_disconnect_export_list()) MGS: disconnecting export at 0@lo (ffff90a7ff56b800), last request at 1789136078 00000020:00000080:0.0:1789136194.655644:0:21338:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x559c8745c6de3b49 00000020:00010000:0.0:1789136194.655649:0:21338:0:(genops.c:1921:obd_stale_export_put()) Put export ffff90a7ff56b800: total 2 00000100:00080000:0.0:1789136194.655653:0:21338:0:(import.c:65:import_set_state_nolock()) ffff90a7ff568000 : changing import state from FULL to CLOSED 00000020:00080000:0.0:1789136194.655667:0:21338:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff90a7ff56b800): rc 0 00000020:00080000:0.0:1789136194.655672:0:21338:0:(genops.c:1558:class_disconnect_exports()) OBD device 1 (ffff90a7f64b4ed8) has no exports 00000100:00100000:0.0:1789136194.655741:0:17747:0:(service.c:3183:ptlrpc_main()) ll_mgs_0002: service thread [ffff90a6c22a2800:17747] 2 exiting: rc = 0 00000020:00000080:3.0:1789136194.655915:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff90a6c3a2e000 for lustre-MDT0001-osp-MDT0000 00000020:00000080:3.0:1789136194.655922:0:38:0:(genops.c:885:class_export_put()) final put ffff90a7c7412000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1789136194.655924:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff90a7c7412000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001-osp-MDT0000 00000020:01000000:3.0:1789136194.655933:0:38:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-osp-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1789136194.656000:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff90a7ff554800/lustre-MDD0000_UUID for lustre-MDD0000 00000020:00000080:3.0:1789136194.656003:0:38:0:(genops.c:885:class_export_put()) final put ffff90a6c3a2c000/lustre-MDD0000_UUID 00000020:00000080:3.0:1789136194.656006:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff90a6c3a2c000/lustre-MDD0000_UUID for lustre-MDD0000 00000020:01000000:3.0:1789136194.656009:0:38:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0000 (lustre-MDD0000_UUID) 00000020:00000080:3.0:1789136194.656036:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff90a7ff555000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00010000:3.0:1789136194.656056:0:17742:0:(genops.c:1907:obd_stale_export_get()) Get export ffff90a7ff56b800: total 0 00010000:00010000:3.0:1789136194.656076:0:17742:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff90a7ff56b800, canceled 0 locks, left on hash table 13. 00010000:00010000:3.0:1789136194.656103:0:17742:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90a7e1c9f400/0x559c8745c6de4100 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x559c8745c6de40f9 expref: 14 pid: 17747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136194.656120:0:17742:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90a7ff5f5c00/0x559c8745c6de410e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x559c8745c6de4107 expref: 13 pid: 17747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136194.656131:0:17742:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90a6c2d3e600/0x559c8745c6de3db1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x559c8745c6de3daa expref: 12 pid: 17745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136194.656150:0:17742:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90a7ff5f5a00/0x559c8745c6de411c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x559c8745c6de4115 expref: 11 pid: 17747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136194.656165:0:17742:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90a6c2d3f600/0x559c8745c6de3c6f lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x559c8745c6de3c68 expref: 10 pid: 17745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136194.656177:0:17742:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90a7ff5f4a00/0x559c8745c6de3f1d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x559c8745c6de3f16 expref: 9 pid: 17747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136194.656189:0:17742:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90a6c2d3fa00/0x559c8745c6de3c8b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x559c8745c6de3c84 expref: 8 pid: 17745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136194.656199:0:17742:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90a6c2d3e000/0x559c8745c6de3b5e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x559c8745c6de3b57 expref: 7 pid: 17746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136194.656208:0:17742:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90a6c3caf200/0x559c8745c6de3ddb lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x559c8745c6de3dd4 expref: 6 pid: 17746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136194.656217:0:17742:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90a7ff5f5e00/0x559c8745c6de3f47 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x559c8745c6de3f40 expref: 5 pid: 17745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136194.656226:0:17742:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90a7e1c9f000/0x559c8745c6de3f86 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x559c8745c6de3f7f expref: 4 pid: 17745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136194.656238:0:17742:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90a7d1879800/0x559c8745c6de3d2c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x559c8745c6de3d25 expref: 3 pid: 17745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136194.656250:0:17742:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90a6c2d3ee00/0x559c8745c6de3c7d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x559c8745c6de3c76 expref: 2 pid: 17745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136194.656269:0:17742:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff90a7ff56b800, canceled 13 locks, left on hash table 0. 00000020:00000080:3.0:1789136194.656281:0:17742:0:(genops.c:885:class_export_put()) final put ffff90a7ff56b800/511c13c6-847f-45db-8965-d0deb75673dc 00010000:00010000:3.0:1789136194.656317:0:17742:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789136194.656320:0:17742:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789136194.656322:0:17742:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789136194.656431:0:17745:0:(service.c:3183:ptlrpc_main()) ll_mgs_0000: service thread [ffff90a6c22a3000:17745] 0 exiting: rc = 1 00000020:00000080:0.0:1789136194.657377:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff90a7ff56b800/511c13c6-847f-45db-8965-d0deb75673dc for MGS 00000020:00000080:0.0:1789136194.657427:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff90a7ff568000 for MGS 00000100:00100000:1.0:1789136194.659321:0:17746:0:(service.c:3183:ptlrpc_main()) ll_mgs_0001: service thread [ffff90a6c22a2400:17746] 1 exiting: rc = 0 00000100:00100000:0.0:1789136194.659706:0:21338:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136194.659715:0:21338:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136194.659724:0:21338:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136194.659730:0:21338:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136194.659736:0:21338:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136194.659752:0:21338:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136194.659758:0:21338:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136194.659764:0:21338:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136194.659771:0:21338:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136194.659789:0:21338:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136194.659798:0:21338:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136194.659804:0:21338:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136194.659811:0:21338:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136194.659817:0:21338:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136194.659824:0:21338:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136194.659831:0:21338:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136194.659836:0:21338:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136194.659841:0:21338:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136194.659847:0:21338:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136194.659878:0:21338:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136194.659886:0:21338:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136194.659892:0:21338:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136194.659897:0:21338:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136194.659902:0:21338:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136194.659907:0:21338:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136194.659912:0:21338:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136194.659917:0:21338:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136194.659922:0:21338:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136194.659928:0:21338:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136194.659932:0:21338:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136194.659938:0:21338:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136194.659944:0:21338:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136194.659949:0:21338:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136194.659955:0:21338:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136194.659959:0:21338:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136194.660008:0:21338:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136194.660016:0:21338:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136194.660022:0:21338:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136194.660028:0:21338:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136194.660032:0:21338:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136194.660037:0:21338:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136194.660043:0:21338:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136194.660049:0:21338:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136194.660056:0:21338:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136194.660072:0:21338:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136194.660078:0:21338:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136194.660085:0:21338:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136194.660090:0:21338:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136194.660095:0:21338:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136194.660100:0:21338:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136194.660105:0:21338:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136194.660111:0:21338:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136194.660115:0:21338:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136194.660120:0:21338:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136194.660125:0:21338:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136194.660130:0:21338:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136194.660136:0:21338:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136194.660141:0:21338:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136194.660146:0:21338:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136194.660153:0:21338:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136194.660158:0:21338:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136194.660164:0:21338:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136194.660170:0:21338:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136194.660175:0:21338:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:01000000:0.0:1789136194.667115:0:21338:0:(lprocfs_status_server.c:345:lprocfs_free_client_stats()) stat ffff90a7f64e3c00 - data ffff90a7ceca4510/ffff90a7f04c0c00 00000020:01000000:0.0:1789136194.667293:0:21338:0:(lprocfs_status_server.c:345:lprocfs_free_client_stats()) stat ffff90a6c3dc7000 - data ffff90a7cee6cd80/ffff90a7f7de1400 00000020:00000080:0.0:1789136194.667723:0:21338:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x559c8745c6de3b34 00000020:00000080:0.0:1789136194.667731:0:21338:0:(genops.c:885:class_export_put()) final put ffff90a7f666c800/lustre-MDT0000-osd_UUID 00000020:01000004:0.0:1789136194.668185:0:21338:0:(tgt_mount.c:187:server_put_mount()) put mount ffff90a7d8b2f000 from MGS, refs=2 00000020:01000004:0.0:1789136194.668201:0:21338:0:(obd_mount.c:710:lustre_put_lsi()) put ffff90a7d8b2f000 2 00000020:01000004:0.0:1789136194.668204:0:21338:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff90a7d8b2f000 from MGS 00000020:00000080:0.0:1789136194.668230:0:21338:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1789136194.668236:0:21338:0:(obd_config.c:883:class_detach()) detach on obd MGS (uuid MGS) 00000020:00000080:0.0:1789136194.668240:0:21338:0:(genops.c:885:class_export_put()) final put ffff90a7f666a000/MGS 00000020:00000080:0.0:1789136194.668243:0:21338:0:(genops.c:844:class_export_destroy()) destroying export ffff90a7f666a000/MGS for MGS 00000020:01000000:0.0:1789136194.668250:0:21338:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGS (MGS) 00000020:01000000:0.0:1789136194.668312:0:21338:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0000 (flags='F') 00000020:00000080:0.0:1789136194.668316:0:21338:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1789136194.668322:0:21338:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-MDT0000: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1789136194.668328:0:21338:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-MDT0000: ACTIVE ffff90a7fa65e000 lustre-MDT0000-lwp-MDT0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1789136194.668334:0:21338:0:(genops.c:1553:class_disconnect_exports()) OBD device 11 (ffff90a7f64b0000) has exports, disconnecting them 00000020:00080000:0.0:1789136194.668338:0:21338:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0000: disconnecting export at 0@lo (ffff90a7fa65e000), last request at 1789136078 00000020:00000080:0.0:1789136194.668342:0:21338:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x559c8745c6de3c37 00000020:00080000:0.0:1789136194.668352:0:21338:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff90a7fa65e000): rc 0 00000020:00000080:0.0:1789136194.668356:0:21338:0:(genops.c:885:class_export_put()) final put ffff90a7fa65e000/lustre-MDT0000-lwp-MDT0000 00000020:00000080:3.0:1789136194.672595:0:16093:0:(genops.c:844:class_export_destroy()) destroying export ffff90a7f666c800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:3.0:1789136194.674958:0:16093:0:(genops.c:844:class_export_destroy()) destroying export ffff90a7fa65e000/lustre-MDT0000-lwp-MDT0000 for lustre-MDT0000-lwp-MDT0000 00010000:01000000:1.0:1789136194.733242:0:21338:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0000: client import never connected 00000100:00080000:1.0:1789136194.733252:0:21338:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1789136194.733256:0:21338:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:1.0:1789136194.733383:0:21338:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1789136194.733593:0:21338:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1789136194.733602:0:21338:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000020:01000004:1.0:1789136194.733610:0:21338:0:(obd_mount.c:710:lustre_put_lsi()) put ffff90a7d8b2f000 1 00000020:00000080:1.0:1789136194.733617:0:21338:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x559c8745c6de3b26 00000020:00000080:1.0:1789136194.733626:0:21338:0:(genops.c:885:class_export_put()) final put ffff90a7f666a800/lustre-MDT0000-osd_UUID 00000020:00000080:3.0:1789136194.733648:0:16093:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff90a7fa65d000 for lustre-MDT0000-lwp-MDT0000 00000020:00000080:3.0:1789136194.733655:0:16093:0:(genops.c:885:class_export_put()) final put ffff90a6c3a2c800/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:3.0:1789136194.733657:0:16093:0:(genops.c:844:class_export_destroy()) destroying export ffff90a6c3a2c800/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000-lwp-MDT0000 00000020:01000000:3.0:1789136194.733664:0:16093:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0000 (lustre-MDT0000-lwp-MDT0000_UUID) 00000020:01000000:1.0:1789136194.734063:0:21338:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osd (flags='') 00000020:00000080:1.0:1789136194.734069:0:21338:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1789136194.734073:0:21338:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-osd: forcing exports to disconnect: 0/2 00000020:00000080:3.0:1789136194.734137:0:16093:0:(genops.c:844:class_export_destroy()) destroying export ffff90a7f666a800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00080000:1.0:1789136194.734162:0:21338:0:(genops.c:1558:class_disconnect_exports()) OBD device 0 (ffff90a6c2b93490) has no exports 00010000:00010000:1.0:1789136194.927041:0:17741:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1789136194.978654:0:21338:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1789136194.978665:0:21338:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00000020:00000080:1.0:1789136194.978671:0:21338:0:(genops.c:885:class_export_put()) final put ffff90a7d8b2a000/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1789136194.978676:0:21338:0:(genops.c:844:class_export_destroy()) destroying export ffff90a7d8b2a000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:1.0:1789136194.978688:0:21338:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osd (lustre-MDT0000-osd_UUID) 00000020:01000004:1.0:1789136194.978818:0:21338:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff90a7d8b29000 00000020:02000400:1.0:1789136194.978933:0:21338:0:(tgt_mount.c:2181:server_put_super()) server umount lustre-MDT0000 complete 00010000:00010000:3.0:1789136195.944480:0:17742:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789136196.467071:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7c14b6940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1876044666894080:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1789136196.467148:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789136196.469253:0:19268:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666894080 00000100:00100000:0.0:1789136196.469268:0:19268:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666894080 00000100:00100000:0.0:1789136196.469359:0:19268:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1789136196.469371:0:19268:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7c14b4f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1876044666894080:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1789136196.469404:0:19268:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3915853824 avail 3684331520 00000100:00100000:0.0:1789136196.469485:0:19268:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7c14b4f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1876044666894080:12345-0@lo:13:osp-pre-0-1.0 Request processed in 117us (2336us total) trans 0 rc 0/0 00000100:00100000:0.0:1789136196.469492:0:19268:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00080000:2.0:1789136196.469506:0:17749:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789136196.469550:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7c14b6940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1876044666894080:0@lo:13:osp-pre-0-1.0 00010000:00010000:1.0:1789136196.969971:0:17741:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1789136197.742125:0:18511:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1789136197.993334:0:17742:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789136199.025781:0:17741:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1789136199.531542:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1789136199.531549:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1789136199.531552:0:38:0:(import.c:65:import_set_state_nolock()) ffff90a6c44b9800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1789136199.531561:0:38:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 642 00000100:00080000:3.0:1789136199.531567:0:38:0:(import.c:589:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 10s 00000100:00080000:3.0:1789136199.531574:0:38:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff90a6c44b9800 using connection 192.168.201.131@tcp/0@lo 00000100:00100000:3.0:1789136199.531599:0:38:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff90a7fa348780 x1876044666894336/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1789136199.531642:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1789136199.531646:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1789136199.531658:0:38:0:(import.c:65:import_set_state_nolock()) ffff90a7d0676000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1789136199.531662:0:38:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 642 00000100:00080000:3.0:1789136199.531665:0:38:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 10s 00000100:00080000:3.0:1789136199.531669:0:38:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff90a7d0676000 using connection 192.168.201.131@tcp/0@lo 00000100:00100000:3.0:1789136199.531682:0:38:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff90a7fa7df840 x1876044666894720/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1789136199.531692:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1789136199.531695:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1789136199.531696:0:38:0:(import.c:65:import_set_state_nolock()) ffff90a7ff596800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1789136199.531700:0:38:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 642 00000100:00080000:3.0:1789136199.531702:0:38:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 10s 00000100:00080000:3.0:1789136199.531706:0:38:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff90a7ff596800 using connection 192.168.201.131@tcp/0@lo 00000100:00100000:3.0:1789136199.531715:0:38:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff90a7fa7df480 x1876044666894848/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1789136199.531731:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1789136199.531735:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1789136199.531737:0:38:0:(import.c:65:import_set_state_nolock()) ffff90a6c47ca800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1789136199.531740:0:38:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 642 00000100:00080000:3.0:1789136199.531743:0:38:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 10s 00000100:00080000:3.0:1789136199.531746:0:38:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff90a6c47ca800 using connection 192.168.201.131@tcp/0@lo 00000100:00100000:3.0:1789136199.531754:0:38:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff90a7fa7dda40 x1876044666895104/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1789136199.531804:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7fa7df0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3638:1876044666894976:0@lo:400:kworker.0 00000100:00100000:3.0:1789136199.531917:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789136199.531987:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1789136199.531995:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7fa34ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:511c13c6-847f-45db-8965-d0deb75673dc:3638:1876044666894208:0@lo:400:kworker.0 00000400:00000100:3.0:1789136199.532019:0:3638:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1876044666894208 offset 0 length 224: 4 00000100:00100000:3.0:1789136199.532039:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7ff64bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3638:1876044666895232:0@lo:400:kworker.0 00000100:00100000:3.0:1789136199.532062:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789136199.532096:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7fa348780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3637:1876044666894336:0@lo:38:kworker.0 00000100:00100000:3.0:1789136199.532128:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789136199.532146:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7fa7df840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3637:1876044666894720:0@lo:38:kworker.0 00000100:00100000:3.0:1789136199.532167:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789136199.532185:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7fa7df480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3637:1876044666894848:0@lo:38:kworker.0 00000100:00100000:3.0:1789136199.532203:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789136199.532217:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7fa7dda40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3637:1876044666895104:0@lo:38:kworker.0 00000100:00100000:3.0:1789136199.532234:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789136199.532255:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7fa7dc780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1876044666894592:0@lo:400:kworker.0 00000100:00100000:3.0:1789136199.532282:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789136199.532300:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789136199.532305:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7fa3492c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1876044666894464:0@lo:400:kworker.0 00000100:00100000:3.0:1789136199.532324:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789136199.532361:0:17754:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666894976 00000100:00100000:3.0:1789136199.532367:0:17754:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666894976 00000100:00100000:3.0:1789136199.532412:0:17754:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666895232 00000100:00100000:3.0:1789136199.532415:0:17754:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666895232 00000100:00100000:3.0:1789136199.532429:0:17754:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666894720 00000100:00100000:3.0:1789136199.532431:0:17754:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666894720 00000100:00100000:3.0:1789136199.532439:0:17754:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666894848 00000100:00100000:3.0:1789136199.532441:0:17754:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666894848 00000100:00100000:3.0:1789136199.532446:0:17754:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666895104 00000100:00100000:3.0:1789136199.532454:0:17754:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666895104 00000100:00100000:3.0:1789136199.532469:0:17754:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:3.0:1789136199.532477:0:17754:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7ff64a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3638:x1876044666894976:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789136199.532526:0:17754:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7ff64a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3638:x1876044666894976:12345-0@lo:400:kworker.0 Request processed in 50us (609us total) trans 0 rc 0/0 00000100:00100000:3.0:1789136199.532533:0:17754:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00100000:3.0:1789136199.532550:0:17754:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:3.0:1789136199.532556:0:17754:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7ff6483c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3638:x1876044666895232:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789136199.532580:0:17754:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7ff6483c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3638:x1876044666895232:12345-0@lo:400:kworker.0 Request processed in 25us (518us total) trans 0 rc 0/0 00000100:00100000:3.0:1789136199.532586:0:17754:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00100000:3.0:1789136199.532597:0:17754:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:3.0:1789136199.532601:0:17754:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7ff64b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3637:x1876044666894720:12345-0@lo:38:kworker.0 00010000:00020000:3.0:1789136199.532619:0:17754:0:(ldlm_lib.c:1228:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1789136199.536445:0:18920:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1789136199.536459:0:18920:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7ff64b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3637:x1876044666894848:12345-0@lo:38:kworker.0 00010000:00020000:2.0:1789136199.536488:0:18920:0:(ldlm_lib.c:1228:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1789136199.536605:0:18920:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7ff64b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3637:x1876044666894848:12345-0@lo:38:kworker.0 Request processed in 146us (4399us total) trans 0 rc -19/-19 00000100:00100000:2.0:1789136199.536612:0:18920:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1789136199.536638:0:18920:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:2.0:1789136199.536642:0:18920:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7ff64a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3637:x1876044666895104:12345-0@lo:38:kworker.0 00010000:00020000:2.0:1789136199.536652:0:18920:0:(ldlm_lib.c:1228:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1789136199.536694:0:18920:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7ff64a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3637:x1876044666895104:12345-0@lo:38:kworker.0 Request processed in 50us (4459us total) trans 0 rc -19/-19 00000100:00100000:2.0:1789136199.536702:0:18920:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:2.0:1789136199.539339:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789136199.539361:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7c14b70c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1876044666895360:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1789136199.539430:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789136199.539472:0:20582:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666895360 00000100:00100000:2.0:1789136199.539479:0:20582:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666895360 00000100:00100000:2.0:1789136199.539533:0:20582:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1789136199.539543:0:20582:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7c14b5a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1876044666895360:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1789136199.539573:0:20582:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923501056 avail 3691978752 00000100:00100000:2.0:1789136199.539613:0:20582:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7c14b5a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1876044666895360:12345-0@lo:13:osp-pre-1-1.0 Request processed in 73us (185us total) trans 0 rc 0/0 00000100:00100000:2.0:1789136199.539621:0:20582:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1789136199.539672:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7c14b70c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1876044666895360:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1789136199.539980:0:19267:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666894592 00000100:00100000:0.0:1789136199.539985:0:19267:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666894592 00000100:00100000:0.0:1789136199.540157:0:19267:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666894464 00000100:00100000:0.0:1789136199.540161:0:19267:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666894464 00000100:00100000:0.0:1789136199.540196:0:19267:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1789136199.540202:0:19267:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7ff6492c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3641:x1876044666894592:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789136199.540245:0:19267:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7ff6492c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3641:x1876044666894592:12345-0@lo:400:kworker.0 Request processed in 43us (7962us total) trans 0 rc 0/0 00000100:00100000:0.0:1789136199.540251:0:19267:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1789136199.540264:0:19267:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1789136199.540270:0:19267:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7ff648000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3641:x1876044666894464:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789136199.540295:0:19267:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7ff648000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3641:x1876044666894464:12345-0@lo:400:kworker.0 Request processed in 26us (7970us total) trans 0 rc 0/0 00000100:00100000:0.0:1789136199.540300:0:19267:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1789136199.540323:0:17758:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666894336 00000100:00100000:0.0:1789136199.540326:0:17758:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666894336 00000100:00100000:0.0:1789136199.540346:0:17758:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:0.0:1789136199.540350:0:17758:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7ff6c0c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3637:x1876044666894336:12345-0@lo:38:kworker.0 00010000:00020000:0.0:1789136199.540367:0:17758:0:(ldlm_lib.c:1228:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1789136199.540398:0:17758:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7ff6c0c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3637:x1876044666894336:12345-0@lo:38:kworker.0 Request processed in 46us (8269us total) trans 0 rc -19/-19 00000100:00100000:0.0:1789136199.540404:0:17758:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:2.0:1789136199.540839:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7fa3492c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1876044666894464:0@lo:400:kworker.0 00000100:00100000:2.0:1789136199.540867:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7fa7dc780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1876044666894592:0@lo:400:kworker.0 00000100:00080000:2.0:1789136199.546194:0:17749:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789136199.546205:0:17749:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789136199.546209:0:17749:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:2.0:1789136199.560312:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61550) req@ffff90a7ff64bc00 x1876044666895232/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789136215 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789136199.560331:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7ff64bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3638:1876044666895232:0@lo:400:kworker.0 00010000:00080000:2.0:1789136199.560345:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61550) req@ffff90a7fa7df0c0 x1876044666894976/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789136215 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789136199.560372:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7fa7df0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3638:1876044666894976:0@lo:400:kworker.0 00000100:00080000:3.0:1789136199.595284:0:3637:0:(import.c:65:import_set_state_nolock()) ffff90a6c44b9800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1789136199.595299:0:3637:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1789136199.595305:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7fa348780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3637:1876044666894336:0@lo:38:kworker.0 00000100:00080000:3.0:1789136199.595319:0:3637:0:(import.c:65:import_set_state_nolock()) ffff90a7ff596800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1789136199.595323:0:3637:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1789136199.595327:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7fa7df480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3637:1876044666894848:0@lo:38:kworker.0 00000100:00080000:3.0:1789136199.595338:0:3637:0:(import.c:65:import_set_state_nolock()) ffff90a6c47ca800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1789136199.595341:0:3637:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1789136199.595344:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7fa7dda40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3637:1876044666895104:0@lo:38:kworker.0 00000100:00100000:3.0:1789136199.597319:0:17754:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7ff64b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3637:x1876044666894720:12345-0@lo:38:kworker.0 Request processed in 64707us (65141us total) trans 0 rc -19/-19 00000100:00100000:3.0:1789136199.597340:0:17754:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00080000:3.0:1789136199.597390:0:3637:0:(import.c:65:import_set_state_nolock()) ffff90a7d0676000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1789136199.597395:0:3637:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1789136199.597399:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7fa7df840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3637:1876044666894720:0@lo:38:kworker.0 00010000:00010000:2.0:1789136200.040494:0:17742:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:0.0:1789136200.678630:0:21540:0:(tgt_mount.c:2192:server_umount_begin()) umount -f 00000020:01000004:1.0:1789136200.703245:0:21540:0:(tgt_mount.c:2062:server_put_super()) server put_super lustre-MDT0001 00010000:00010000:1.0:1789136200.703416:0:21540:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.131@tcp lock: ffff90a7d1878a00/0x559c8745c6de3d25 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x559c8745c6de3d2c expref: -99 pid: 18488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136200.703432:0:21540:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.131@tcp lock: ffff90a7d1878a00/0x559c8745c6de3d25 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x559c8745c6de3d2c expref: -99 pid: 18488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136200.703438:0:21540:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.131@tcp lock: ffff90a7d1878a00/0x559c8745c6de3d25 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0x559c8745c6de3d2c expref: -99 pid: 18488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136200.703458:0:21540:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.131@tcp lock: ffff90a7d1878a00/0x559c8745c6de3d25 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0x559c8745c6de3d2c expref: -99 pid: 18488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136200.703523:0:21540:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:1.0:1789136200.703529:0:21540:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:1.0:1789136200.703557:0:21540:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1789136200.703562:0:21540:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 3 00000100:00080000:1.0:1789136200.703568:0:21540:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID 00000100:00080000:1.0:1789136200.703574:0:21540:0:(import.c:65:import_set_state_nolock()) ffff90a7d0676000 lustre-MDT0000_UUID: changing import state from DISCONN to CLOSED 00000100:00080000:1.0:1789136200.703578:0:21540:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1789136200.703580:0:21540:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 4 00000100:00100000:1.0:1789136200.703583:0:21540:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:1.0:1789136200.705180:0:21540:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.131@tcp lock: ffff90a7d1878200/0x559c8745c6de3c84 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x559c8745c6de3c8b expref: -99 pid: 18488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136200.705197:0:21540:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.131@tcp lock: ffff90a7d1878200/0x559c8745c6de3c84 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x559c8745c6de3c8b expref: -99 pid: 18488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136200.705204:0:21540:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.131@tcp lock: ffff90a7d1878200/0x559c8745c6de3c84 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0x559c8745c6de3c8b expref: -99 pid: 18488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136200.705211:0:21540:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.131@tcp lock: ffff90a7d1878200/0x559c8745c6de3c84 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0x559c8745c6de3c8b expref: -99 pid: 18488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136200.707421:0:17741:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1789136200.707435:0:17741:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.131@tcp lock: ffff90a7d1878a00/0x559c8745c6de3d25 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0x559c8745c6de3d2c expref: -99 pid: 18488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136200.707447:0:17741:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a7d1878a00 already unused, calling callback (ffffffffc13bbc20) 10000000:00010000:2.0:1789136200.707451:0:17741:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.131@tcp lock: ffff90a7d1878a00/0x559c8745c6de3d25 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0x559c8745c6de3d2c expref: -99 pid: 18488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136200.707460:0:17741:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.131@tcp lock: ffff90a7d1878a00/0x559c8745c6de3d25 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1008400000000 nid: local remote: 0x559c8745c6de3d2c expref: -99 pid: 18488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789136200.707468:0:17741:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.131@tcp lock: ffff90a7d1878a00/0x559c8745c6de3d25 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1009400000000 nid: local remote: 0x559c8745c6de3d2c expref: -99 pid: 18488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789136200.707474:0:17741:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1789136200.707477:0:17741:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:2.0:1789136200.707480:0:17741:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:2.0:1789136200.707945:0:17742:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789136200.708063:0:21540:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1789136200.708075:0:21540:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.131@tcp lock: ffff90a7ff5f4400/0x559c8745c6de3f7f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x559c8745c6de3f86 expref: -99 pid: 17750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136200.708180:0:21540:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.131@tcp lock: ffff90a7ff5f4400/0x559c8745c6de3f7f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x559c8745c6de3f86 expref: -99 pid: 17750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136200.708187:0:21540:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.131@tcp lock: ffff90a7ff5f4400/0x559c8745c6de3f7f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x559c8745c6de3f86 expref: -99 pid: 17750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136200.708193:0:21540:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.131@tcp lock: ffff90a7ff5f4400/0x559c8745c6de3f7f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x559c8745c6de3f86 expref: -99 pid: 17750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136200.708203:0:21540:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789136200.708208:0:21540:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.131@tcp lock: ffff90a7ff5f5800/0x559c8745c6de4115 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x559c8745c6de411c expref: -99 pid: 17750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136200.708214:0:21540:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.131@tcp lock: ffff90a7ff5f5800/0x559c8745c6de4115 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x559c8745c6de411c expref: -99 pid: 17750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136200.708220:0:21540:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.131@tcp lock: ffff90a7ff5f5800/0x559c8745c6de4115 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x559c8745c6de411c expref: -99 pid: 17750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136200.708227:0:21540:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.131@tcp lock: ffff90a7ff5f5800/0x559c8745c6de4115 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x559c8745c6de411c expref: -99 pid: 17750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136200.708234:0:21540:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1789136200.708239:0:21540:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.131@tcp lock: ffff90a7d1879600/0x559c8745c6de3c76 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x559c8745c6de3c7d expref: -99 pid: 18488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136200.708244:0:21540:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.131@tcp lock: ffff90a7d1879600/0x559c8745c6de3c76 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x559c8745c6de3c7d expref: -99 pid: 18488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136200.708271:0:21540:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.131@tcp lock: ffff90a7d1879600/0x559c8745c6de3c76 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x559c8745c6de3c7d expref: -99 pid: 18488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136200.708278:0:21540:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.131@tcp lock: ffff90a7d1879600/0x559c8745c6de3c76 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x559c8745c6de3c7d expref: -99 pid: 18488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136200.708286:0:21540:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 10000000:01000000:1.0:1789136200.708289:0:21540:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0001 (0) 00000020:01000004:1.0:1789136200.708392:0:21540:0:(tgt_mount.c:2112:server_put_super()) stopping lustre-MDT0001 00000020:01000000:1.0:1789136200.708397:0:21540:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001 (flags='F') 00000020:00000080:1.0:1789136200.708402:0:21540:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1789136200.708407:0:21540:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001: forcing exports to disconnect: 2/5 00000020:00080000:1.0:1789136200.708414:0:21540:0:(genops.c:1819:print_export_data()) lustre-MDT0001: ACTIVE ffff90a6c3ba5800 lustre-MDT0001-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1789136200.708419:0:21540:0:(genops.c:1819:print_export_data()) lustre-MDT0001: ACTIVE ffff90a7c732b800 lustre-MDT0001-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1789136200.708425:0:21540:0:(genops.c:1553:class_disconnect_exports()) OBD device 14 (ffff90a7fc3a8000) has exports, disconnecting them 00000020:00080000:1.0:1789136200.708429:0:21540:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0001: disconnecting export at 0@lo (ffff90a6c3ba5800), last request at 1789136199 00000020:00000080:1.0:1789136200.708437:0:21540:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x559c8745c6de3f71 00000100:00080000:1.0:1789136200.708456:0:21540:0:(import.c:65:import_set_state_nolock()) ffff90a6c3ba4800 : changing import state from FULL to CLOSED 00000020:00080000:1.0:1789136200.708503:0:21540:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff90a6c3ba5800): rc 0 00000020:00000080:1.0:1789136200.708506:0:21540:0:(genops.c:885:class_export_put()) final put ffff90a6c3ba5800/lustre-MDT0001-lwp-OST0001_UUID 00000020:00080000:1.0:1789136200.709162:0:21540:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0001: disconnecting export at 0@lo (ffff90a7c732b800), last request at 1789136199 00000020:00000080:1.0:1789136200.709167:0:21540:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x559c8745c6de3e05 00000100:00080000:1.0:1789136200.709174:0:21540:0:(import.c:65:import_set_state_nolock()) ffff90a7ff502000 : changing import state from FULL to CLOSED 00000020:00080000:1.0:1789136200.709185:0:21540:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff90a7c732b800): rc 0 00000020:00000080:1.0:1789136200.709189:0:21540:0:(genops.c:885:class_export_put()) final put ffff90a7c732b800/lustre-MDT0001-lwp-OST0000_UUID 00010000:00010000:3.0:1789136200.709408:0:17741:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.131@tcp lock: ffff90a7d1878a00/0x559c8745c6de3d25 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x559c8745c6de3d2c expref: -99 pid: 18488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136200.709416:0:17741:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789136200.709448:0:17741:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.131@tcp lock: ffff90a7d1878a00/0x559c8745c6de3d25 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x559c8745c6de3d2c expref: -99 pid: 18488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136200.709456:0:17741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.131@tcp lock: ffff90a7d1878a00/0x559c8745c6de3d25 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x559c8745c6de3d2c expref: -99 pid: 18488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136200.709468:0:17741:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1789136200.709472:0:17741:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.131@tcp lock: ffff90a7ff5f4400/0x559c8745c6de3f7f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x559c8745c6de3f86 expref: -99 pid: 17750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136200.709478:0:17741:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a7ff5f4400 already unused, calling callback (ffffffffc13bbc20) 10000000:00010000:3.0:1789136200.709482:0:17741:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.131@tcp lock: ffff90a7ff5f4400/0x559c8745c6de3f7f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x559c8745c6de3f86 expref: -99 pid: 17750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136200.709490:0:17741:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.131@tcp lock: ffff90a7ff5f4400/0x559c8745c6de3f7f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x559c8745c6de3f86 expref: -99 pid: 17750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789136200.709496:0:17741:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.131@tcp lock: ffff90a7ff5f4400/0x559c8745c6de3f7f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x559c8745c6de3f86 expref: -99 pid: 17750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789136200.709502:0:17741:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:3.0:1789136200.709521:0:17741:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 10000000:01000000:3.0:1789136200.709524:0:17741:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00010000:00010000:3.0:1789136200.709543:0:17741:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.131@tcp lock: ffff90a7ff5f4400/0x559c8745c6de3f7f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x559c8745c6de3f86 expref: -99 pid: 17750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136200.709549:0:17741:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789136200.709565:0:17741:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.131@tcp lock: ffff90a7ff5f4400/0x559c8745c6de3f7f lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x559c8745c6de3f86 expref: -99 pid: 17750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136200.709573:0:17741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.131@tcp lock: ffff90a7ff5f4400/0x559c8745c6de3f7f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x559c8745c6de3f86 expref: -99 pid: 17750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136200.709586:0:17741:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1789136200.709589:0:17741:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.131@tcp lock: ffff90a7ff5f5800/0x559c8745c6de4115 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x559c8745c6de411c expref: -99 pid: 17750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136200.709595:0:17741:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a7ff5f5800 already unused, calling callback (ffffffffc13bbc20) 10000000:00010000:3.0:1789136200.709598:0:17741:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.131@tcp lock: ffff90a7ff5f5800/0x559c8745c6de4115 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x559c8745c6de411c expref: -99 pid: 17750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136200.709603:0:17741:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.131@tcp lock: ffff90a7ff5f5800/0x559c8745c6de4115 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x559c8745c6de411c expref: -99 pid: 17750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789136200.709609:0:17741:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.131@tcp lock: ffff90a7ff5f5800/0x559c8745c6de4115 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x559c8745c6de411c expref: -99 pid: 17750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789136200.709613:0:17741:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:3.0:1789136200.709616:0:17741:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:3.0:1789136200.709617:0:17741:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:3.0:1789136200.709631:0:17741:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.131@tcp lock: ffff90a7ff5f5800/0x559c8745c6de4115 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x559c8745c6de411c expref: -99 pid: 17750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136200.709646:0:17741:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789136200.709655:0:17741:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.131@tcp lock: ffff90a7ff5f5800/0x559c8745c6de4115 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x559c8745c6de411c expref: -99 pid: 17750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136200.709661:0:17741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.131@tcp lock: ffff90a7ff5f5800/0x559c8745c6de4115 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x559c8745c6de411c expref: -99 pid: 17750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136200.709669:0:17741:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789136200.709672:0:17741:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.131@tcp lock: ffff90a7d1879600/0x559c8745c6de3c76 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x559c8745c6de3c7d expref: -99 pid: 18488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136200.709678:0:17741:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a7d1879600 already unused, calling callback (ffffffffc13bbc20) 10000000:00010000:3.0:1789136200.709680:0:17741:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.131@tcp lock: ffff90a7d1879600/0x559c8745c6de3c76 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x559c8745c6de3c7d expref: -99 pid: 18488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136200.709687:0:17741:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.131@tcp lock: ffff90a7d1879600/0x559c8745c6de3c76 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x559c8745c6de3c7d expref: -99 pid: 18488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789136200.709692:0:17741:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.131@tcp lock: ffff90a7d1879600/0x559c8745c6de3c76 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x559c8745c6de3c7d expref: -99 pid: 18488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789136200.709697:0:17741:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:3.0:1789136200.709699:0:17741:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 10000000:01000000:3.0:1789136200.709701:0:17741:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 00010000:00010000:3.0:1789136200.709715:0:17741:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.131@tcp lock: ffff90a7d1879600/0x559c8745c6de3c76 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x559c8745c6de3c7d expref: -99 pid: 18488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136200.709721:0:17741:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789136200.709726:0:17741:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.131@tcp lock: ffff90a7d1879600/0x559c8745c6de3c76 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x559c8745c6de3c7d expref: -99 pid: 18488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136200.709741:0:17741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.131@tcp lock: ffff90a7d1879600/0x559c8745c6de3c76 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x559c8745c6de3c7d expref: -99 pid: 18488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136200.709753:0:17741:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789136200.709755:0:17741:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789136200.709757:0:17741:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789136200.709775:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7ff649e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:511c13c6-847f-45db-8965-d0deb75673dc:3640:1876044666895872:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789136200.709907:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789136200.709962:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789136200.709968:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7ff648b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:511c13c6-847f-45db-8965-d0deb75673dc:3640:1876044666895488:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789136200.709991:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789136200.710018:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7ff649680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:511c13c6-847f-45db-8965-d0deb75673dc:3638:1876044666895616:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789136200.710038:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789136200.710055:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789136200.710059:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7ff64ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:511c13c6-847f-45db-8965-d0deb75673dc:3638:1876044666895744:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789136200.710077:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789136200.710099:0:17740:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666895872 00000100:00100000:3.0:1789136200.710106:0:17740:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666895872 00000100:00100000:3.0:1789136200.710134:0:17740:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666895488 00000100:00100000:3.0:1789136200.710137:0:17740:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666895488 00000100:00100000:3.0:1789136200.710145:0:17740:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666895616 00000100:00100000:3.0:1789136200.710147:0:17740:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666895616 00000100:00100000:3.0:1789136200.710154:0:17740:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666895744 00000100:00100000:3.0:1789136200.710157:0:17740:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666895744 00000100:00100000:3.0:1789136200.710167:0:17740:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1789136200.710174:0:17740:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7ff64a940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0+-99:3640:x1876044666895872:12345-0@lo:103:ldlm_bl.0 00010000:00020000:3.0:1789136200.710180:0:17740:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1789136200 with bad export cookie 6168954323349683017 00000020:00000080:2.0:1789136200.713686:0:16093:0:(genops.c:844:class_export_destroy()) destroying export ffff90a6c3ba5800/lustre-MDT0001-lwp-OST0001_UUID for lustre-MDT0001 00000020:00000080:2.0:1789136200.713776:0:16093:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff90a6c3ba4800 for lustre-MDT0001 00010000:00010000:2.0:1789136200.714002:0:21541:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789136200.714006:0:21541:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789136200.714009:0:21541:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789136200.714047:0:17742:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.131@tcp lock: ffff90a7d1878200/0x559c8745c6de3c84 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0x559c8745c6de3c8b expref: -99 pid: 18488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136200.714060:0:17742:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a7d1878200 already unused, calling callback (ffffffffc13bbc20) 10000000:00010000:0.0:1789136200.714065:0:17742:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.131@tcp lock: ffff90a7d1878200/0x559c8745c6de3c84 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0x559c8745c6de3c8b expref: -99 pid: 18488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136200.714075:0:17742:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.131@tcp lock: ffff90a7d1878200/0x559c8745c6de3c84 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1008400000000 nid: local remote: 0x559c8745c6de3c8b expref: -99 pid: 18488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789136200.714109:0:17742:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.131@tcp lock: ffff90a7d1878200/0x559c8745c6de3c84 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1009400000000 nid: local remote: 0x559c8745c6de3c8b expref: -99 pid: 18488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789136200.714116:0:17742:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1789136200.714118:0:17742:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0001: stopping, won't requeue 10000000:01000000:0.0:1789136200.714121:0:17742:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0001 00010000:00010000:0.0:1789136200.714159:0:17742:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.131@tcp lock: ffff90a7d1878200/0x559c8745c6de3c84 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x559c8745c6de3c8b expref: -99 pid: 18488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136200.714165:0:17742:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789136200.714201:0:17742:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.131@tcp lock: ffff90a7d1878200/0x559c8745c6de3c84 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x559c8745c6de3c8b expref: -99 pid: 18488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136200.714208:0:17742:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.131@tcp lock: ffff90a7d1878200/0x559c8745c6de3c84 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x559c8745c6de3c8b expref: -99 pid: 18488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136200.714220:0:17742:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789136200.714221:0:17742:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789136200.714223:0:17742:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789136200.714425:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7fa3bf840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:511c13c6-847f-45db-8965-d0deb75673dc:3641:1876044666896000:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789136200.714504:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00000080:1.0:1789136200.714687:0:21540:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0001: cmd=400866e7 len=0 karg=ffffbb1d41ce7ae0 00000100:00080000:1.0:1789136200.714710:0:21540:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1789136200.714720:0:21540:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 0 gen 3 00000100:00100000:2.0:1789136200.715679:0:17738:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:2.0:1789136200.715702:0:17738:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_003' 00000100:00080000:1.0:1789136200.716638:0:21540:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID 00000100:00080000:1.0:1789136200.716646:0:21540:0:(import.c:65:import_set_state_nolock()) ffff90a6c44b9800 lustre-MDT0000_UUID: changing import state from DISCONN to CLOSED 00000020:00000080:0.0:1789136200.717006:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff90a7c732b800/lustre-MDT0001-lwp-OST0000_UUID for lustre-MDT0001 00000020:00000080:0.0:1789136200.717062:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff90a7ff502000 for lustre-MDT0001 00000100:00100000:0.0:1789136200.717314:0:17738:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666896000 00000100:00100000:0.0:1789136200.717324:0:17738:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666896000 00000100:00100000:1.0:1789136200.717522:0:21542:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1789136200.717530:0:21542:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7ff648f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0+-99:3640:x1876044666895488:12345-0@lo:103:ldlm_bl.0 00010000:00020000:1.0:1789136200.717537:0:21542:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1789136200 with bad export cookie 6168954323349683017 00000100:00100000:1.0:1789136200.717623:0:21542:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7ff648f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0+-99:3640:x1876044666895488:12345-0@lo:103:ldlm_bl.0 Request processed in 92us (7631us total) trans 0 rc -107/-107 00000100:00100000:1.0:1789136200.717629:0:21542:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1789136200.717649:0:21542:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1789136200.717654:0:21542:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7ff64b0c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0+-99:3638:x1876044666895616:12345-0@lo:103:ldlm_bl.0 00010000:00020000:1.0:1789136200.717658:0:21542:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1789136200 with bad export cookie 6168954323349683017 00000100:00100000:1.0:1789136200.717699:0:21542:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7ff64b0c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0+-99:3638:x1876044666895616:12345-0@lo:103:ldlm_bl.0 Request processed in 44us (7659us total) trans 0 rc -107/-107 00000100:00100000:1.0:1789136200.717706:0:21542:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1789136200.717718:0:21542:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1789136200.717722:0:21542:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7ff649a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0+-99:3638:x1876044666895744:12345-0@lo:103:ldlm_bl.0 00010000:00020000:1.0:1789136200.717726:0:21542:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1789136200 with bad export cookie 6168954323349683017 00000100:00100000:1.0:1789136200.717751:0:21542:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7ff649a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0+-99:3638:x1876044666895744:12345-0@lo:103:ldlm_bl.0 Request processed in 27us (7673us total) trans 0 rc -107/-107 00000100:00100000:1.0:1789136200.717757:0:21542:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1789136200.717766:0:21542:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1789136200.717770:0:21542:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7f6bc2850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0+-99:3641:x1876044666896000:12345-0@lo:103:ldlm_bl.0 00010000:00020000:1.0:1789136200.717774:0:21542:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1789136200 with bad export cookie 6168954323349683017 00000100:00100000:1.0:1789136200.717803:0:21542:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7f6bc2850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0+-99:3641:x1876044666896000:12345-0@lo:103:ldlm_bl.0 Request processed in 31us (3300us total) trans 0 rc -107/-107 00000100:00100000:1.0:1789136200.717833:0:21542:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00080000:1.0:1789136200.717934:0:3640:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.201.131@tcp of MGS@0@lo abruptly disconnected: reconnecting 00000100:00080000:1.0:1789136200.717938:0:3640:0:(import.c:65:import_set_state_nolock()) ffff90a7d8b29800 MGS: changing import state from FULL to DISCONN 00000100:02020000:1.0:1789136200.717942:0:3640:0:(import.c:186:ptlrpc_set_import_discon()) MGC192.168.201.131@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail 00000100:00080000:0.0:1789136200.718012:0:3638:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.201.131@tcp of MGS@0@lo abruptly disconnected: reconnecting 00000100:00080000:2.0:1789136200.718498:0:3641:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.201.131@tcp of MGS@0@lo abruptly disconnected: reconnecting 00000100:00100000:3.0:1789136200.722359:0:17740:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7ff64a940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0+-99:3640:x1876044666895872:12345-0@lo:103:ldlm_bl.0 Request processed in 12178us (12446us total) trans 0 rc -107/-107 00000100:00100000:3.0:1789136200.722374:0:17740:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00080000:3.0:1789136200.722524:0:21540:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:3.0:1789136200.722529:0:21540:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 8589934593 gen 3 00000004:00080000:3.0:1789136200.722542:0:21540:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:3.0:1789136200.722597:0:21540:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:3.0:1789136200.722617:0:21540:0:(import.c:65:import_set_state_nolock()) ffff90a6c44be000 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00080000:3.0:1789136200.722631:0:21540:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:3.0:1789136200.722633:0:21540:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 8589934593 gen 3 00000004:00080000:3.0:1789136200.722640:0:21540:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:3.0:1789136200.722701:0:21540:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:3.0:1789136200.722707:0:21540:0:(import.c:65:import_set_state_nolock()) ffff90a6c2a09000 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000020:00080000:3.0:1789136200.722741:0:21540:0:(genops.c:1558:class_disconnect_exports()) OBD device 14 (ffff90a7fc3a8000) has no exports 00000100:00100000:3.0:1789136200.722771:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7ff648f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3637:1876044666896128:0@lo:9:umount.0 00000100:00100000:3.0:1789136200.722811:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789136200.722837:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7ff64b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3637:1876044666896256:0@lo:9:umount.0 00000100:00100000:3.0:1789136200.723468:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789136200.723530:0:20655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666896128 00000100:00100000:3.0:1789136200.723537:0:20655:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666896128 00000100:00100000:3.0:1789136200.723576:0:20655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666896256 00000100:00100000:3.0:1789136200.723578:0:20655:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666896256 00000100:00100000:3.0:1789136200.723597:0:20655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1789136200.723604:0:20655:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7ff649a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3637:x1876044666896128:12345-0@lo:9:umount.0 00000020:00000080:3.0:1789136200.723630:0:20655:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x559c8745c6de3e36 00000100:00080000:3.0:1789136200.723639:0:20655:0:(import.c:65:import_set_state_nolock()) ffff90a6c2293800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1789136200.723680:0:20655:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934600 00000100:00100000:3.0:1789136200.723833:0:20655:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7ff649a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+2:3637:x1876044666896128:12345-0@lo:9:umount.0 Request processed in 215us (1008us total) trans 0 rc 0/0 00000100:00100000:3.0:1789136200.723882:0:20655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1789136200.723896:0:20655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1789136200.723903:0:20655:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7ff64a940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3637:x1876044666896256:12345-0@lo:9:umount.0 00000020:00000080:3.0:1789136200.723915:0:20655:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x559c8745c6de3fa2 00000100:00080000:3.0:1789136200.723923:0:20655:0:(import.c:65:import_set_state_nolock()) ffff90a7f6b2b000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1789136200.723946:0:20655:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934594 00000100:00100000:3.0:1789136200.724023:0:20655:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7ff64a940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+2:3637:x1876044666896256:12345-0@lo:9:umount.0 Request processed in 120us (556us total) trans 0 rc 0/0 00000100:00100000:3.0:1789136200.724030:0:20655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00080000:3.0:1789136200.724071:0:3637:0:(import.c:65:import_set_state_nolock()) ffff90a6c44be000 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:3.0:1789136200.724082:0:3637:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:3.0:1789136200.724085:0:3637:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1789136200.724089:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7ff648f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3637:1876044666896128:0@lo:9:umount.0 00000100:00080000:3.0:1789136200.724112:0:3637:0:(import.c:65:import_set_state_nolock()) ffff90a6c2a09000 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:3.0:1789136200.724120:0:3637:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:3.0:1789136200.724121:0:3637:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1789136200.724124:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7ff64b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3637:1876044666896256:0@lo:9:umount.0 00010000:00010000:3.0:1789136200.724149:0:17741:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789136200.724183:0:21541:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1789136200.745999:0:3640:0:(import.c:192:ptlrpc_set_import_discon()) import MGS@0@lo for MGC192.168.201.131@tcp not replayable, auto-deactivating 00000100:00080000:1.0:1789136200.746005:0:3640:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:1.0:1789136200.746015:0:3640:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff90a7fa34ad00 x1876044666894208/t0(0) o400->MGC192.168.201.131@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1789136215 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789136200.746030:0:3640:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff90a7ff649e00 x1876044666895872/t0(0) o103->MGC192.168.201.131@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1789136216 ref 1 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789136200.746039:0:3640:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff90a7ff648b40 x1876044666895488/t0(0) o103->MGC192.168.201.131@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1789136216 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789136200.746047:0:3640:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff90a7ff649680 x1876044666895616/t0(0) o103->MGC192.168.201.131@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1789136216 ref 1 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789136200.746054:0:3640:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff90a7ff64ad00 x1876044666895744/t0(0) o103->MGC192.168.201.131@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1789136216 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789136200.746063:0:3640:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff90a7fa3bf840 x1876044666896000/t0(0) o103->MGC192.168.201.131@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1789136216 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 10000000:01000000:1.0:1789136200.746072:0:3640:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:1.0:1789136200.746074:0:3640:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:1.0:1789136200.746076:0:3640:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:0.0:1789136200.746164:0:3638:0:(import.c:214:ptlrpc_set_import_discon()) mgc: import ffff90a7d8b29800 already not connected (conn 1, was 1): DISCONN 00000100:00100000:0.0:1789136200.746194:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7ff649680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:511c13c6-847f-45db-8965-d0deb75673dc:3638:1876044666895616:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789136200.746203:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7fa34ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:511c13c6-847f-45db-8965-d0deb75673dc:3638:1876044666894208:0@lo:400:kworker.0 00000100:00100000:0.0:1789136200.746231:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7ff64ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:511c13c6-847f-45db-8965-d0deb75673dc:3638:1876044666895744:0@lo:103:ldlm_bl.0 00000100:00080000:2.0:1789136200.748048:0:3641:0:(import.c:214:ptlrpc_set_import_discon()) mgc: import ffff90a7d8b29800 already not connected (conn 1, was 1): DISCONN 00000100:00080000:1.0:1789136200.748055:0:3640:0:(import.c:65:import_set_state_nolock()) ffff90a7d8b29800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1789136200.748066:0:3640:0:(import.c:510:import_select_connection()) MGC192.168.201.131@tcp: connect to NID 0@lo last attempt 526 00000100:00080000:1.0:1789136200.748076:0:3640:0:(import.c:624:import_select_connection()) MGC192.168.201.131@tcp: import ffff90a7d8b29800 using connection 192.168.201.131@tcp/0@lo 00000100:00100000:1.0:1789136200.748941:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7fa3bf840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:511c13c6-847f-45db-8965-d0deb75673dc:3641:1876044666896000:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789136200.749415:0:3640:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff90a7ff64b0c0 x1876044666896384/t0(0) o250->MGC192.168.201.131@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1789136200.749460:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7ff649e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:511c13c6-847f-45db-8965-d0deb75673dc:3640:1876044666895872:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789136200.749471:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7ff64b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:511c13c6-847f-45db-8965-d0deb75673dc:3637:1876044666896384:0@lo:250:ptlrpcd_00_02.0 00000100:00100000:3.0:1789136200.749480:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7ff648b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:511c13c6-847f-45db-8965-d0deb75673dc:3640:1876044666895488:0@lo:103:ldlm_bl.0 00000400:00000100:1.0:1789136200.749536:0:3637:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1876044666896384 offset 0 length 520: 4 00000020:00080000:2.0:1789136200.764587:0:21540:0:(genops.c:1558:class_disconnect_exports()) OBD device 14 (ffff90a7fc3a8000) has no exports 00000020:01000000:3.0:1789136200.910155:0:21540:0:(lprocfs_status_server.c:345:lprocfs_free_client_stats()) stat ffff90a7f64e3600 - data ffff90a6c256aaf8/ffff90a7dd6eb800 00000020:01000000:3.0:1789136200.910335:0:21540:0:(lprocfs_status_server.c:345:lprocfs_free_client_stats()) stat ffff90a6c2a1c180 - data ffff90a6c24e46c0/ffff90a7c4e0d800 00000001:00000004:0.0:1789136200.944085:0:21540:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 2, last_transno is 8589934595 00000100:00080000:3.0:1789136201.016049:0:21540:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1789136201.016058:0:21540:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 0 gen 4 00000100:00100000:3.0:1789136201.016068:0:21540:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00080000:3.0:1789136201.019013:0:21540:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:3.0:1789136201.019022:0:21540:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 8589934593 gen 4 00000004:00080000:3.0:1789136201.019046:0:21540:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1789136201.019049:0:21540:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:0.0:1789136201.020012:0:18497:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:0.0:1789136201.020018:0:18497:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 1 count 1 00000040:00080000:0.0:1789136201.020030:0:18497:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 2 count 2 00000100:00080000:3.0:1789136201.021739:0:21540:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:3.0:1789136201.021745:0:21540:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 8589934593 gen 4 00000004:00080000:3.0:1789136201.021794:0:21540:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1789136201.021797:0:21540:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:0.0:1789136201.025699:0:18499:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:0.0:1789136201.025709:0:18499:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xa:0x0] index 1 count 1 00000040:00080000:0.0:1789136201.025727:0:18499:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 2 count 2 00000020:00000080:3.0:1789136201.028470:0:21540:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x559c8745c6de3c99 00000020:00000080:3.0:1789136201.028482:0:21540:0:(genops.c:885:class_export_put()) final put ffff90a7d0670800/lustre-MDT0001-osd_UUID 00000020:00000080:3.0:1789136201.030985:0:21540:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x559c8745c6de3cae 00000020:00000080:3.0:1789136201.030999:0:21540:0:(genops.c:885:class_export_put()) final put ffff90a7d0674000/lustre-MDT0001-mdtlov_UUID 00000020:01000000:3.0:1789136201.031006:0:21540:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-mdtlov (flags='') 00000020:00000080:3.0:1789136201.031012:0:21540:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1789136201.031020:0:21540:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:3.0:1789136201.031025:0:21540:0:(genops.c:1558:class_disconnect_exports()) OBD device 13 (ffff90a7fc3a9a48) has no exports 00000004:01000000:3.0:1789136201.031218:0:21540:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:0.0:1789136201.031669:0:16093:0:(genops.c:844:class_export_destroy()) destroying export ffff90a7d0670800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:0.0:1789136201.031680:0:16093:0:(genops.c:844:class_export_destroy()) destroying export ffff90a7d0674000/lustre-MDT0001-mdtlov_UUID for lustre-MDT0001-mdtlov 00000020:00000080:3.0:1789136201.032343:0:21540:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x559c8745c6de3d02 00000020:00000080:3.0:1789136201.032352:0:21540:0:(genops.c:885:class_export_put()) final put ffff90a7ff5c2000/lustre-MDT0001-mdtlov_UUID 00000020:01000000:3.0:1789136201.032369:0:21540:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0001 (flags='') 00000020:00000080:3.0:1789136201.032376:0:21540:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1789136201.032383:0:21540:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osc-MDT0001: forcing exports to disconnect: 0/3 00000020:00080000:3.0:1789136201.032386:0:21540:0:(genops.c:1558:class_disconnect_exports()) OBD device 18 (ffff90a7fc3aced8) has no exports 00000020:00000080:3.0:1789136201.032394:0:21540:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x559c8745c6de3cfb 00000020:00000080:3.0:1789136201.032398:0:21540:0:(genops.c:885:class_export_put()) final put ffff90a6c2a0c000/lustre-MDT0001-osd_UUID 00000020:00000080:0.0:1789136201.032653:0:16093:0:(genops.c:844:class_export_destroy()) destroying export ffff90a7ff5c2000/lustre-MDT0001-mdtlov_UUID for lustre-OST0001-osc-MDT0001 00000020:00000080:0.0:1789136201.032661:0:16093:0:(genops.c:844:class_export_destroy()) destroying export ffff90a6c2a0c000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00010000:01000000:3.0:1789136201.032977:0:21540:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0001: client import never connected 00000100:00080000:3.0:1789136201.032983:0:21540:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:3.0:1789136201.032987:0:21540:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 8589934593 gen 5 00000004:00080000:3.0:1789136201.032992:0:21540:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1789136201.033006:0:21540:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1789136201.033156:0:21540:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1789136201.033163:0:21540:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:3.0:1789136201.033169:0:21540:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x559c8745c6de3ced 00000020:00000080:3.0:1789136201.033175:0:21540:0:(genops.c:885:class_export_put()) final put ffff90a7d0672800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:0.0:1789136201.037459:0:16093:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff90a6c2a09000 for lustre-OST0001-osc-MDT0001 00000020:00000080:0.0:1789136201.037476:0:16093:0:(genops.c:885:class_export_put()) final put ffff90a7d0671000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:0.0:1789136201.037480:0:16093:0:(genops.c:844:class_export_destroy()) destroying export ffff90a7d0671000/lustre-MDT0001-mdtlov_UUID for lustre-OST0001-osc-MDT0001 00000020:01000000:0.0:1789136201.037489:0:16093:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0001 (lustre-MDT0001-mdtlov_UUID) 00000020:01000000:3.0:1789136201.042668:0:21540:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0001 (flags='') 00000020:00000080:3.0:1789136201.042684:0:21540:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1789136201.042695:0:21540:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osc-MDT0001: forcing exports to disconnect: 0/3 00000020:00080000:3.0:1789136201.042700:0:21540:0:(genops.c:1558:class_disconnect_exports()) OBD device 17 (ffff90a7e6e9ced8) has no exports 00000020:00000080:3.0:1789136201.042710:0:21540:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x559c8745c6de3ce6 00000020:00000080:3.0:1789136201.042720:0:21540:0:(genops.c:885:class_export_put()) final put ffff90a6c44b8800/lustre-MDT0001-osd_UUID 00000020:00000080:1.0:1789136201.045254:0:16093:0:(genops.c:844:class_export_destroy()) destroying export ffff90a7d0672800/lustre-MDT0001-mdtlov_UUID for lustre-OST0000-osc-MDT0001 00010000:01000000:3.0:1789136201.046306:0:21540:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0001: client import never connected 00000100:00080000:3.0:1789136201.046313:0:21540:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:3.0:1789136201.046317:0:21540:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 8589934593 gen 5 00000004:00080000:3.0:1789136201.046324:0:21540:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1789136201.046327:0:21540:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1789136201.046364:0:21540:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1789136201.046373:0:21540:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000004:01000000:3.0:1789136201.046387:0:21540:0:(lod_lov.c:59:lod_putref()) destroying 1 ltd desc 00000020:00000080:3.0:1789136201.046394:0:21540:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x559c8745c6de3cd1 00000020:00000080:3.0:1789136201.046404:0:21540:0:(genops.c:885:class_export_put()) final put ffff90a6c2a0f000/lustre-MDT0001-mdtlov_UUID 00000020:01000000:3.0:1789136201.046410:0:21540:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osp-MDT0001 (flags='F') 00000020:00000080:3.0:1789136201.046418:0:21540:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1789136201.046422:0:21540:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-osp-MDT0001: forcing exports to disconnect: 0/3 00000020:00080000:3.0:1789136201.046425:0:21540:0:(genops.c:1558:class_disconnect_exports()) OBD device 16 (ffff90a7f64b3490) has no exports 00000020:00000080:3.0:1789136201.046431:0:21540:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x559c8745c6de3cca 00000020:00000080:3.0:1789136201.046435:0:21540:0:(genops.c:885:class_export_put()) final put ffff90a6c44be800/lustre-MDT0001-osd_UUID 00000020:00000080:1.0:1789136201.047225:0:16093:0:(genops.c:844:class_export_destroy()) destroying export ffff90a6c44b8800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:1.0:1789136201.047237:0:16093:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff90a6c44be000 for lustre-OST0000-osc-MDT0001 00000020:00000080:1.0:1789136201.047245:0:16093:0:(genops.c:885:class_export_put()) final put ffff90a6c2a0b800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:1.0:1789136201.047247:0:16093:0:(genops.c:844:class_export_destroy()) destroying export ffff90a6c2a0b800/lustre-MDT0001-mdtlov_UUID for lustre-OST0000-osc-MDT0001 00000020:01000000:1.0:1789136201.047253:0:16093:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0001 (lustre-MDT0001-mdtlov_UUID) 00000020:00000080:1.0:1789136201.047333:0:16093:0:(genops.c:844:class_export_destroy()) destroying export ffff90a6c2a0f000/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000-osp-MDT0001 00000020:00000080:1.0:1789136201.047337:0:16093:0:(genops.c:844:class_export_destroy()) destroying export ffff90a6c44be800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00010000:00010000:0.0:1789136201.067249:0:17742:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:01000000:0.0:1789136201.082933:0:21540:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0000-osp-MDT0001: client import never connected 00000100:00080000:0.0:1789136201.082942:0:21540:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1789136201.082948:0:21540:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 0 gen 5 00000100:00100000:0.0:1789136201.082956:0:21540:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1789136201.083014:0:21540:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1789136201.083024:0:21540:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osp-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:0.0:1789136201.083053:0:21540:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1789136201.083056:0:21540:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-mdtlov (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:0.0:1789136201.083062:0:21540:0:(genops.c:885:class_export_put()) final put ffff90a7ff5b4000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:0.0:1789136201.083067:0:21540:0:(genops.c:844:class_export_destroy()) destroying export ffff90a7ff5b4000/lustre-MDT0001-mdtlov_UUID for lustre-MDT0001-mdtlov 00000020:01000000:0.0:1789136201.083079:0:21540:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-mdtlov (lustre-MDT0001-mdtlov_UUID) 00000020:00000080:0.0:1789136201.083260:0:21540:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x559c8745c6de3cb5 00000020:00000080:0.0:1789136201.083278:0:21540:0:(genops.c:885:class_export_put()) final put ffff90a7d0671800/lustre-MDD0001_UUID 00000020:01000000:0.0:1789136201.083284:0:21540:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDD0001 (flags='') 00000020:00000080:0.0:1789136201.083288:0:21540:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1789136201.083292:0:21540:0:(obd_config.c:956:class_cleanup()) lustre-MDD0001: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1789136201.083295:0:21540:0:(genops.c:1558:class_disconnect_exports()) OBD device 15 (ffff90a7fc3ab490) has no exports 00000020:00000080:0.0:1789136201.083315:0:21540:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1789136201.083317:0:21540:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0001 (uuid lustre-MDD0001_UUID) 00000020:00000080:0.0:1789136201.083321:0:21540:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x559c8745c6de3cbc 00000020:00000080:0.0:1789136201.083325:0:21540:0:(genops.c:885:class_export_put()) final put ffff90a7d0673000/lustre-MDT0001-osd_UUID 00000020:01000004:0.0:1789136201.083332:0:21540:0:(tgt_mount.c:187:server_put_mount()) put mount ffff90a6c3dd6000 from lustre-MDT0001, refs=2 00000020:01000004:0.0:1789136201.083335:0:21540:0:(obd_mount.c:710:lustre_put_lsi()) put ffff90a6c3dd6000 2 00000020:01000004:0.0:1789136201.083337:0:21540:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff90a6c3dd6000 from lustre-MDT0001 00000020:00000080:0.0:1789136201.083355:0:21540:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1789136201.083357:0:21540:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001 (uuid lustre-MDT0001_UUID) 00000020:00000080:0.0:1789136201.083359:0:21540:0:(genops.c:885:class_export_put()) final put ffff90a7d0677000/lustre-MDT0001_UUID 00000020:00000080:0.0:1789136201.083361:0:21540:0:(genops.c:844:class_export_destroy()) destroying export ffff90a7d0677000/lustre-MDT0001_UUID for lustre-MDT0001 00000020:01000000:0.0:1789136201.083367:0:21540:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001 (lustre-MDT0001_UUID) 00000020:01000004:0.0:1789136201.083396:0:21540:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 2 references. 00000020:01000000:0.0:1789136201.083400:0:21540:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0001 (flags='F') 00000020:00000080:0.0:1789136201.083403:0:21540:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1789136201.083406:0:21540:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-MDT0001: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1789136201.083412:0:21540:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-MDT0001: ACTIVE ffff90a7ff5c3800 lustre-MDT0000-lwp-MDT0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1789136201.083417:0:21540:0:(genops.c:1553:class_disconnect_exports()) OBD device 19 (ffff90a7d184ced8) has exports, disconnecting them 00000020:00080000:0.0:1789136201.083421:0:21540:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0001: disconnecting export at 0@lo (ffff90a7ff5c3800), last request at 1789136094 00000020:00000080:0.0:1789136201.083425:0:21540:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x559c8745c6de3d3a 00000020:00080000:0.0:1789136201.083437:0:21540:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff90a7ff5c3800): rc 0 00000020:00000080:0.0:1789136201.083441:0:21540:0:(genops.c:885:class_export_put()) final put ffff90a7ff5c3800/lustre-MDT0000-lwp-MDT0001 00000020:00000080:1.0:1789136201.084419:0:16093:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff90a6c44b9800 for lustre-MDT0000-osp-MDT0001 00000020:00000080:1.0:1789136201.084430:0:16093:0:(genops.c:885:class_export_put()) final put ffff90a7c5d8c000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:1.0:1789136201.084433:0:16093:0:(genops.c:844:class_export_destroy()) destroying export ffff90a7c5d8c000/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000-osp-MDT0001 00000020:01000000:1.0:1789136201.084441:0:16093:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osp-MDT0001 (lustre-MDT0001-mdtlov_UUID) 00000020:00000080:1.0:1789136201.084557:0:16093:0:(genops.c:844:class_export_destroy()) destroying export ffff90a7d0671800/lustre-MDD0001_UUID for lustre-MDD0001 00000020:00000080:1.0:1789136201.084562:0:16093:0:(genops.c:885:class_export_put()) final put ffff90a7d0672000/lustre-MDD0001_UUID 00000020:00000080:1.0:1789136201.084564:0:16093:0:(genops.c:844:class_export_destroy()) destroying export ffff90a7d0672000/lustre-MDD0001_UUID for lustre-MDD0001 00000020:01000000:1.0:1789136201.084567:0:16093:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0001 (lustre-MDD0001_UUID) 00000020:00000080:1.0:1789136201.084679:0:16093:0:(genops.c:844:class_export_destroy()) destroying export ffff90a7d0673000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:1.0:1789136201.084685:0:16093:0:(genops.c:844:class_export_destroy()) destroying export ffff90a7ff5c3800/lustre-MDT0000-lwp-MDT0001 for lustre-MDT0000-lwp-MDT0001 00010000:01000000:1.0:1789136201.084712:0:21540:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0001: client import never connected 00000100:00080000:1.0:1789136201.084716:0:21540:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1789136201.084719:0:21540:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 5 00000100:00100000:1.0:1789136201.084724:0:21540:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1789136201.084741:0:16093:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff90a7d0676000 for lustre-MDT0000-lwp-MDT0001 00000020:00000080:1.0:1789136201.084950:0:21540:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1789136201.084957:0:21540:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0001 (uuid lustre-MDT0000-lwp-MDT0001_UUID) 00000020:00000080:1.0:1789136201.084968:0:21540:0:(genops.c:885:class_export_put()) final put ffff90a7ff5c6000/lustre-MDT0000-lwp-MDT0001_UUID 00000020:00000080:1.0:1789136201.084970:0:21540:0:(genops.c:844:class_export_destroy()) destroying export ffff90a7ff5c6000/lustre-MDT0000-lwp-MDT0001_UUID for lustre-MDT0000-lwp-MDT0001 00000020:01000000:1.0:1789136201.084975:0:21540:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0001 (lustre-MDT0000-lwp-MDT0001_UUID) 00000020:01000004:1.0:1789136201.085007:0:21540:0:(obd_mount.c:710:lustre_put_lsi()) put ffff90a6c3dd6000 1 00000020:00000080:1.0:1789136201.085013:0:21540:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x559c8745c6de3c61 00000020:00000080:1.0:1789136201.085017:0:21540:0:(genops.c:885:class_export_put()) final put ffff90a6c44fa000/lustre-MDT0001-osd_UUID 00000020:01000000:1.0:1789136201.085026:0:21540:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-osd (flags='') 00000020:00000080:1.0:1789136201.085033:0:16093:0:(genops.c:844:class_export_destroy()) destroying export ffff90a6c44fa000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:1.0:1789136201.085042:0:21540:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1789136201.085046:0:21540:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-osd: forcing exports to disconnect: 0/1 00000020:00080000:1.0:1789136201.085049:0:21540:0:(genops.c:1558:class_disconnect_exports()) OBD device 12 (ffff90a7efa19a48) has no exports 00000020:00000080:1.0:1789136201.177621:0:21540:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1789136201.177634:0:21540:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-osd (uuid lustre-MDT0001-osd_UUID) 00000020:00000080:1.0:1789136201.177641:0:21540:0:(genops.c:885:class_export_put()) final put ffff90a6c3dd5800/lustre-MDT0001-osd_UUID 00000020:00000080:1.0:1789136201.177646:0:21540:0:(genops.c:844:class_export_destroy()) destroying export ffff90a6c3dd5800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:01000000:1.0:1789136201.177658:0:21540:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-osd (lustre-MDT0001-osd_UUID) 00000020:01000004:1.0:1789136201.177771:0:21540:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff90a6c3dd7000 00000020:01000000:1.0:1789136201.177792:0:21540:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MDS (flags='F') 00000020:00000080:1.0:1789136201.177796:0:21540:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1789136201.177800:0:21540:0:(obd_config.c:956:class_cleanup()) MDS: forcing exports to disconnect: 0/1 00000020:00080000:1.0:1789136201.177804:0:21540:0:(genops.c:1558:class_disconnect_exports()) OBD device 3 (ffff90a6c2b91a48) has no exports 00000100:00100000:3.0:1789136201.178547:0:18920:0:(service.c:3183:ptlrpc_main()) mdt00_003: service thread [ffff90a7c4df8400:18920] 3 exiting: rc = 0 00000100:00100000:3.0:1789136201.178664:0:17754:0:(service.c:3183:ptlrpc_main()) mdt00_001: service thread [ffff90a6c22a2a00:17754] 1 exiting: rc = 0 00000100:00100000:0.0:1789136201.178789:0:17755:0:(service.c:3183:ptlrpc_main()) mdt00_002: service thread [ffff90a7ef9a5800:17755] 2 exiting: rc = 0 00000100:00100000:0.0:1789136201.178956:0:17753:0:(service.c:3183:ptlrpc_main()) mdt00_000: service thread [ffff90a6c22a3c00:17753] 0 exiting: rc = 1 00000100:00100000:1.0:1789136201.179749:0:21540:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136201.179760:0:21540:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136201.179766:0:21540:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136201.179773:0:21540:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136201.179780:0:21540:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136201.179786:0:21540:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136201.179793:0:21540:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136201.179798:0:21540:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136201.179804:0:21540:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136201.179810:0:21540:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136201.179815:0:21540:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136201.179831:0:21540:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136201.179837:0:21540:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136201.179843:0:21540:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136201.179849:0:21540:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136201.179878:0:21540:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136201.179884:0:21540:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136201.179889:0:21540:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136201.179895:0:21540:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136201.179900:0:21540:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136201.179906:0:21540:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136201.179911:0:21540:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136201.179917:0:21540:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136201.179922:0:21540:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136201.179927:0:21540:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136201.179932:0:21540:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136201.179936:0:21540:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136201.179941:0:21540:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136201.179947:0:21540:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136201.179952:0:21540:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136201.179957:0:21540:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136201.179962:0:21540:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136201.179968:0:21540:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136201.179973:0:21540:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136201.179978:0:21540:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136201.179983:0:21540:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136201.179988:0:21540:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136201.179993:0:21540:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136201.179999:0:21540:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136201.180004:0:21540:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136201.180010:0:21540:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136201.180014:0:21540:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136201.180019:0:21540:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136201.180024:0:21540:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136201.180030:0:21540:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136201.180035:0:21540:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136201.180050:0:21540:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136201.180054:0:21540:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136201.180059:0:21540:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136201.180064:0:21540:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136201.180070:0:21540:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136201.180075:0:21540:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136201.180080:0:21540:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136201.180086:0:21540:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136201.180215:0:21540:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136201.180330:0:21540:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136201.180340:0:21540:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136201.180345:0:21540:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136201.180350:0:21540:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136201.180355:0:21540:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136201.180361:0:21540:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136201.180383:0:21540:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136201.180389:0:21540:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136201.180395:0:21540:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789136201.184590:0:17756:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_000: service thread [ffff90a7de744800:17756] 0 exiting: rc = 1 00000100:00100000:0.0:1789136201.184712:0:17757:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_001: service thread [ffff90a7de745000:17757] 1 exiting: rc = 0 00000100:00100000:1.0:1789136201.185294:0:21540:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136201.185305:0:21540:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136201.185313:0:21540:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136201.185318:0:21540:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136201.185324:0:21540:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136201.185329:0:21540:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136201.185335:0:21540:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136201.185340:0:21540:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136201.185345:0:21540:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136201.185351:0:21540:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136201.185357:0:21540:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136201.185363:0:21540:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136201.185368:0:21540:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136201.185373:0:21540:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136201.185379:0:21540:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136201.185384:0:21540:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136201.185389:0:21540:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136201.185409:0:21540:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136201.185414:0:21540:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136201.185421:0:21540:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136201.185428:0:21540:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136201.185434:0:21540:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136201.185440:0:21540:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136201.185445:0:21540:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136201.185451:0:21540:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136201.185456:0:21540:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136201.185462:0:21540:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136201.185468:0:21540:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136201.185473:0:21540:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136201.185480:0:21540:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136201.185486:0:21540:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136201.185492:0:21540:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136201.185498:0:21540:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136201.185505:0:21540:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136201.185510:0:21540:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136201.185515:0:21540:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136201.185521:0:21540:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136201.185527:0:21540:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136201.185532:0:21540:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136201.185538:0:21540:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136201.185544:0:21540:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136201.185550:0:21540:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136201.185555:0:21540:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136201.185561:0:21540:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136201.185567:0:21540:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136201.185572:0:21540:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136201.185577:0:21540:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136201.185582:0:21540:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136201.185587:0:21540:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136201.185591:0:21540:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136201.185596:0:21540:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136201.185602:0:21540:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136201.185617:0:21540:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136201.185623:0:21540:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136201.185629:0:21540:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136201.185635:0:21540:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136201.185641:0:21540:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136201.185646:0:21540:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136201.185652:0:21540:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136201.185658:0:21540:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136201.185663:0:21540:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136201.185668:0:21540:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136201.185673:0:21540:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136201.185678:0:21540:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136201.186317:0:17758:0:(service.c:3183:ptlrpc_main()) mdt_out00_000: service thread [ffff90a7f644c600:17758] 0 exiting: rc = 1 00000100:00100000:3.0:1789136201.186451:0:17759:0:(service.c:3183:ptlrpc_main()) mdt_out00_001: service thread [ffff90a7f644c400:17759] 1 exiting: rc = 0 00000100:00100000:1.0:1789136201.186546:0:21540:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136201.186555:0:21540:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136201.186562:0:21540:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136201.186570:0:21540:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136201.186578:0:21540:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136201.186584:0:21540:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136201.186591:0:21540:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136201.186598:0:21540:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136201.186605:0:21540:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136201.186612:0:21540:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136201.186620:0:21540:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136201.186647:0:21540:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136201.186654:0:21540:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136201.186661:0:21540:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136201.186669:0:21540:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136201.186675:0:21540:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136201.186681:0:21540:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136201.186686:0:21540:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136201.186692:0:21540:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136201.186698:0:21540:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136201.186703:0:21540:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136201.186712:0:21540:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136201.186718:0:21540:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136201.186751:0:21540:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136201.186758:0:21540:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136201.186764:0:21540:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136201.186770:0:21540:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136201.186777:0:21540:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136201.186782:0:21540:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136201.186789:0:21540:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136201.186795:0:21540:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136201.186801:0:21540:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136201.186806:0:21540:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136201.186812:0:21540:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136201.186818:0:21540:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136201.186837:0:21540:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136201.186844:0:21540:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136201.186850:0:21540:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136201.186921:0:21540:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136201.186930:0:21540:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136201.186935:0:21540:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136201.186940:0:21540:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136201.186945:0:21540:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136201.186952:0:21540:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136201.186957:0:21540:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136201.186963:0:21540:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136201.186970:0:21540:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136201.186992:0:21540:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136201.186999:0:21540:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136201.187006:0:21540:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136201.187012:0:21540:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136201.187019:0:21540:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136201.187026:0:21540:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136201.187032:0:21540:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136201.187038:0:21540:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136201.187044:0:21540:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136201.187050:0:21540:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136201.187055:0:21540:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136201.187070:0:21540:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136201.187163:0:21540:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136201.187172:0:21540:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136201.187177:0:21540:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136201.187183:0:21540:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136201.187196:0:21540:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789136201.195401:0:17760:0:(service.c:3183:ptlrpc_main()) mdt_seqs_0000: service thread [ffff90a7d5d97a00:17760] 0 exiting: rc = 1 00000100:00100000:1.0:1789136201.195547:0:17761:0:(service.c:3183:ptlrpc_main()) mdt_seqs_0001: service thread [ffff90a7d5d96c00:17761] 1 exiting: rc = 0 00000100:00100000:0.0:1789136201.195640:0:21540:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136201.195647:0:21540:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136201.195652:0:21540:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136201.195656:0:21540:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136201.195660:0:21540:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136201.195665:0:21540:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136201.195671:0:21540:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136201.195675:0:21540:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136201.195680:0:21540:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136201.195684:0:21540:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136201.195688:0:21540:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136201.195693:0:21540:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136201.195697:0:21540:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136201.195702:0:21540:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136201.195707:0:21540:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136201.195712:0:21540:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136201.195716:0:21540:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136201.195721:0:21540:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136201.195726:0:21540:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136201.195731:0:21540:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136201.195736:0:21540:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136201.195741:0:21540:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136201.195745:0:21540:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136201.195750:0:21540:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136201.195754:0:21540:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136201.195760:0:21540:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136201.195765:0:21540:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136201.195770:0:21540:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136201.195775:0:21540:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136201.195780:0:21540:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136201.195785:0:21540:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136201.195790:0:21540:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136201.195795:0:21540:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136201.195799:0:21540:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136201.195804:0:21540:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136201.195818:0:21540:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136201.195825:0:21540:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136201.195830:0:21540:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136201.195835:0:21540:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136201.195840:0:21540:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136201.195844:0:21540:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136201.195849:0:21540:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136201.196273:0:21540:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136201.196279:0:21540:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136201.196283:0:21540:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136201.196287:0:21540:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136201.196292:0:21540:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136201.196297:0:21540:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136201.196302:0:21540:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136201.196307:0:21540:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136201.196313:0:21540:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136201.196317:0:21540:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136201.196323:0:21540:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136201.196327:0:21540:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136201.196332:0:21540:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136201.196337:0:21540:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136201.196342:0:21540:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136201.196347:0:21540:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136201.196352:0:21540:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136201.196357:0:21540:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136201.196362:0:21540:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136201.196366:0:21540:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136201.196371:0:21540:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136201.196376:0:21540:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789136201.196732:0:17763:0:(service.c:3183:ptlrpc_main()) mdt_seqm_0001: service thread [ffff90a7d5d96000:17763] 1 exiting: rc = 0 00000100:00100000:1.0:1789136201.196900:0:17762:0:(service.c:3183:ptlrpc_main()) mdt_seqm_0000: service thread [ffff90a7d5d96200:17762] 0 exiting: rc = 1 00000100:00100000:0.0:1789136201.196995:0:21540:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136201.197002:0:21540:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136201.197007:0:21540:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136201.197011:0:21540:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136201.197016:0:21540:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136201.197020:0:21540:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136201.197035:0:21540:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136201.197039:0:21540:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136201.197044:0:21540:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136201.197051:0:21540:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136201.197058:0:21540:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136201.197064:0:21540:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136201.197071:0:21540:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136201.197076:0:21540:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136201.197081:0:21540:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136201.197086:0:21540:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136201.197106:0:21540:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136201.197112:0:21540:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136201.197116:0:21540:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136201.197121:0:21540:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136201.197127:0:21540:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136201.197133:0:21540:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136201.197138:0:21540:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136201.197143:0:21540:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136201.197148:0:21540:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136201.197153:0:21540:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136201.197159:0:21540:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136201.197165:0:21540:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136201.197170:0:21540:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136201.197175:0:21540:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136201.197179:0:21540:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136201.197184:0:21540:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136201.197189:0:21540:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136201.197194:0:21540:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136201.197199:0:21540:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136201.197204:0:21540:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136201.197210:0:21540:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136201.197216:0:21540:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136201.197221:0:21540:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136201.197226:0:21540:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136201.197232:0:21540:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136201.197245:0:21540:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136201.197249:0:21540:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136201.197254:0:21540:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136201.197259:0:21540:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136201.197263:0:21540:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136201.197268:0:21540:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136201.197273:0:21540:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136201.197277:0:21540:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136201.197283:0:21540:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136201.197287:0:21540:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136201.197291:0:21540:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136201.197295:0:21540:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136201.197300:0:21540:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136201.197305:0:21540:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136201.197310:0:21540:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136201.197314:0:21540:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136201.197319:0:21540:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136201.197323:0:21540:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136201.197327:0:21540:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136201.197331:0:21540:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136201.197335:0:21540:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136201.197340:0:21540:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136201.197344:0:21540:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136201.197715:0:17764:0:(service.c:3183:ptlrpc_main()) mdt_fld_0000: service thread [ffff90a7c9589c00:17764] 0 exiting: rc = 1 00000100:00100000:3.0:1789136201.197834:0:17765:0:(service.c:3183:ptlrpc_main()) mdt_fld_0001: service thread [ffff90a7c9588c00:17765] 1 exiting: rc = 0 00000100:00100000:0.0:1789136201.197975:0:21540:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136201.197981:0:21540:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136201.197987:0:21540:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136201.197993:0:21540:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136201.197998:0:21540:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136201.198004:0:21540:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136201.198008:0:21540:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136201.198013:0:21540:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136201.198019:0:21540:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136201.198024:0:21540:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136201.198029:0:21540:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136201.198034:0:21540:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136201.198047:0:21540:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136201.198052:0:21540:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136201.198058:0:21540:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136201.198063:0:21540:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136201.198067:0:21540:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136201.198073:0:21540:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136201.198079:0:21540:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136201.198084:0:21540:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136201.198151:0:21540:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136201.198157:0:21540:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136201.198161:0:21540:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136201.198166:0:21540:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136201.198171:0:21540:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136201.198176:0:21540:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136201.198182:0:21540:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136201.198187:0:21540:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136201.198193:0:21540:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136201.198198:0:21540:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136201.198204:0:21540:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136201.198209:0:21540:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136201.198215:0:21540:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136201.198220:0:21540:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136201.198225:0:21540:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136201.198230:0:21540:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136201.198235:0:21540:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136201.198241:0:21540:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136201.198246:0:21540:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136201.198251:0:21540:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136201.198256:0:21540:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136201.198261:0:21540:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136201.198266:0:21540:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136201.198271:0:21540:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136201.198276:0:21540:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136201.198282:0:21540:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136201.198287:0:21540:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136201.198299:0:21540:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136201.198305:0:21540:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136201.198310:0:21540:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136201.198315:0:21540:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136201.198319:0:21540:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136201.198325:0:21540:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136201.198330:0:21540:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136201.198335:0:21540:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136201.198340:0:21540:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136201.198346:0:21540:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136201.198351:0:21540:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136201.198355:0:21540:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136201.198360:0:21540:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136201.198366:0:21540:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136201.198371:0:21540:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136201.198376:0:21540:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136201.198381:0:21540:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136201.199451:0:17766:0:(service.c:3183:ptlrpc_main()) mdt_io00_000: service thread [ffff90a7f6449600:17766] 0 exiting: rc = 1 00000100:00100000:3.0:1789136201.200005:0:17767:0:(service.c:3183:ptlrpc_main()) mdt_io00_001: service thread [ffff90a7f628b000:17767] 1 exiting: rc = 0 00000100:00100000:3.0:1789136201.200325:0:17768:0:(service.c:3183:ptlrpc_main()) mdt_io00_002: service thread [ffff90a7f628a000:17768] 2 exiting: rc = 0 00000100:00100000:0.0:1789136201.200459:0:21540:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136201.200468:0:21540:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136201.200474:0:21540:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136201.200479:0:21540:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136201.200485:0:21540:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136201.200490:0:21540:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136201.200495:0:21540:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136201.200501:0:21540:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136201.200506:0:21540:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136201.200512:0:21540:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136201.200518:0:21540:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136201.200524:0:21540:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136201.200530:0:21540:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136201.200538:0:21540:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136201.200543:0:21540:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136201.200549:0:21540:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136201.200556:0:21540:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136201.200570:0:21540:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136201.200604:0:21540:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136201.200610:0:21540:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136201.200616:0:21540:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136201.200622:0:21540:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136201.200627:0:21540:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136201.200633:0:21540:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136201.200638:0:21540:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136201.200644:0:21540:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136201.200650:0:21540:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136201.200656:0:21540:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136201.200662:0:21540:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136201.200668:0:21540:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136201.200673:0:21540:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136201.200679:0:21540:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136201.200684:0:21540:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136201.200691:0:21540:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136201.200696:0:21540:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136201.200702:0:21540:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136201.200707:0:21540:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136201.200713:0:21540:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136201.200718:0:21540:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136201.200724:0:21540:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136201.200729:0:21540:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136201.200735:0:21540:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136201.200755:0:21540:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136201.200762:0:21540:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136201.200768:0:21540:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136201.200773:0:21540:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136201.200778:0:21540:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136201.200783:0:21540:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136201.200788:0:21540:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136201.200794:0:21540:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136201.200800:0:21540:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136201.200805:0:21540:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136201.200811:0:21540:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136201.200825:0:21540:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136201.200831:0:21540:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136201.200836:0:21540:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136201.200843:0:21540:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136201.200849:0:21540:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136201.200889:0:21540:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136201.200895:0:21540:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136201.200900:0:21540:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136201.200905:0:21540:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136201.200910:0:21540:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136201.200923:0:21540:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:0.0:1789136201.205254:0:21540:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1789136201.205269:0:21540:0:(obd_config.c:883:class_detach()) detach on obd MDS (uuid MDS_uuid) 00000020:00000080:0.0:1789136201.205275:0:21540:0:(genops.c:885:class_export_put()) final put ffff90a7d8b2b000/MDS_uuid 00000020:00000080:0.0:1789136201.205279:0:21540:0:(genops.c:844:class_export_destroy()) destroying export ffff90a7d8b2b000/MDS_uuid for MDS 00000020:01000000:0.0:1789136201.205285:0:21540:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MDS (MDS_uuid) 00000020:02000400:0.0:1789136201.205420:0:21540:0:(tgt_mount.c:2181:server_put_super()) server umount lustre-MDT0001 complete 00010000:00010000:2.0:1789136202.092352:0:17741:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789136203.112349:0:21541:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789136204.138391:0:17742:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1789136204.653317:0:16093:0:(pinger.c:229:ptlrpc_pinger_process_import()) 511c13c6-847f-45db-8965-d0deb75673dc->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1789136204.653327:0:16093:0:(pinger.c:247:ptlrpc_pinger_process_import()) 511c13c6-847f-45db-8965-d0deb75673dc->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1789136204.653330:0:16093:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1789136204.653333:0:16093:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1789136204.653337:0:16093:0:(import.c:65:import_set_state_nolock()) ffff90a7ff596800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1789136204.653346:0:16093:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 647 00000100:00080000:3.0:1789136204.653352:0:16093:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 15s 00000100:00080000:3.0:1789136204.653359:0:16093:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff90a7ff596800 using connection 192.168.201.131@tcp/0@lo 00000100:00100000:3.0:1789136204.653401:0:16093:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff90a7ff648f00 x1876044666896512/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1789136204.653452:0:16093:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1789136204.653456:0:16093:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1789136204.653457:0:16093:0:(import.c:65:import_set_state_nolock()) ffff90a6c47ca800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1789136204.653461:0:16093:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 647 00000100:00080000:3.0:1789136204.653464:0:16093:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 15s 00000100:00080000:3.0:1789136204.653467:0:16093:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff90a6c47ca800 using connection 192.168.201.131@tcp/0@lo 00000100:00100000:3.0:1789136204.653479:0:16093:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff90a7ff648b40 x1876044666896768/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1789136204.653525:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7ff648780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3638:1876044666896640:0@lo:400:kworker.0 00000400:00000100:3.0:1789136204.653580:0:3638:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1876044666896640 offset 0 length 224: 4 00000100:00100000:1.0:1789136204.653617:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7ff648f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3637:1876044666896512:0@lo:38:kworker.0 00000100:00100000:3.0:1789136204.653629:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789136204.653635:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7ff64a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3638:1876044666896896:0@lo:400:kworker.0 00000400:00000100:1.0:1789136204.653642:0:3637:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1876044666896512 offset 0 length 520: 4 00000400:00000100:3.0:1789136204.653650:0:3638:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1876044666896896 offset 0 length 224: 4 00000100:00100000:1.0:1789136204.653655:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7ff648b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3637:1876044666896768:0@lo:38:kworker.0 00000400:00000100:1.0:1789136204.653670:0:3637:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1876044666896768 offset 0 length 520: 4 00010000:00010000:2.0:1789136205.160027:0:17741:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1789136205.673518:0:16093:0:(pinger.c:229:ptlrpc_pinger_process_import()) 511c13c6-847f-45db-8965-d0deb75673dc->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1789136205.673528:0:16093:0:(pinger.c:247:ptlrpc_pinger_process_import()) 511c13c6-847f-45db-8965-d0deb75673dc->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1789136205.673530:0:16093:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1789136205.673542:0:16093:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1789136205.673583:0:16093:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1789136205.673586:0:16093:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1789136205.673610:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7c14b61c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3640:1876044666897024:0@lo:400:kworker.0 00000400:00000100:2.0:1789136205.673669:0:3640:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1876044666897024 offset 0 length 224: 4 00000100:00100000:2.0:1789136205.673723:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789136205.673729:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7c14b43c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3640:1876044666897152:0@lo:400:kworker.0 00000400:00000100:2.0:1789136205.673752:0:3640:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1876044666897152 offset 0 length 224: 4 00000020:01000004:0.0:1789136205.744787:0:21743:0:(tgt_mount.c:2192:server_umount_begin()) umount -f 00000020:01000004:0.0:1789136205.771108:0:21743:0:(tgt_mount.c:2062:server_put_super()) server put_super lustre-OST0000 00010000:00010000:0.0:1789136205.771166:0:21743:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.131@tcp lock: ffff90a6c2d3fc00/0x559c8745c6de3dd4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x559c8745c6de3ddb expref: -99 pid: 19260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136205.771182:0:21743:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.131@tcp lock: ffff90a6c2d3fc00/0x559c8745c6de3dd4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x559c8745c6de3ddb expref: -99 pid: 19260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136205.771190:0:21743:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.131@tcp lock: ffff90a6c2d3fc00/0x559c8745c6de3dd4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0x559c8745c6de3ddb expref: -99 pid: 19260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136205.771197:0:21743:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.131@tcp lock: ffff90a6c2d3fc00/0x559c8745c6de3dd4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0x559c8745c6de3ddb expref: -99 pid: 19260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136205.771226:0:21743:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:0.0:1789136205.771232:0:21743:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:0.0:1789136205.771275:0:21743:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1789136205.771287:0:21743:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff90a7ff648f00 x1876044666896512/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 1789136229 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789136205.771313:0:21743:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 3 00000100:00080000:0.0:1789136205.771319:0:21743:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00080000:0.0:1789136205.771326:0:21743:0:(import.c:65:import_set_state_nolock()) ffff90a7ff596800 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00080000:0.0:1789136205.771330:0:21743:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1789136205.771334:0:21743:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff90a7ff648f00 x1876044666896512/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 1789136229 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789136205.771342:0:21743:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 4 00000100:00100000:0.0:1789136205.771345:0:21743:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 32s for inflight to error out 00000100:00100000:1.0:1789136205.771428:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7ff648f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3637:1876044666896512:0@lo:38:kworker.0 00010000:00010000:2.0:1789136205.771518:0:21541:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789136205.771526:0:21541:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.131@tcp lock: ffff90a6c2d3fc00/0x559c8745c6de3dd4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0x559c8745c6de3ddb expref: -99 pid: 19260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136205.771545:0:21541:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a6c2d3fc00 already unused, calling callback (ffffffffc13bbc20) 10000000:00010000:2.0:1789136205.771549:0:21541:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.131@tcp lock: ffff90a6c2d3fc00/0x559c8745c6de3dd4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0x559c8745c6de3ddb expref: -99 pid: 19260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136205.771568:0:21541:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.131@tcp lock: ffff90a6c2d3fc00/0x559c8745c6de3dd4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1008400000000 nid: local remote: 0x559c8745c6de3ddb expref: -99 pid: 19260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789136205.771576:0:21541:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.131@tcp lock: ffff90a6c2d3fc00/0x559c8745c6de3dd4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1009400000000 nid: local remote: 0x559c8745c6de3ddb expref: -99 pid: 19260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789136205.771582:0:21541:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1789136205.771584:0:21541:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:2.0:1789136205.771586:0:21541:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:2.0:1789136205.771600:0:21541:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff90a7d8b29800 00010000:00010000:2.0:1789136205.771603:0:21541:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.131@tcp lock: ffff90a6c2d3fc00/0x559c8745c6de3dd4 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000000 nid: local remote: 0x559c8745c6de3ddb expref: -99 pid: 19260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136205.771609:0:21541:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.131@tcp lock: ffff90a6c2d3fc00/0x559c8745c6de3dd4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000000 nid: local remote: 0x559c8745c6de3ddb expref: -99 pid: 19260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136205.771619:0:21541:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789136205.771621:0:21541:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789136205.771623:0:21541:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1789136205.773324:0:21743:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:0.0:1789136205.773340:0:21743:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff90a7ff648780 x1876044666896640/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789136220 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789136205.773370:0:21743:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff90a7c14b61c0 x1876044666897024/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789136221 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789136205.773477:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7ff648780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3638:1876044666896640:0@lo:400:kworker.0 00000100:00100000:0.0:1789136205.773496:0:21743:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 3 00000100:00080000:0.0:1789136205.773501:0:21743:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID 00000100:00100000:2.0:1789136205.776926:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7c14b61c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3640:1876044666897024:0@lo:400:kworker.0 00000100:00080000:1.0:1789136205.777467:0:21743:0:(import.c:65:import_set_state_nolock()) ffff90a7e7618800 lustre-MDT0001_UUID: changing import state from FULL to CONNECTING 00000100:00100000:2.0:1789136205.777519:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7f662da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3637:1876044666897280:0@lo:39:umount.0 00000400:00000100:2.0:1789136205.777572:0:3637:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1876044666897280 offset 0 length 224: 4 00010000:00010000:1.0:1789136206.184042:0:17742:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1789136206.697719:0:19261:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000020:00000080:3.0:1789136206.697728:0:19261:0:(genops.c:885:class_export_put()) final put ffff90a6c2291000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:2.0:1789136206.697810:0:487:0:(genops.c:844:class_export_destroy()) destroying export ffff90a6c2291000/lustre-MDT0001-mdtlov_UUID for lustre-OST0000 00000020:00000080:2.0:1789136206.697883:0:487:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff90a6c2293800 for lustre-OST0000 00000001:00100000:0.0:1789136206.702641:0:20083:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000020:00000080:0.0:1789136206.702650:0:20083:0:(genops.c:885:class_export_put()) final put ffff90a7f6b2a000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:3.0:1789136206.702734:0:16093:0:(genops.c:844:class_export_destroy()) destroying export ffff90a7f6b2a000/lustre-MDT0001-mdtlov_UUID for lustre-OST0001 00000020:00000080:3.0:1789136206.702795:0:16093:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff90a7f6b2b000 for lustre-OST0001 00010000:00010000:2.0:1789136207.208927:0:17741:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789136208.232190:0:21541:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789136209.256089:0:17742:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1789136209.705759:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) 511c13c6-847f-45db-8965-d0deb75673dc->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1789136209.705770:0:487:0:(pinger.c:247:ptlrpc_pinger_process_import()) 511c13c6-847f-45db-8965-d0deb75673dc->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1789136209.705793:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1789136209.705797:0:487:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1789136209.705953:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7c14b61c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3638:1876044666897408:0@lo:400:kworker.0 00000400:00000100:3.0:1789136209.706010:0:3638:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1876044666897408 offset 0 length 224: 4 00010000:00010000:2.0:1789136210.280120:0:17741:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789136210.920580:0:3637:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789136200/real 1789136200] req@ffff90a7ff64b0c0 x1876044666896384/t0(0) o250->MGC192.168.201.131@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1789136210 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'ptlrpcd_00_02.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789136210.920615:0:3637:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff90a7ff64b0c0 x1876044666896384/t0(0) o250->MGC192.168.201.131@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1789136210 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'ptlrpcd_00_02.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1789136210.920636:0:3637:0:(import.c:65:import_set_state_nolock()) ffff90a7d8b29800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1789136210.920646:0:3637:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-110) 00000100:00100000:2.0:1789136210.920649:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7ff64b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:511c13c6-847f-45db-8965-d0deb75673dc:3637:1876044666896384:0@lo:250:ptlrpcd_00_02.0 00000100:00080000:0.0:1789136210.920820:0:16093:0:(pinger.c:229:ptlrpc_pinger_process_import()) 511c13c6-847f-45db-8965-d0deb75673dc->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1789136210.920825:0:16093:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:0.0:1789136210.920829:0:16093:0:(import.c:65:import_set_state_nolock()) ffff90a7d8b29800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1789136210.920834:0:16093:0:(import.c:510:import_select_connection()) MGC192.168.201.131@tcp: connect to NID 0@lo last attempt 648 00000100:00080000:0.0:1789136210.920838:0:16093:0:(import.c:589:import_select_connection()) MGC192.168.201.131@tcp: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1789136210.920845:0:16093:0:(import.c:624:import_select_connection()) MGC192.168.201.131@tcp: import ffff90a7d8b29800 using connection 192.168.201.131@tcp/0@lo 00000100:00100000:0.0:1789136210.920901:0:16093:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff90a7fa3be580 x1876044666897536/t0(0) o250->MGC192.168.201.131@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1789136210.920932:0:16093:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1789136210.920937:0:16093:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1789136210.921120:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7fa3be580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:511c13c6-847f-45db-8965-d0deb75673dc:3637:1876044666897536:0@lo:250:kworker.0 00000100:00100000:3.0:1789136210.921146:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7fa3bda40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3639:1876044666897664:0@lo:400:kworker.0 00000400:00000100:2.0:1789136210.921170:0:3637:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1876044666897536 offset 0 length 520: 4 00000400:00000100:3.0:1789136210.921175:0:3639:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1876044666897664 offset 0 length 224: 4 00010000:00010000:3.0:1789136211.304212:0:21541:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789136212.328395:0:17742:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789136213.353427:0:17741:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789136214.376640:0:21541:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789136215.016034:0:3637:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789136205/real 1789136205] req@ffff90a7f662da40 x1876044666897280/t0(0) o39->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1789136215 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789136215.016068:0:3637:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff90a7f662da40 x1876044666897280/t0(0) o39->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1789136215 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1789136215.016088:0:3637:0:(import.c:65:import_set_state_nolock()) ffff90a7e7618800 lustre-MDT0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:2.0:1789136215.016111:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7f662da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3637:1876044666897280:0@lo:39:umount.0 00000100:00080000:1.0:1789136215.016272:0:21743:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:1.0:1789136215.016277:0:21743:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 4 00000100:00100000:1.0:1789136215.016282:0:21743:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:1.0:1789136215.017251:0:21743:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.131@tcp lock: ffff90a7ff5f4000/0x559c8745c6de3daa lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x559c8745c6de3db1 expref: -99 pid: 19260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136215.017263:0:21743:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.131@tcp lock: ffff90a7ff5f4000/0x559c8745c6de3daa lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x559c8745c6de3db1 expref: -99 pid: 19260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136215.017283:0:21743:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.131@tcp lock: ffff90a7ff5f4000/0x559c8745c6de3daa lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x559c8745c6de3db1 expref: -99 pid: 19260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136215.017287:0:21743:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.131@tcp lock: ffff90a7ff5f4000/0x559c8745c6de3daa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x559c8745c6de3db1 expref: -99 pid: 19260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136215.017302:0:21743:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789136215.017307:0:21743:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.131@tcp lock: ffff90a7c167c000/0x559c8745c6de4107 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x559c8745c6de410e expref: -99 pid: 17750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136215.017311:0:21743:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.131@tcp lock: ffff90a7c167c000/0x559c8745c6de4107 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x559c8745c6de410e expref: -99 pid: 17750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136215.017314:0:21743:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.131@tcp lock: ffff90a7c167c000/0x559c8745c6de4107 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x559c8745c6de410e expref: -99 pid: 17750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136215.017318:0:21743:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.131@tcp lock: ffff90a7c167c000/0x559c8745c6de4107 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x559c8745c6de410e expref: -99 pid: 17750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136215.017330:0:21743:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:01000000:1.0:1789136215.017333:0:21743:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0000 (0) 00000020:01000004:1.0:1789136215.017358:0:21743:0:(tgt_mount.c:2112:server_put_super()) stopping lustre-OST0000 00000020:01000000:1.0:1789136215.017363:0:21743:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000 (flags='F') 00000020:00000080:1.0:1789136215.017367:0:21743:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1789136215.017372:0:21743:0:(obd_config.c:956:class_cleanup()) lustre-OST0000: forcing exports to disconnect: 0/1 00000020:00080000:1.0:1789136215.017377:0:21743:0:(genops.c:1558:class_disconnect_exports()) OBD device 22 (ffff90a7d1849a48) has no exports 00010000:00010000:3.0:1789136215.017440:0:17741:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1789136215.017448:0:17741:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.131@tcp lock: ffff90a7ff5f4000/0x559c8745c6de3daa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x559c8745c6de3db1 expref: -99 pid: 19260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136215.017455:0:17741:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a7ff5f4000 already unused, calling callback (ffffffffc13bbc20) 10000000:00010000:3.0:1789136215.017458:0:17741:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.131@tcp lock: ffff90a7ff5f4000/0x559c8745c6de3daa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x559c8745c6de3db1 expref: -99 pid: 19260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136215.017466:0:17741:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.131@tcp lock: ffff90a7ff5f4000/0x559c8745c6de3daa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0x559c8745c6de3db1 expref: -99 pid: 19260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789136215.017471:0:17741:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.131@tcp lock: ffff90a7ff5f4000/0x559c8745c6de3daa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0x559c8745c6de3db1 expref: -99 pid: 19260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:1.0:1789136215.017483:0:21743:0:(genops.c:1558:class_disconnect_exports()) OBD device 22 (ffff90a7d1849a48) has no exports 10000000:01000000:3.0:1789136215.017487:0:17741:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1789136215.017489:0:17741:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0000: stopping, won't requeue 10000000:01000000:3.0:1789136215.017491:0:17741:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0000 00010000:00010000:3.0:1789136215.017504:0:17741:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff90a7d8b29800 00010000:00010000:3.0:1789136215.017508:0:17741:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.131@tcp lock: ffff90a7ff5f4000/0x559c8745c6de3daa lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000000 nid: local remote: 0x559c8745c6de3db1 expref: -99 pid: 19260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136215.017770:0:17741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.131@tcp lock: ffff90a7ff5f4000/0x559c8745c6de3daa lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000000 nid: local remote: 0x559c8745c6de3db1 expref: -99 pid: 19260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136215.017793:0:17741:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789136215.017796:0:17741:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.131@tcp lock: ffff90a7c167c000/0x559c8745c6de4107 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x559c8745c6de410e expref: -99 pid: 17750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136215.017802:0:17741:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a7c167c000 already unused, calling callback (ffffffffc13bbc20) 10000000:00010000:3.0:1789136215.018012:0:17741:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.131@tcp lock: ffff90a7c167c000/0x559c8745c6de4107 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x559c8745c6de410e expref: -99 pid: 17750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136215.018020:0:17741:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.131@tcp lock: ffff90a7c167c000/0x559c8745c6de4107 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x559c8745c6de410e expref: -99 pid: 17750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789136215.018027:0:17741:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.131@tcp lock: ffff90a7c167c000/0x559c8745c6de4107 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x559c8745c6de410e expref: -99 pid: 17750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789136215.018032:0:17741:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:3.0:1789136215.018106:0:17741:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:3.0:1789136215.018108:0:17741:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:3.0:1789136215.018115:0:17741:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff90a7d8b29800 00010000:00010000:3.0:1789136215.018118:0:17741:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.131@tcp lock: ffff90a7c167c000/0x559c8745c6de4107 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x559c8745c6de410e expref: -99 pid: 17750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136215.018133:0:17741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.131@tcp lock: ffff90a7c167c000/0x559c8745c6de4107 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x559c8745c6de410e expref: -99 pid: 17750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136215.018144:0:17741:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789136215.018145:0:17741:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789136215.018147:0:17741:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789136215.019686:0:17742:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:1.0:1789136215.025367:0:21743:0:(lprocfs_status_server.c:345:lprocfs_free_client_stats()) stat ffff90a6c2cce1e0 - data ffff90a7cee81510/ffff90a7c515e400 00000020:01000000:1.0:1789136215.025527:0:21743:0:(lprocfs_status_server.c:345:lprocfs_free_client_stats()) stat ffff90a7d28ddf60 - data ffff90a7d2237ca8/ffff90a7c4fff400 00100000:10000000:1.0:1789136215.052814:0:21743:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0000-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:0.0:1789136215.093988:0:21743:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x559c8745c6de3dbf 00000020:00000080:0.0:1789136215.094004:0:21743:0:(genops.c:885:class_export_put()) final put ffff90a7d606a800/lustre-OST0000-osd_UUID 00000020:01000004:0.0:1789136215.094029:0:21743:0:(tgt_mount.c:187:server_put_mount()) put mount ffff90a6c44ff800 from lustre-OST0000, refs=2 00000020:01000004:0.0:1789136215.094033:0:21743:0:(obd_mount.c:710:lustre_put_lsi()) put ffff90a6c44ff800 2 00000020:01000004:0.0:1789136215.094036:0:21743:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff90a6c44ff800 from lustre-OST0000 00000020:00000080:0.0:1789136215.094062:0:21743:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1789136215.094073:0:21743:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:00000080:0.0:1789136215.094076:0:21743:0:(genops.c:885:class_export_put()) final put ffff90a7d0675800/lustre-OST0000_UUID 00000020:00000080:0.0:1789136215.094079:0:21743:0:(genops.c:844:class_export_destroy()) destroying export ffff90a7d0675800/lustre-OST0000_UUID for lustre-OST0000 00000020:01000000:0.0:1789136215.094085:0:21743:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000 (lustre-OST0000_UUID) 00000020:01000004:0.0:1789136215.094147:0:21743:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 1 references. 00000020:01000000:0.0:1789136215.094152:0:21743:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0000 (flags='F') 00000020:00000080:0.0:1789136215.094157:0:21743:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1789136215.094162:0:21743:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-OST0000: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1789136215.094169:0:21743:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-OST0000: ACTIVE ffff90a7ff596000 lustre-MDT0000-lwp-OST0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1789136215.094175:0:21743:0:(genops.c:1553:class_disconnect_exports()) OBD device 23 (ffff90a7e6e9b490) has exports, disconnecting them 00000020:00080000:0.0:1789136215.094180:0:21743:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0000: disconnecting export at 0@lo (ffff90a7ff596000), last request at 1789136112 00000020:00000080:0.0:1789136215.094184:0:21743:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x559c8745c6de3de9 00000020:00080000:0.0:1789136215.094192:0:21743:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff90a7ff596000): rc 0 00000020:00000080:0.0:1789136215.094197:0:21743:0:(genops.c:885:class_export_put()) final put ffff90a7ff596000/lustre-MDT0000-lwp-OST0000 00000020:00000080:3.0:1789136215.094968:0:487:0:(genops.c:844:class_export_destroy()) destroying export ffff90a7d606a800/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:3.0:1789136215.094982:0:487:0:(genops.c:844:class_export_destroy()) destroying export ffff90a7ff596000/lustre-MDT0000-lwp-OST0000 for lustre-MDT0000-lwp-OST0000 00010000:01000000:2.0:1789136215.097304:0:21743:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0000: client import never connected 00000100:00080000:2.0:1789136215.097316:0:21743:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1789136215.097321:0:21743:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 5 00000100:00100000:2.0:1789136215.097349:0:21743:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1789136215.097563:0:21743:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1789136215.097571:0:21743:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000020:01000000:2.0:1789136215.097578:0:21743:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-lwp-OST0000 (flags='F') 00000020:00000080:2.0:1789136215.097583:0:21743:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1789136215.097587:0:21743:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-lwp-OST0000: forcing exports to disconnect: 1/3 00000020:00080000:2.0:1789136215.097594:0:21743:0:(genops.c:1819:print_export_data()) lustre-MDT0001-lwp-OST0000: ACTIVE ffff90a7e1c31800 lustre-MDT0001-lwp-OST0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1789136215.097609:0:21743:0:(genops.c:1553:class_disconnect_exports()) OBD device 24 (ffff90a7e6e99a48) has exports, disconnecting them 00000020:00080000:2.0:1789136215.097614:0:21743:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0001-lwp-OST0000: disconnecting export at 0@lo (ffff90a7e1c31800), last request at 1789136112 00000020:00000080:2.0:1789136215.097618:0:21743:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x559c8745c6de3dfe 00000020:00080000:2.0:1789136215.097642:0:21743:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff90a7e1c31800): rc 0 00000020:00000080:2.0:1789136215.097647:0:21743:0:(genops.c:885:class_export_put()) final put ffff90a7e1c31800/lustre-MDT0001-lwp-OST0000 00000020:00000080:3.0:1789136215.097660:0:487:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff90a7ff596800 for lustre-MDT0000-lwp-OST0000 00000020:00000080:3.0:1789136215.097669:0:487:0:(genops.c:885:class_export_put()) final put ffff90a7d28f9800/lustre-MDT0000-lwp-OST0000_UUID 00000020:00000080:3.0:1789136215.097672:0:487:0:(genops.c:844:class_export_destroy()) destroying export ffff90a7d28f9800/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000-lwp-OST0000 00000020:01000000:3.0:1789136215.097678:0:487:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0000 (lustre-MDT0000-lwp-OST0000_UUID) 00000020:00000080:3.0:1789136215.097737:0:487:0:(genops.c:844:class_export_destroy()) destroying export ffff90a7e1c31800/lustre-MDT0001-lwp-OST0000 for lustre-MDT0001-lwp-OST0000 00010000:01000000:2.0:1789136215.100918:0:21743:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0001-lwp-OST0000: client import never connected 00000100:00080000:2.0:1789136215.100936:0:21743:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:2.0:1789136215.100941:0:21743:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 5 00000100:00100000:2.0:1789136215.100948:0:21743:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1789136215.101413:0:21743:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1789136215.101423:0:21743:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-lwp-OST0000 (uuid lustre-MDT0001-lwp-OST0000_UUID) 00000020:01000004:2.0:1789136215.101431:0:21743:0:(obd_mount.c:710:lustre_put_lsi()) put ffff90a6c44ff800 1 00000020:00000080:2.0:1789136215.101439:0:21743:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x559c8745c6de3d9c 00000020:00000080:2.0:1789136215.101447:0:21743:0:(genops.c:885:class_export_put()) final put ffff90a7f0961800/lustre-OST0000-osd_UUID 00000020:01000000:2.0:1789136215.101454:0:21743:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osd (flags='') 00000020:00000080:2.0:1789136215.101461:0:21743:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1789136215.101465:0:21743:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osd: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1789136215.101468:0:21743:0:(genops.c:1558:class_disconnect_exports()) OBD device 20 (ffff90a7d1848000) has no exports 00000020:00000080:2.0:1789136215.154995:0:487:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff90a7e7618800 for lustre-MDT0001-lwp-OST0000 00000020:00000080:2.0:1789136215.155014:0:487:0:(genops.c:885:class_export_put()) final put ffff90a7ff592000/lustre-MDT0001-lwp-OST0000_UUID 00000020:00000080:2.0:1789136215.155018:0:487:0:(genops.c:844:class_export_destroy()) destroying export ffff90a7ff592000/lustre-MDT0001-lwp-OST0000_UUID for lustre-MDT0001-lwp-OST0000 00000020:01000000:2.0:1789136215.155030:0:487:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-lwp-OST0000 (lustre-MDT0001-lwp-OST0000_UUID) 00000020:00000080:2.0:1789136215.155313:0:487:0:(genops.c:844:class_export_destroy()) destroying export ffff90a7f0961800/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:2.0:1789136215.298056:0:21743:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1789136215.298072:0:21743:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00000020:00000080:2.0:1789136215.298080:0:21743:0:(genops.c:885:class_export_put()) final put ffff90a7c2b68000/lustre-OST0000-osd_UUID 00000020:00000080:2.0:1789136215.298086:0:21743:0:(genops.c:844:class_export_destroy()) destroying export ffff90a7c2b68000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:01000000:2.0:1789136215.298102:0:21743:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osd (lustre-OST0000-osd_UUID) 00000020:01000004:2.0:1789136215.298403:0:21743:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff90a7d893b800 00000020:02000400:2.0:1789136215.298450:0:21743:0:(tgt_mount.c:2181:server_put_super()) server umount lustre-OST0000 complete 00010000:00010000:2.0:1789136215.404482:0:21541:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1789136216.424486:0:16093:0:(pinger.c:229:ptlrpc_pinger_process_import()) 511c13c6-847f-45db-8965-d0deb75673dc->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1789136216.424494:0:16093:0:(pinger.c:247:ptlrpc_pinger_process_import()) 511c13c6-847f-45db-8965-d0deb75673dc->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1789136216.424497:0:16093:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1789136216.424500:0:16093:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00010000:00010000:1.0:1789136216.424592:0:17741:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789136216.424663:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7f662c3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3640:1876044666897792:0@lo:400:kworker.0 00000400:00000100:2.0:1789136216.424717:0:3640:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1876044666897792 offset 0 length 224: 4 00010000:00010000:0.0:1789136217.448092:0:17742:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789136218.473028:0:21541:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789136219.496962:0:17741:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00000400:3.0:1789136220.008013:0:3638:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789136204/real 1789136204] req@ffff90a7ff64a1c0 x1876044666896896/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1789136220 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789136220.052506:0:3638:0:(client.c:2547:ptlrpc_expire_one_request()) @@@ TIMEOUT-NORESEND: req@ffff90a7ff64a1c0 x1876044666896896/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1789136220 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1789136220.052578:0:3638:0:(import.c:65:import_set_state_nolock()) ffff90a6c47cd800 lustre-MDT0001_UUID: changing import state from FULL to DISCONN 00000100:02000400:3.0:1789136220.052583:0:3638:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0001-lwp-OST0001: Connection to lustre-MDT0001 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:3.0:1789136220.065366:0:3638:0:(import.c:418:ptlrpc_pinger_force()) lustre-MDT0001_UUID: waking up pinger s:DISCONN 00000100:00080000:0.0:1789136220.068046:0:16093:0:(pinger.c:229:ptlrpc_pinger_process_import()) 511c13c6-847f-45db-8965-d0deb75673dc->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1789136220.068056:0:16093:0:(pinger.c:247:ptlrpc_pinger_process_import()) 511c13c6-847f-45db-8965-d0deb75673dc->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1789136220.068060:0:16093:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1789136220.068081:0:16093:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1789136220.068084:0:16093:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1789136220.068088:0:16093:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:0.0:1789136220.068092:0:16093:0:(import.c:65:import_set_state_nolock()) ffff90a6c47cd800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1789136220.068100:0:16093:0:(import.c:510:import_select_connection()) lustre-MDT0001-lwp-OST0001: connect to NID 0@lo last attempt 580 00000100:00080000:0.0:1789136220.068110:0:16093:0:(import.c:624:import_select_connection()) lustre-MDT0001-lwp-OST0001: import ffff90a6c47cd800 using connection 192.168.201.131@tcp/0@lo 00000100:00100000:0.0:1789136220.068148:0:16093:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff90a7fa3bfc00 x1876044666897920/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1789136220.068332:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7fa3bfc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3637:1876044666897920:0@lo:38:kworker.0 00000400:00000100:3.0:1789136220.068396:0:3637:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1876044666897920 offset 0 length 520: 4 00000100:00100000:3.0:1789136220.068484:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7ff64a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3638:1876044666896896:0@lo:400:kworker.0 00000020:01000004:1.0:1789136220.199412:0:21945:0:(tgt_mount.c:2192:server_umount_begin()) umount -f 00000020:01000004:1.0:1789136220.220535:0:21945:0:(tgt_mount.c:2062:server_put_super()) server put_super lustre-OST0001 00010000:00010000:1.0:1789136220.220631:0:21945:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.131@tcp lock: ffff90a6c2d3f400/0x559c8745c6de3f40 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x559c8745c6de3f47 expref: -99 pid: 20082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136220.220646:0:21945:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.131@tcp lock: ffff90a6c2d3f400/0x559c8745c6de3f40 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x559c8745c6de3f47 expref: -99 pid: 20082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136220.220653:0:21945:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.131@tcp lock: ffff90a6c2d3f400/0x559c8745c6de3f40 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x559c8745c6de3f47 expref: -99 pid: 20082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136220.220660:0:21945:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.131@tcp lock: ffff90a6c2d3f400/0x559c8745c6de3f40 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x559c8745c6de3f47 expref: -99 pid: 20082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136220.220688:0:21945:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:1.0:1789136220.220694:0:21945:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:1.0:1789136220.220722:0:21945:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1789136220.220734:0:21945:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff90a7ff648b40 x1876044666896768/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1789136229 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789136220.220764:0:21945:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 3 00000100:00080000:1.0:1789136220.220770:0:21945:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00080000:1.0:1789136220.220790:0:21945:0:(import.c:65:import_set_state_nolock()) ffff90a6c47ca800 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00080000:1.0:1789136220.220794:0:21945:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1789136220.220798:0:21945:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff90a7ff648b40 x1876044666896768/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1789136229 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789136220.220804:0:21945:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 4 00000100:00100000:1.0:1789136220.220807:0:21945:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 12s for inflight to error out 00000100:00100000:3.0:1789136220.220908:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7ff648b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3637:1876044666896768:0@lo:38:kworker.0 00000100:00080000:1.0:1789136220.225993:0:21945:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:1.0:1789136220.226012:0:21945:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff90a7c14b43c0 x1876044666897152/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789136221 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789136220.226040:0:21945:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff90a7c14b61c0 x1876044666897408/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789136225 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789136220.226054:0:21945:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff90a7fa3bda40 x1876044666897664/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789136226 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789136220.226064:0:21945:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff90a7f662c3c0 x1876044666897792/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789136232 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789136220.226072:0:21945:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff90a7fa3bfc00 x1876044666897920/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1789136230 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789136220.226082:0:21945:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 3 00000100:00080000:1.0:1789136220.226088:0:21945:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID 00000100:00080000:1.0:1789136220.226094:0:21945:0:(import.c:65:import_set_state_nolock()) ffff90a6c47cd800 lustre-MDT0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00080000:1.0:1789136220.226099:0:21945:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:1.0:1789136220.226103:0:21945:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff90a7c14b43c0 x1876044666897152/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789136221 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789136220.226110:0:21945:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff90a7c14b61c0 x1876044666897408/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789136225 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789136220.226118:0:21945:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff90a7fa3bda40 x1876044666897664/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789136226 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789136220.226144:0:21945:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff90a7f662c3c0 x1876044666897792/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789136232 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789136220.226151:0:21945:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff90a7fa3bfc00 x1876044666897920/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1789136230 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789136220.226157:0:21945:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 4 00000100:00100000:1.0:1789136220.226160:0:21945:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 16s for inflight to error out 00010000:00010000:0.0:1789136220.226245:0:17742:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789136220.226255:0:17742:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.131@tcp lock: ffff90a6c2d3f400/0x559c8745c6de3f40 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x559c8745c6de3f47 expref: -99 pid: 20082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136220.226265:0:17742:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a6c2d3f400 already unused, calling callback (ffffffffc13bbc20) 10000000:00010000:0.0:1789136220.226269:0:17742:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.131@tcp lock: ffff90a6c2d3f400/0x559c8745c6de3f40 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x559c8745c6de3f47 expref: -99 pid: 20082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136220.226280:0:17742:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.131@tcp lock: ffff90a6c2d3f400/0x559c8745c6de3f40 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x559c8745c6de3f47 expref: -99 pid: 20082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789136220.226288:0:17742:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.131@tcp lock: ffff90a6c2d3f400/0x559c8745c6de3f40 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x559c8745c6de3f47 expref: -99 pid: 20082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789136220.226294:0:17742:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1789136220.226297:0:17742:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:0.0:1789136220.226300:0:17742:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:0.0:1789136220.226315:0:17742:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff90a7d8b29800 00010000:00010000:0.0:1789136220.226319:0:17742:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.131@tcp lock: ffff90a6c2d3f400/0x559c8745c6de3f40 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x559c8745c6de3f47 expref: -99 pid: 20082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136220.226339:0:17742:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.131@tcp lock: ffff90a6c2d3f400/0x559c8745c6de3f40 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x559c8745c6de3f47 expref: -99 pid: 20082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136220.226352:0:17742:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789136220.226353:0:17742:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789136220.226355:0:17742:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789136220.226481:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7f662c3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3640:1876044666897792:0@lo:400:kworker.0 00000100:00100000:3.0:1789136220.226499:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7c14b43c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3640:1876044666897152:0@lo:400:kworker.0 00000100:00100000:3.0:1789136220.226552:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7fa3bda40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3639:1876044666897664:0@lo:400:kworker.0 00000100:00100000:3.0:1789136220.226657:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7fa3bfc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3637:1876044666897920:0@lo:38:kworker.0 00000100:00100000:3.0:1789136220.226675:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7c14b61c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3638:1876044666897408:0@lo:400:kworker.0 00010000:00010000:1.0:1789136220.227838:0:21945:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.131@tcp lock: ffff90a7d1879200/0x559c8745c6de3f16 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x559c8745c6de3f1d expref: -99 pid: 20082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136220.227888:0:21945:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.131@tcp lock: ffff90a7d1879200/0x559c8745c6de3f16 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x559c8745c6de3f1d expref: -99 pid: 20082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136220.227896:0:21945:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.131@tcp lock: ffff90a7d1879200/0x559c8745c6de3f16 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x559c8745c6de3f1d expref: -99 pid: 20082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136220.227903:0:21945:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.131@tcp lock: ffff90a7d1879200/0x559c8745c6de3f16 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x559c8745c6de3f1d expref: -99 pid: 20082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136220.227929:0:21945:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789136220.227937:0:21945:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.131@tcp lock: ffff90a7ff5f4800/0x559c8745c6de40f9 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x559c8745c6de4100 expref: -99 pid: 17750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136220.227943:0:21945:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.131@tcp lock: ffff90a7ff5f4800/0x559c8745c6de40f9 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x559c8745c6de4100 expref: -99 pid: 17750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136220.227949:0:21945:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.131@tcp lock: ffff90a7ff5f4800/0x559c8745c6de40f9 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x559c8745c6de4100 expref: -99 pid: 17750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136220.227955:0:21945:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.131@tcp lock: ffff90a7ff5f4800/0x559c8745c6de40f9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x559c8745c6de4100 expref: -99 pid: 17750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136220.227993:0:21945:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:01000000:1.0:1789136220.227997:0:21945:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0001 (0) 00000020:01000004:1.0:1789136220.228025:0:21945:0:(tgt_mount.c:2112:server_put_super()) stopping lustre-OST0001 00000020:01000000:1.0:1789136220.228029:0:21945:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001 (flags='F') 00000020:00000080:1.0:1789136220.228033:0:21945:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1789136220.228038:0:21945:0:(obd_config.c:956:class_cleanup()) lustre-OST0001: forcing exports to disconnect: 0/1 00000020:00080000:1.0:1789136220.228042:0:21945:0:(genops.c:1558:class_disconnect_exports()) OBD device 26 (ffff90a6c470ced8) has no exports 00000020:00080000:1.0:1789136220.228153:0:21945:0:(genops.c:1558:class_disconnect_exports()) OBD device 26 (ffff90a6c470ced8) has no exports 00010000:00010000:2.0:1789136220.229654:0:17741:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1789136220.229667:0:17741:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.131@tcp lock: ffff90a7d1879200/0x559c8745c6de3f16 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x559c8745c6de3f1d expref: -99 pid: 20082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136220.229677:0:17741:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a7d1879200 already unused, calling callback (ffffffffc13bbc20) 10000000:00010000:2.0:1789136220.229681:0:17741:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.131@tcp lock: ffff90a7d1879200/0x559c8745c6de3f16 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x559c8745c6de3f1d expref: -99 pid: 20082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136220.229692:0:17741:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.131@tcp lock: ffff90a7d1879200/0x559c8745c6de3f16 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x559c8745c6de3f1d expref: -99 pid: 20082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789136220.229700:0:17741:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.131@tcp lock: ffff90a7d1879200/0x559c8745c6de3f16 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x559c8745c6de3f1d expref: -99 pid: 20082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789136220.229705:0:17741:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1789136220.229708:0:17741:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0001: stopping, won't requeue 10000000:01000000:2.0:1789136220.229711:0:17741:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0001 00010000:00010000:2.0:1789136220.229727:0:17741:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff90a7d8b29800 00010000:00010000:2.0:1789136220.229731:0:17741:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.131@tcp lock: ffff90a7d1879200/0x559c8745c6de3f16 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x559c8745c6de3f1d expref: -99 pid: 20082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136220.229758:0:17741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.131@tcp lock: ffff90a7d1879200/0x559c8745c6de3f16 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x559c8745c6de3f1d expref: -99 pid: 20082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136220.229774:0:17741:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789136220.229778:0:17741:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.131@tcp lock: ffff90a7ff5f4800/0x559c8745c6de40f9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x559c8745c6de4100 expref: -99 pid: 17750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136220.229783:0:17741:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a7ff5f4800 already unused, calling callback (ffffffffc13bbc20) 10000000:00010000:2.0:1789136220.229786:0:17741:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.131@tcp lock: ffff90a7ff5f4800/0x559c8745c6de40f9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x559c8745c6de4100 expref: -99 pid: 17750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136220.229792:0:17741:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.131@tcp lock: ffff90a7ff5f4800/0x559c8745c6de40f9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x559c8745c6de4100 expref: -99 pid: 17750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789136220.229798:0:17741:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.131@tcp lock: ffff90a7ff5f4800/0x559c8745c6de40f9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x559c8745c6de4100 expref: -99 pid: 17750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789136220.229803:0:17741:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:2.0:1789136220.229805:0:17741:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:2.0:1789136220.229807:0:17741:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:2.0:1789136220.229824:0:17741:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff90a7d8b29800 00010000:00010000:2.0:1789136220.229827:0:17741:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.131@tcp lock: ffff90a7ff5f4800/0x559c8745c6de40f9 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0x559c8745c6de4100 expref: -99 pid: 17750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136220.229833:0:17741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.131@tcp lock: ffff90a7ff5f4800/0x559c8745c6de40f9 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0x559c8745c6de4100 expref: -99 pid: 17750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136220.229847:0:17741:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789136220.229848:0:17741:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789136220.229887:0:17741:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789136220.230609:0:21541:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:1.0:1789136220.236365:0:21945:0:(lprocfs_status_server.c:345:lprocfs_free_client_stats()) stat ffff90a6c2cceb40 - data ffff90a7cec85948/ffff90a7c515e800 00000020:01000000:1.0:1789136220.236524:0:21945:0:(lprocfs_status_server.c:345:lprocfs_free_client_stats()) stat ffff90a7e6eb5f60 - data ffff90a6c241c0d8/ffff90a6c3826400 00100000:10000000:1.0:1789136220.246383:0:21945:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0001-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:3.0:1789136220.260960:0:21945:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x559c8745c6de3f2b 00000020:00000080:3.0:1789136220.260973:0:21945:0:(genops.c:885:class_export_put()) final put ffff90a7f6b2d800/lustre-OST0001-osd_UUID 00000020:01000004:3.0:1789136220.260990:0:21945:0:(tgt_mount.c:187:server_put_mount()) put mount ffff90a7ff501000 from lustre-OST0001, refs=2 00000020:01000004:3.0:1789136220.260994:0:21945:0:(obd_mount.c:710:lustre_put_lsi()) put ffff90a7ff501000 2 00000020:01000004:3.0:1789136220.260997:0:21945:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff90a7ff501000 from lustre-OST0001 00000020:00000080:3.0:1789136220.261024:0:21945:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1789136220.261034:0:21945:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:00000080:3.0:1789136220.261037:0:21945:0:(genops.c:885:class_export_put()) final put ffff90a7f6b2e000/lustre-OST0001_UUID 00000020:00000080:3.0:1789136220.261040:0:21945:0:(genops.c:844:class_export_destroy()) destroying export ffff90a7f6b2e000/lustre-OST0001_UUID for lustre-OST0001 00000020:01000000:3.0:1789136220.261047:0:21945:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001 (lustre-OST0001_UUID) 00000100:00080000:3.0:1789136220.261149:0:21945:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import 511c13c6-847f-45db-8965-d0deb75673dc->MGS 00010000:00010000:3.0:1789136220.261166:0:21945:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.131@tcp lock: ffff90a7d1878e00/0x559c8745c6de3c68 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x559c8745c6de3c6f expref: -99 pid: 18488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789136220.261179:0:21945:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.131@tcp lock: ffff90a7d1878e00/0x559c8745c6de3c68 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x559c8745c6de3c6f expref: -99 pid: 18488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789136220.261185:0:21945:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 10000000:01000000:3.0:1789136220.261188:0:21945:0:(mgc_request.c:954:mgc_blocking_ast()) log nodemap: disconnecting, won't requeue 10000000:01000000:3.0:1789136220.261201:0:21945:0:(mgc_request.c:130:config_log_put()) dropping config log nodemap 00010000:00010000:3.0:1789136220.261217:0:21945:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff90a7d8b29800 00010000:00010000:3.0:1789136220.261221:0:21945:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.131@tcp lock: ffff90a7d1878e00/0x559c8745c6de3c68 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x559c8745c6de3c6f expref: -99 pid: 18488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136220.261235:0:21945:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.131@tcp lock: ffff90a7d1878c00/0x559c8745c6de3b57 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x559c8745c6de3b5e expref: -99 pid: 17732 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789136220.261243:0:21945:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.131@tcp lock: ffff90a7d1878c00/0x559c8745c6de3b57 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x559c8745c6de3b5e expref: -99 pid: 17732 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789136220.261248:0:21945:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1789136220.261251:0:21945:0:(mgc_request.c:954:mgc_blocking_ast()) log lustre-s: disconnecting, won't requeue 10000000:01000000:3.0:1789136220.261252:0:21945:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-sptlrpc 00010000:00010000:3.0:1789136220.261262:0:21945:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff90a7d8b29800 00010000:00010000:3.0:1789136220.261265:0:21945:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.131@tcp lock: ffff90a7d1878c00/0x559c8745c6de3b57 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x559c8745c6de3b5e expref: -99 pid: 17732 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1789136220.261281:0:21945:0:(import.c:65:import_set_state_nolock()) ffff90a7d8b29800 MGS: changing import state from CONNECTING to CLOSED 10000000:01000000:3.0:1789136220.261285:0:21945:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:3.0:1789136220.261288:0:21945:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:3.0:1789136220.261290:0:21945:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:3.0:1789136220.261294:0:21945:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:3.0:1789136220.261305:0:21945:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff90a7fa3be580 x1876044666897536/t0(0) o250->MGC192.168.201.131@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 1789136225 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 10000000:01000000:3.0:1789136220.261322:0:21945:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:3.0:1789136220.261325:0:21945:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 6s for inflight to error out 00000100:00100000:3.0:1789136220.261354:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7fa3be580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:511c13c6-847f-45db-8965-d0deb75673dc:3637:1876044666897536:0@lo:250:kworker.0 10000000:01000000:3.0:1789136220.261378:0:21945:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:3.0:1789136220.261384:0:21945:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x559c8745c6de3b42 00000020:00000080:3.0:1789136220.261389:0:21945:0:(genops.c:885:class_export_put()) final put ffff90a7d8b2e800/511c13c6-847f-45db-8965-d0deb75673dc 00000020:01000000:3.0:1789136220.261394:0:21945:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGC192.168.201.131@tcp (flags='') 00000020:00000080:3.0:1789136220.261403:0:21945:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1789136220.261407:0:21945:0:(obd_config.c:956:class_cleanup()) MGC192.168.201.131@tcp: forcing exports to disconnect: 0/3 00000020:00080000:3.0:1789136220.261411:0:21945:0:(genops.c:1558:class_disconnect_exports()) OBD device 2 (ffff90a6c2b94ed8) has no exports 00000020:00000080:0.0:1789136220.261623:0:16093:0:(genops.c:844:class_export_destroy()) destroying export ffff90a7f6b2d800/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:00000080:0.0:1789136220.261631:0:16093:0:(genops.c:844:class_export_destroy()) destroying export ffff90a7d8b2e800/511c13c6-847f-45db-8965-d0deb75673dc for MGC192.168.201.131@tcp 10000000:01000000:0.0:1789136220.262079:0:17750:0:(mgc_request.c:708:mgc_requeue_thread()) Ending requeue thread 10000000:01000000:3.0:1789136220.262691:0:21945:0:(obd_class.h:671:obd_cleanup_client_import()) MGC192.168.201.131@tcp: client import never connected 00000100:00080000:3.0:1789136220.262697:0:21945:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 10000000:01000000:3.0:1789136220.262699:0:21945:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:3.0:1789136220.262703:0:21945:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 10000000:01000000:3.0:1789136220.262706:0:21945:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:3.0:1789136220.262779:0:21945:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1789136220.262786:0:21945:0:(obd_config.c:883:class_detach()) detach on obd MGC192.168.201.131@tcp (uuid 511c13c6-847f-45db-8965-d0deb75673dc) 00000020:01000000:3.0:1789136220.262804:0:21945:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0001 (flags='F') 00000020:00000080:3.0:1789136220.262810:0:21945:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1789136220.262814:0:21945:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-OST0001: forcing exports to disconnect: 1/3 00000020:00080000:3.0:1789136220.262821:0:21945:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-OST0001: ACTIVE ffff90a6c47cb000 lustre-MDT0000-lwp-OST0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1789136220.262827:0:21945:0:(genops.c:1553:class_disconnect_exports()) OBD device 27 (ffff90a7efa1b490) has exports, disconnecting them 00000020:00080000:3.0:1789136220.262831:0:21945:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0001: disconnecting export at 0@lo (ffff90a6c47cb000), last request at 1789136132 00000020:00000080:3.0:1789136220.262835:0:21945:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x559c8745c6de3f55 00000020:00080000:3.0:1789136220.262850:0:21945:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff90a6c47cb000): rc 0 00000020:00000080:3.0:1789136220.262875:0:21945:0:(genops.c:885:class_export_put()) final put ffff90a6c47cb000/lustre-MDT0000-lwp-OST0001 00000020:00000080:0.0:1789136220.263596:0:16093:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff90a7d8b29800 for MGC192.168.201.131@tcp 00000020:00000080:0.0:1789136220.263603:0:16093:0:(genops.c:885:class_export_put()) final put ffff90a7d8b2b800/511c13c6-847f-45db-8965-d0deb75673dc 00000020:00000080:0.0:1789136220.263607:0:16093:0:(genops.c:844:class_export_destroy()) destroying export ffff90a7d8b2b800/511c13c6-847f-45db-8965-d0deb75673dc for MGC192.168.201.131@tcp 00000020:01000000:0.0:1789136220.263614:0:16093:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGC192.168.201.131@tcp (511c13c6-847f-45db-8965-d0deb75673dc) 00000020:00000080:0.0:1789136220.263895:0:16093:0:(genops.c:844:class_export_destroy()) destroying export ffff90a6c47cb000/lustre-MDT0000-lwp-OST0001 for lustre-MDT0000-lwp-OST0001 00010000:01000000:2.0:1789136220.270109:0:21945:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0001: client import never connected 00000100:00080000:2.0:1789136220.270119:0:21945:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1789136220.270123:0:21945:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 5 00000100:00100000:2.0:1789136220.270131:0:21945:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1789136220.270323:0:21945:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1789136220.270331:0:21945:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000020:01000000:2.0:1789136220.270339:0:21945:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-lwp-OST0001 (flags='F') 00000020:00000080:2.0:1789136220.270344:0:21945:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1789136220.270348:0:21945:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-lwp-OST0001: forcing exports to disconnect: 1/3 00000020:00080000:2.0:1789136220.270355:0:21945:0:(genops.c:1819:print_export_data()) lustre-MDT0001-lwp-OST0001: ACTIVE ffff90a6c3ba2000 lustre-MDT0001-lwp-OST0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1789136220.270361:0:21945:0:(genops.c:1553:class_disconnect_exports()) OBD device 28 (ffff90a8018d4ed8) has exports, disconnecting them 00000020:00080000:2.0:1789136220.270366:0:21945:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0001-lwp-OST0001: disconnecting export at 0@lo (ffff90a6c3ba2000), last request at 1789136132 00000020:00000080:2.0:1789136220.270370:0:21945:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x559c8745c6de3f6a 00000020:00080000:2.0:1789136220.270384:0:21945:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff90a6c3ba2000): rc 0 00000020:00000080:2.0:1789136220.270390:0:21945:0:(genops.c:885:class_export_put()) final put ffff90a6c3ba2000/lustre-MDT0001-lwp-OST0001 00000020:00000080:0.0:1789136220.270850:0:16093:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff90a6c47ca800 for lustre-MDT0000-lwp-OST0001 00000020:00000080:0.0:1789136220.270878:0:16093:0:(genops.c:885:class_export_put()) final put ffff90a6c47cf800/lustre-MDT0000-lwp-OST0001_UUID 00000020:00000080:0.0:1789136220.270881:0:16093:0:(genops.c:844:class_export_destroy()) destroying export ffff90a6c47cf800/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000-lwp-OST0001 00000020:01000000:0.0:1789136220.270887:0:16093:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0001 (lustre-MDT0000-lwp-OST0001_UUID) 00000020:00000080:0.0:1789136220.270954:0:16093:0:(genops.c:844:class_export_destroy()) destroying export ffff90a6c3ba2000/lustre-MDT0001-lwp-OST0001 for lustre-MDT0001-lwp-OST0001 00010000:01000000:0.0:1789136220.298960:0:21945:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0001-lwp-OST0001: client import never connected 00000100:00080000:0.0:1789136220.298969:0:21945:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:0.0:1789136220.298974:0:21945:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 5 00000100:00100000:0.0:1789136220.298981:0:21945:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1789136220.299015:0:16093:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff90a6c47cd800 for lustre-MDT0001-lwp-OST0001 00010000:00010000:0.0:1789136220.299065:0:17742:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-1 blwis in pool) 00010000:00010000:3.0:1789136220.299961:0:17741:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-2 blwis in pool) 00010000:00010000:3.0:1789136220.300134:0:21541:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-3 blwis in pool) 00000100:00100000:3.0:1789136220.300310:0:17737:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_001: service thread [ffff90a7fa653e00:17737] 1 exiting: rc = 0 00000100:00100000:1.0:1789136220.307108:0:17736:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_000: service thread [ffff90a7fa653c00:17736] 0 exiting: rc = 1 00000100:00100000:0.0:1789136220.307398:0:21945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789136220.307752:0:21542:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_003: service thread [ffff90a7c62c8200:21542] 3 exiting: rc = 0 00000100:00100000:3.0:1789136220.307833:0:17740:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_002: service thread [ffff90a7c62c8600:17740] 2 exiting: rc = 0 00000100:00100000:2.0:1789136220.308415:0:17738:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_000: service thread [ffff90a7fa653800:17738] 0 exiting: rc = 1 00000100:00100000:0.0:1789136220.309387:0:17739:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_001: service thread [ffff90a7fa653000:17739] 1 exiting: rc = 0 00000100:00100000:0.0:1789136220.309465:0:21945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136220.309472:0:21945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136220.309479:0:21945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136220.309485:0:21945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136220.309490:0:21945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136220.309497:0:21945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136220.309503:0:21945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136220.309518:0:21945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136220.309525:0:21945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136220.309530:0:21945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136220.309535:0:21945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136220.309541:0:21945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136220.309546:0:21945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136220.309551:0:21945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136220.309556:0:21945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136220.309561:0:21945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136220.309566:0:21945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136220.309572:0:21945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136220.309576:0:21945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136220.309583:0:21945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136220.309588:0:21945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136220.309592:0:21945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136220.309597:0:21945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136220.309601:0:21945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136220.309606:0:21945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136220.309611:0:21945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136220.309616:0:21945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136220.309621:0:21945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136220.309626:0:21945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136220.309631:0:21945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136220.309637:0:21945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136220.309642:0:21945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136220.309647:0:21945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136220.309652:0:21945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136220.309671:0:21945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136220.309687:0:21945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136220.309693:0:21945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136220.309698:0:21945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136220.309705:0:21945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136220.309710:0:21945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136220.309715:0:21945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136220.309720:0:21945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136220.309726:0:21945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136220.309733:0:21945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136220.309755:0:21945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136220.309760:0:21945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136220.309765:0:21945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136220.309770:0:21945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136220.309775:0:21945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136220.309782:0:21945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136220.309788:0:21945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136220.309794:0:21945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136220.309799:0:21945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136220.309805:0:21945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136220.309810:0:21945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136220.309816:0:21945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136220.309821:0:21945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136220.309825:0:21945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136220.309830:0:21945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136220.309836:0:21945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136220.309842:0:21945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136220.309847:0:21945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136220.309874:0:21945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136220.309881:0:21945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:0.0:1789136220.311291:0:21945:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1789136220.311301:0:21945:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-lwp-OST0001 (uuid lustre-MDT0001-lwp-OST0001_UUID) 00000020:00000080:0.0:1789136220.311307:0:21945:0:(genops.c:885:class_export_put()) final put ffff90a7d28fe800/lustre-MDT0001-lwp-OST0001_UUID 00000020:00000080:0.0:1789136220.311324:0:21945:0:(genops.c:844:class_export_destroy()) destroying export ffff90a7d28fe800/lustre-MDT0001-lwp-OST0001_UUID for lustre-MDT0001-lwp-OST0001 00000020:01000000:0.0:1789136220.311330:0:21945:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-lwp-OST0001 (lustre-MDT0001-lwp-OST0001_UUID) 00000020:01000004:0.0:1789136220.311392:0:21945:0:(obd_mount.c:710:lustre_put_lsi()) put ffff90a7ff501000 1 00000020:00000080:0.0:1789136220.311398:0:21945:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x559c8745c6de3f0f 00000020:00000080:0.0:1789136220.311405:0:21945:0:(genops.c:885:class_export_put()) final put ffff90a7f0966000/lustre-OST0001-osd_UUID 00000020:01000000:0.0:1789136220.311427:0:21945:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osd (flags='') 00000020:00000080:0.0:1789136220.311431:0:21945:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1789136220.311436:0:21945:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osd: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1789136220.311440:0:21945:0:(genops.c:1558:class_disconnect_exports()) OBD device 25 (ffff90a7e6e98000) has no exports 00000020:00000080:3.0:1789136220.316019:0:16093:0:(genops.c:844:class_export_destroy()) destroying export ffff90a7f0966000/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:00000080:2.0:1789136220.350388:0:21945:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1789136220.350403:0:21945:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00000020:00000080:2.0:1789136220.350409:0:21945:0:(genops.c:885:class_export_put()) final put ffff90a7ff505000/lustre-OST0001-osd_UUID 00000020:00000080:2.0:1789136220.350413:0:21945:0:(genops.c:844:class_export_destroy()) destroying export ffff90a7ff505000/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:01000000:2.0:1789136220.350426:0:21945:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osd (lustre-OST0001-osd_UUID) 00000020:01000004:2.0:1789136220.350756:0:21945:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff90a7ff501800 00000020:01000000:2.0:1789136220.350776:0:21945:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of OSS (flags='F') 00000020:00000080:2.0:1789136220.350780:0:21945:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1789136220.350784:0:21945:0:(obd_config.c:956:class_cleanup()) OSS: forcing exports to disconnect: 0/1 00000020:00080000:2.0:1789136220.350787:0:21945:0:(genops.c:1558:class_disconnect_exports()) OBD device 21 (ffff90a7efa1ced8) has no exports 00000020:00000080:2.0:1789136220.350810:0:21945:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1789136220.350814:0:21945:0:(obd_config.c:883:class_detach()) detach on obd OSS (uuid OSS_uuid) 00000020:00000080:2.0:1789136220.350817:0:21945:0:(genops.c:885:class_export_put()) final put ffff90a7f0964000/OSS_uuid 00000020:00000080:2.0:1789136220.350827:0:21945:0:(genops.c:844:class_export_destroy()) destroying export ffff90a7f0964000/OSS_uuid for OSS 00000020:01000000:2.0:1789136220.350830:0:21945:0:(genops.c:441:class_free_dev()) finishing cleanup of obd OSS (OSS_uuid) 00000100:00080000:2.0:1789136220.350879:0:17749:0:(pinger.c:548:ping_evictor_main()) Exiting Ping Evictor 00000100:00100000:3.0:1789136220.352035:0:20655:0:(service.c:3183:ptlrpc_main()) ll_ost00_004: service thread [ffff90a6c4d3e800:20655] 4 exiting: rc = 0 00000100:00100000:3.0:1789136220.352129:0:19572:0:(service.c:3183:ptlrpc_main()) ll_ost00_003: service thread [ffff90a7c4df9400:19572] 3 exiting: rc = 0 00000100:00100000:3.0:1789136220.352181:0:19265:0:(service.c:3183:ptlrpc_main()) ll_ost00_000: service thread [ffff90a6c2226e00:19265] 0 exiting: rc = 1 00000100:00100000:0.0:1789136220.352770:0:19267:0:(service.c:3183:ptlrpc_main()) ll_ost00_002: service thread [ffff90a7c4f7c600:19267] 2 exiting: rc = 0 00000100:00100000:0.0:1789136220.355175:0:19266:0:(service.c:3183:ptlrpc_main()) ll_ost00_001: service thread [ffff90a7c4c9de00:19266] 1 exiting: rc = 0 00000100:00100000:2.0:1789136220.356605:0:21945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789136220.356618:0:21945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789136220.356623:0:21945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789136220.356628:0:21945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789136220.356633:0:21945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789136220.356638:0:21945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789136220.356644:0:21945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789136220.356648:0:21945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789136220.356653:0:21945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789136220.356663:0:21945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789136220.356671:0:21945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789136220.356676:0:21945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789136220.356682:0:21945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789136220.356686:0:21945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789136220.356691:0:21945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789136220.356696:0:21945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789136220.356701:0:21945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789136220.356706:0:21945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789136220.356712:0:21945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789136220.356717:0:21945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789136220.356722:0:21945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789136220.356727:0:21945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789136220.356732:0:21945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789136220.357204:0:21945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789136220.357212:0:21945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789136220.357218:0:21945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789136220.357224:0:21945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789136220.357229:0:21945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789136220.357307:0:21945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789136220.357430:0:21945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789136220.357435:0:21945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789136220.357441:0:21945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789136220.357463:0:21945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789136220.357468:0:21945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789136220.357473:0:21945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789136220.357478:0:21945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789136220.357483:0:21945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789136220.357488:0:21945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789136220.357493:0:21945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789136220.357498:0:21945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789136220.357503:0:21945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789136220.357519:0:21945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789136220.357526:0:21945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789136220.357531:0:21945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789136220.357535:0:21945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789136220.357540:0:21945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789136220.357545:0:21945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789136220.357550:0:21945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789136220.357555:0:21945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789136220.357560:0:21945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789136220.357565:0:21945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789136220.357571:0:21945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789136220.357576:0:21945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789136220.357581:0:21945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789136220.357587:0:21945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789136220.357593:0:21945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789136220.357599:0:21945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789136220.357605:0:21945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789136220.357610:0:21945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789136220.357614:0:21945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789136220.357620:0:21945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789136220.357625:0:21945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789136220.357630:0:21945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789136220.357635:0:21945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789136220.368817:0:20582:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_002: service thread [ffff90a6c39ec200:20582] 2 exiting: rc = 0 00000100:00100000:3.0:1789136220.373824:0:19269:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_001: service thread [ffff90a7c5123800:19269] 1 exiting: rc = 0 00000100:00100000:2.0:1789136220.374368:0:19268:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_000: service thread [ffff90a7c5123200:19268] 0 exiting: rc = 1 00000100:00100000:0.0:1789136220.374634:0:21945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136220.374642:0:21945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136220.374647:0:21945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136220.374653:0:21945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136220.374659:0:21945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136220.374664:0:21945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136220.374669:0:21945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136220.374675:0:21945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136220.374680:0:21945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136220.374685:0:21945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136220.374691:0:21945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136220.374696:0:21945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136220.374701:0:21945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136220.374707:0:21945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136220.374713:0:21945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136220.374718:0:21945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136220.374724:0:21945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136220.374729:0:21945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136220.374847:0:21945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136220.375005:0:21945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136220.375014:0:21945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136220.375019:0:21945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136220.375023:0:21945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136220.375028:0:21945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136220.375032:0:21945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136220.375050:0:21945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136220.375054:0:21945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136220.375059:0:21945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136220.375064:0:21945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136220.375069:0:21945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136220.375074:0:21945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136220.375079:0:21945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136220.375084:0:21945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136220.375090:0:21945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136220.375095:0:21945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136220.375100:0:21945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136220.375105:0:21945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136220.375109:0:21945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136220.375114:0:21945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136220.375119:0:21945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136220.375123:0:21945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136220.375128:0:21945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136220.375133:0:21945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136220.375138:0:21945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136220.375143:0:21945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136220.375149:0:21945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136220.375153:0:21945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136220.375158:0:21945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136220.375163:0:21945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136220.375168:0:21945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136220.375172:0:21945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136220.375177:0:21945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136220.375182:0:21945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136220.375187:0:21945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136220.375193:0:21945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136220.375198:0:21945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136220.375204:0:21945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136220.375209:0:21945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136220.375215:0:21945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136220.375219:0:21945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136220.375232:0:21945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136220.375237:0:21945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136220.375243:0:21945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136220.375248:0:21945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136220.376758:0:19270:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_000: service thread [ffff90a7c5122400:19270] 0 exiting: rc = 1 00000100:00100000:1.0:1789136220.377099:0:19271:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_001: service thread [ffff90a6c2ff1800:19271] 1 exiting: rc = 0 00000100:00100000:2.0:1789136220.377549:0:20906:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_003: service thread [ffff90a6c39ec000:20906] 3 exiting: rc = 0 00000100:00100000:2.0:1789136220.378225:0:19272:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_002: service thread [ffff90a7c4f51800:19272] 2 exiting: rc = 0 00000100:00100000:0.0:1789136220.378733:0:21945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136220.379043:0:21945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136220.379058:0:21945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136220.379065:0:21945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136220.379071:0:21945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136220.379084:0:21945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136220.379091:0:21945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136220.379097:0:21945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136220.379103:0:21945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136220.379109:0:21945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136220.379115:0:21945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136220.379121:0:21945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136220.379126:0:21945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136220.379132:0:21945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136220.379161:0:21945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136220.379167:0:21945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136220.379172:0:21945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136220.379177:0:21945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136220.379181:0:21945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136220.379187:0:21945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136220.379192:0:21945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136220.379197:0:21945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136220.379203:0:21945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136220.379207:0:21945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136220.379212:0:21945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136220.379217:0:21945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136220.379223:0:21945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136220.379228:0:21945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136220.379233:0:21945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136220.379239:0:21945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136220.379254:0:21945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136220.379259:0:21945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136220.379264:0:21945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136220.379270:0:21945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136220.379276:0:21945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136220.379282:0:21945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136220.379287:0:21945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136220.379293:0:21945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136220.379371:0:21945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136220.379379:0:21945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136220.379385:0:21945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136220.379391:0:21945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136220.379397:0:21945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136220.379403:0:21945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136220.379408:0:21945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136220.379414:0:21945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136220.379422:0:21945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136220.379428:0:21945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136220.379433:0:21945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136220.379438:0:21945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136220.379444:0:21945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136220.379450:0:21945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136220.379456:0:21945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136220.379461:0:21945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136220.379467:0:21945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136220.379472:0:21945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136220.379486:0:21945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136220.379493:0:21945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136220.379499:0:21945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136220.379520:0:21945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136220.379527:0:21945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136220.379533:0:21945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136220.379538:0:21945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789136220.379544:0:21945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789136220.394226:0:19273:0:(service.c:3183:ptlrpc_main()) ll_ost_seq00_000: service thread [ffff90a7c4f50c00:19273] 0 exiting: rc = 1 00000100:00100000:2.0:1789136220.395129:0:19274:0:(service.c:3183:ptlrpc_main()) ll_ost_seq00_001: service thread [ffff90a7c4f50800:19274] 1 exiting: rc = 0 00000100:00100000:3.0:1789136220.395301:0:21945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789136220.395323:0:21945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789136220.395328:0:21945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789136220.395334:0:21945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789136220.395339:0:21945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789136220.395344:0:21945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789136220.395349:0:21945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789136220.395353:0:21945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789136220.395358:0:21945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789136220.395364:0:21945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789136220.395370:0:21945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789136220.395421:0:21945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789136220.395426:0:21945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789136220.395431:0:21945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789136220.395435:0:21945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789136220.395440:0:21945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789136220.395445:0:21945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789136220.395450:0:21945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789136220.395454:0:21945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789136220.395458:0:21945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789136220.395463:0:21945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789136220.395467:0:21945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789136220.395471:0:21945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789136220.395477:0:21945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789136220.395481:0:21945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789136220.395486:0:21945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789136220.395491:0:21945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789136220.395497:0:21945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789136220.395502:0:21945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789136220.395516:0:21945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789136220.395522:0:21945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789136220.395528:0:21945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789136220.395532:0:21945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789136220.395537:0:21945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789136220.395541:0:21945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789136220.395546:0:21945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789136220.395559:0:21945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789136220.395564:0:21945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789136220.395569:0:21945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789136220.395574:0:21945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789136220.395578:0:21945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789136220.395584:0:21945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789136220.395591:0:21945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789136220.395597:0:21945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789136220.395602:0:21945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789136220.395608:0:21945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789136220.395612:0:21945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789136220.395618:0:21945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789136220.395623:0:21945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789136220.395630:0:21945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789136220.395635:0:21945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789136220.395640:0:21945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789136220.395645:0:21945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789136220.395650:0:21945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789136220.395656:0:21945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789136220.395662:0:21945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789136220.395668:0:21945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789136220.395673:0:21945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789136220.395678:0:21945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789136220.395684:0:21945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789136220.395690:0:21945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789136220.395694:0:21945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789136220.395699:0:21945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789136220.395704:0:21945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789136220.396414:0:19276:0:(service.c:3183:ptlrpc_main()) ll_ost_out00_001: service thread [ffff90a6c2d6f600:19276] 1 exiting: rc = 0 00000100:00100000:2.0:1789136220.396631:0:19275:0:(service.c:3183:ptlrpc_main()) ll_ost_out00_000: service thread [ffff90a6c2d6e200:19275] 0 exiting: rc = 1 00000100:00100000:3.0:1789136220.398565:0:21945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789136220.398578:0:21945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789136220.398585:0:21945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789136220.398590:0:21945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789136220.398596:0:21945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789136220.398622:0:21945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789136220.398641:0:21945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789136220.398646:0:21945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789136220.398652:0:21945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789136220.398658:0:21945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789136220.398664:0:21945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789136220.398670:0:21945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789136220.398675:0:21945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789136220.398684:0:21945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789136220.398689:0:21945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789136220.398697:0:21945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789136220.398703:0:21945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789136220.398723:0:21945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789136220.398732:0:21945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789136220.400939:0:21945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789136220.400950:0:21945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789136220.400957:0:21945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789136220.400962:0:21945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789136220.400967:0:21945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789136220.400973:0:21945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789136220.400980:0:21945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789136220.400987:0:21945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789136220.400993:0:21945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789136220.400998:0:21945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789136220.401031:0:21945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789136220.401038:0:21945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789136220.401045:0:21945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789136220.401051:0:21945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789136220.401056:0:21945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789136220.401062:0:21945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789136220.401069:0:21945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789136220.401075:0:21945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789136220.401081:0:21945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789136220.401086:0:21945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789136220.401092:0:21945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789136220.401097:0:21945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789136220.401126:0:21945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789136220.401135:0:21945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789136220.401141:0:21945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789136220.401147:0:21945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789136220.401154:0:21945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789136220.401160:0:21945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789136220.401166:0:21945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789136220.401173:0:21945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789136220.401178:0:21945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789136220.401183:0:21945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789136220.401188:0:21945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789136220.401194:0:21945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789136220.401215:0:21945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789136220.401221:0:21945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789136220.401227:0:21945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789136220.401234:0:21945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789136220.401241:0:21945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789136220.401247:0:21945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789136220.401253:0:21945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789136220.401260:0:21945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789136220.401265:0:21945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789136220.401278:0:21945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789136220.401295:0:21945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:02000400:2.0:1789136220.417959:0:21945:0:(tgt_mount.c:2181:server_put_super()) server umount lustre-OST0001 complete 00000001:02000400:3.0:1789136247.585145:0:22711:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg131-server.virtnet: executing load_modules_local 00000020:01000004:0.0:1789136259.650117:0:23311:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:0.0:1789136259.650132:0:23311:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/mds1_flakey 00000020:01000004:0.0:1789136259.650134:0:23311:0:(obd_mount.c:929:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:0.0:1789136259.650240:0:23311:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff90a7fa55b800 00000020:01000004:0.0:1789136259.650256:0:23311:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-MDT0000, type=osd-ldiskfs, lsifl=200005, mountfl=0 00000020:01000004:0.0:1789136259.650264:0:23311:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-ldiskfs) 00000020:00000080:0.0:1789136259.650278:0:23311:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (ffff90a8018d4ed8) 00000020:00000080:0.0:1789136259.650290:0:23311:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-ldiskfs with refcount 2 00100000:10000000:2.0:1789136259.750107:0:23311:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x13:0x0] (16/1) registered 00100000:10000000:2.0:1789136259.752380:0:23311:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:2.0:1789136259.755440:0:23311:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x27:0x0] (24/16) registered 00100000:10000000:2.0:1789136259.755899:0:23311:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2c:0x0] (24/16) registered 00100000:10000000:2.0:1789136259.756162:0:23311:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2f:0x0] (24/16) registered 00100000:10000000:2.0:1789136259.756633:0:23311:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2b:0x0] (24/16) registered 00100000:10000000:2.0:1789136259.756839:0:23311:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2a:0x0] (24/16) registered 00100000:10000000:2.0:1789136259.757137:0:23311:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x29:0x0] (24/16) registered 00100000:10000000:2.0:1789136259.757439:0:23311:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x25:0x0] (24/16) registered 00100000:10000000:2.0:1789136259.760414:0:23311:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x20:0x0] (16/1) registered 00100000:10000000:2.0:1789136259.760848:0:23311:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2e:0x0] (24/16) registered 00100000:10000000:2.0:1789136259.761421:0:23311:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1c:0x0] (16/1) registered 00100000:10000000:2.0:1789136259.762051:0:23311:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x26:0x0] (24/16) registered 00100000:10000000:2.0:1789136259.762493:0:23311:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1f:0x0] (16/1) registered 00100000:10000000:2.0:1789136259.763074:0:23311:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x34:0x0] (24/16) registered 00100000:10000000:2.0:1789136259.763436:0:23311:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x17:0x0] (16/1) registered 00100000:10000000:2.0:1789136259.764048:0:23311:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1d:0x0] (16/1) registered 00100000:10000000:2.0:1789136259.764463:0:23311:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x18:0x0] (16/1) registered 00100000:10000000:2.0:1789136259.767943:0:23311:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x28:0x0] (24/16) registered 00100000:10000000:2.0:1789136259.769714:0:23311:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x32:0x0] (24/16) registered 00100000:10000000:3.0:1789136259.773962:0:23311:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x16:0x0] (16/1) registered 00100000:10000000:3.0:1789136259.774835:0:23311:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1e:0x0] (16/1) registered 00100000:10000000:3.0:1789136259.776637:0:23311:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1a:0x0] (16/1) registered 00100000:10000000:3.0:1789136259.777085:0:23311:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1b:0x0] (16/1) registered 00100000:10000000:3.0:1789136259.777486:0:23311:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x33:0x0] (24/16) registered 00100000:10000000:3.0:1789136259.777986:0:23311:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x30:0x0] (24/16) registered 00100000:10000000:3.0:1789136259.778387:0:23311:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x23:0x0] (16/1) registered 00100000:10000000:3.0:1789136259.778705:0:23311:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x14:0x0] (16/1) registered 00100000:10000000:3.0:1789136259.778950:0:23311:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x31:0x0] (24/16) registered 00100000:10000000:3.0:1789136259.779345:0:23311:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x15:0x0] (16/1) registered 00100000:10000000:3.0:1789136259.780350:0:23311:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x21:0x0] (16/1) registered 00100000:10000000:3.0:1789136259.780850:0:23311:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2d:0x0] (24/16) registered 00100000:10000000:3.0:1789136259.781330:0:23311:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x22:0x0] (16/1) registered 00100000:10000000:3.0:1789136259.782587:0:23311:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x19:0x0] (16/1) registered 00100000:10000000:3.0:1789136259.784967:0:23311:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2:0x0] (8/32) registered 00100000:10000000:3.0:1789136259.786750:0:23311:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:3.0:1789136259.787374:0:23311:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:3.0:1789136259.787708:0:23311:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/32) registered 00100000:10000000:3.0:1789136259.787964:0:23311:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/32) registered 00100000:10000000:3.0:1789136259.788203:0:23311:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8) registered 00100000:10000000:3.0:1789136259.788560:0:23311:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:0.0:1789136259.789049:0:23311:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x9:0x0] (8/32) registered 00100000:10000000:0.0:1789136259.789434:0:23311:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8) registered 00100000:10000000:0.0:1789136259.789725:0:23311:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/32) registered 00100000:10000000:0.0:1789136259.789932:0:23311:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/32) registered 00100000:10000000:0.0:1789136259.790124:0:23311:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/32) registered 00100000:10000000:0.0:1789136259.790552:0:23311:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8) registered 00100000:10000000:0.0:1789136259.792673:0:23311:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x20000:0x0] (8/32) registered 00100000:10000000:0.0:1789136259.793110:0:23311:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x2020000:0x0] (8/32) registered 00100000:10000000:0.0:1789136259.793487:0:23311:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x1020000:0x0] (8/32) registered 00100000:10000000:1.0:1789136259.794169:0:23311:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x2010000:0x0] (8/32) registered 00100000:10000000:1.0:1789136259.794545:0:23311:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x10000:0x0] (8/32) registered 00100000:10000000:1.0:1789136259.794822:0:23311:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x1010000:0x0] (8/32) registered 00080000:01000000:1.0:1789136259.795436:0:23311:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0000: register osd-ldiskfs tunable parameters 00000020:00000080:1.0:1789136259.795730:0:23311:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:1.0:1789136259.795737:0:23311:0:(osd_handler.c:8895:osd_obd_connect()) connect #0 00000020:00000080:1.0:1789136259.795747:0:23311:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x559c8745c6de43bc 00000020:01000004:1.0:1789136259.795754:0:23311:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-MDT0000 on device /dev/mapper/mds1_flakey 00000020:01000000:1.0:1789136259.795759:0:23311:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:1.0:1789136259.795764:0:23311:0:(tgt_mount.c:101:server_register_mount()) register mount ffff90a7fa55b800 from MGS 00000020:01000004:1.0:1789136259.795767:0:23311:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:1.0:1789136259.795776:0:23311:0:(genops.c:413:class_newdev()) Allocate new device MGS (ffff90a7e6e9ced8) 00000020:00000080:1.0:1789136259.795784:0:23311:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:1.0:1789136259.795960:0:23311:0:(tgt_mount.c:153:server_get_mount()) get mount ffff90a7fa55b800 from MGS, refs=2 00080000:01000000:1.0:1789136259.795975:0:23311:0:(osd_handler.c:8895:osd_obd_connect()) connect #1 00000020:00000080:1.0:1789136259.795980:0:23311:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x559c8745c6de43ca 00000100:00100000:1.0:1789136259.796079:0:23311:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:1.0:1789136259.796206:0:23311:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:1.0:1789136259.796221:0:23311:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:1.0:1789136259.796705:0:23311:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:1.0:1789136259.796711:0:23311:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:3.0:1789136259.797360:0:23311:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1789136259.797505:0:23311:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:3.0:1789136259.797509:0:23311:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:3.0:1789136259.803848:0:23311:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:3.0:1789136259.803889:0:23311:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:3.0:1789136259.805232:0:23311:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:3.0:1789136259.805241:0:23311:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:0.0:1789136259.814677:0:23320:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789136259.814682:0:23320:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789136259.814684:0:23320:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789136259.814976:0:23321:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789136259.814978:0:23321:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789136259.814980:0:23321:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789136259.815655:0:23311:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:0.0:1789136259.817142:0:23320:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:01000000:3.0:1789136259.824151:0:23311:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 10000000:01000000:0.0:1789136259.826880:0:23323:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:1.0:1789136259.827435:0:23311:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:1.0:1789136259.827489:0:23311:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:1.0:1789136259.828699:0:23311:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:1.0:1789136259.830506:0:23311:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1789136259.830700:0:23311:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:1.0:1789136259.830707:0:23311:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:1.0:1789136259.831712:0:23311:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:1.0:1789136259.831720:0:23311:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:0.0:1789136259.838312:0:23311:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:0.0:1789136259.838325:0:23311:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:2.0:1789136259.845291:0:23311:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:2.0:1789136259.845317:0:23311:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.201.131@tcp' 00000020:01000004:2.0:1789136259.845319:0:23311:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:2.0:1789136259.845370:0:23311:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.201.131@tcp (typ=mgc) 00000020:00000080:2.0:1789136259.845387:0:23311:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.201.131@tcp (ffff90a6c4709a48) 00000020:00000080:2.0:1789136259.845405:0:23311:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:2.0:1789136259.845496:0:23311:0:(ldlm_lib.c:102:import_set_conn()) imp ffff90a7fa3e8000@MGC192.168.201.131@tcp: add connection 192.168.201.131@tcp at head 00010000:00010000:2.0:1789136259.845653:0:23311:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.201.131@tcp-0 is initialized 00000040:01000000:2.0:1789136259.845660:0:23311:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.201.131@tcp ctxt 1 is initialized 00000100:00080000:1.0:1789136259.853475:0:23328:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 10000000:01000000:1.0:1789136259.860791:0:23329:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:3.0:1789136259.860928:0:23311:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.201.131@tcp (uuid b11da215-324d-4c8d-90a5-0b7f26186c4c) 00000020:00000080:3.0:1789136259.860954:0:23311:0:(genops.c:1385:class_connect()) connect: client b11da215-324d-4c8d-90a5-0b7f26186c4c, cookie 0x559c8745c6de43d8 00000100:00080000:3.0:1789136259.860977:0:23311:0:(import.c:510:import_select_connection()) MGC192.168.201.131@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1789136259.860984:0:23311:0:(import.c:624:import_select_connection()) MGC192.168.201.131@tcp: import ffff90a7fa3e8000 using connection 192.168.201.131@tcp/0@lo 00000100:00100000:3.0:1789136259.861019:0:23311:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff90a7ff649a40 x1876044666898048/t0(0) o250->MGC192.168.201.131@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1789136259.861070:0:23311:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import b11da215-324d-4c8d-90a5-0b7f26186c4c->MGS 00000020:01000004:3.0:1789136259.861091:0:23311:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:3.0:1789136259.861096:0:23311:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:3.0:1789136259.861110:0:23311:0:(genops.c:413:class_newdev()) Allocate new device MDS (ffff90a7d184b490) 00000020:00000080:3.0:1789136259.861122:0:23311:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:1.0:1789136259.865226:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7ff649a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b11da215-324d-4c8d-90a5-0b7f26186c4c:3637:1876044666898048:0@lo:250:mount.lustre.0 00000100:00100000:1.0:1789136259.865300:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789136259.871687:0:23311:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1789136259.873278:0:23324:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666898048 00000100:00100000:2.0:1789136259.873294:0:23324:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666898048 00000100:00100000:2.0:1789136259.873355:0:23324:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789136259.873363:0:23324:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7fb157450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3637:x1876044666898048:12345-0@lo:250:mount.lustre.0 00010000:00080000:2.0:1789136259.873394:0:23324:0:(ldlm_lib.c:1482:target_handle_connect()) MGS: connection from b11da215-324d-4c8d-90a5-0b7f26186c4c@0@lo t0 exp 0000000000000000 cur 707 last 0 00000020:00000080:2.0:1789136259.873420:0:23324:0:(genops.c:1385:class_connect()) connect: client b11da215-324d-4c8d-90a5-0b7f26186c4c, cookie 0x559c8745c6de43e6 00000100:00080000:2.0:1789136259.873559:0:23324:0:(import.c:65:import_set_state_nolock()) ffff90a7fa3ed000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789136259.881376:0:23324:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7fb157450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b11da215-324d-4c8d-90a5-0b7f26186c4c+5:3637:x1876044666898048:12345-0@lo:250:mount.lustre.0 Request processed in 8003us (16067us total) trans 0 rc 0/0 00000100:00100000:2.0:1789136259.881391:0:23324:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1789136259.881718:0:23311:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:3.0:1789136259.881726:0:23311:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:0.0:1789136259.882730:0:23311:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:0.0:1789136259.882739:0:23311:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:0.0:1789136259.882972:0:3637:0:(client.c:3125:ptlrpc_free_committed()) MGC192.168.201.131@tcp: committing for last_committed 0 gen 1 00000100:00080000:0.0:1789136259.882983:0:3637:0:(import.c:1132:ptlrpc_connect_interpret()) MGC192.168.201.131@tcp: connect to target with instance 0 00000100:00080000:0.0:1789136259.882992:0:3637:0:(import.c:956:ptlrpc_connect_set_flags()) MGC192.168.201.131@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:0.0:1789136259.883004:0:3637:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:0.0:1789136259.883009:0:3637:0:(import.c:65:import_set_state_nolock()) ffff90a7fa3e8000 MGS: changing import state from CONNECTING to FULL 10000000:01000000:0.0:1789136259.883011:0:3637:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:0.0:1789136259.883025:0:3637:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:0.0:1789136259.883042:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7ff649a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b11da215-324d-4c8d-90a5-0b7f26186c4c:3637:1876044666898048:0@lo:250:mount.lustre.0 00000100:00100000:0.0:1789136259.886823:0:23311:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:0.0:1789136259.886835:0:23311:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:0.0:1789136259.889155:0:23311:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1789136259.889421:0:23311:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:0.0:1789136259.889428:0:23311:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:0.0:1789136259.890122:0:23311:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:0.0:1789136259.890129:0:23311:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:3.0:1789136259.962098:0:23311:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1789136259.962749:0:23311:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:3.0:1789136259.962759:0:23311:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:3.0:1789136259.964690:0:23311:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:3.0:1789136259.964702:0:23311:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:3.0:1789136259.965421:0:23311:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1789136259.975229:0:23311:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:0.0:1789136259.975239:0:23311:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:3.0:1789136259.976408:0:23311:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:3.0:1789136259.976417:0:23311:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:1.0:1789136259.977261:0:23311:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1789136259.977511:0:23311:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:1.0:1789136259.977518:0:23311:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:3.0:1789136259.979227:0:23311:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:3.0:1789136259.979238:0:23311:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:0.0:1789136259.980501:0:23311:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1789136259.980682:0:23311:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:0.0:1789136259.980687:0:23311:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:0.0:1789136259.981429:0:23311:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:0.0:1789136259.981436:0:23311:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:2.0:1789136260.008111:0:23311:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1789136260.008327:0:23311:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:2.0:1789136260.008519:0:23311:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:3.0:1789136260.017917:0:23311:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:3.0:1789136260.017938:0:23311:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:2.0:1789136260.023200:0:23311:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:2.0:1789136260.023218:0:23311:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:3.0:1789136260.024808:0:23311:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:3.0:1789136260.024845:0:23311:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds1_flakey 10000000:01000000:3.0:1789136260.024882:0:23311:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.201.131@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:3.0:1789136260.024989:0:23311:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.201.131@tcp ctxt 0 is initialized 00000020:01000004:3.0:1789136260.025031:0:23311:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.201.131@tcp, index=0000, flags=0x20005 00000020:01000004:3.0:1789136260.025036:0:23311:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1789136260.025038:0:23311:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1789136260.025039:0:23311:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789136260.025041:0:23311:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789136260.025042:0:23311:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789136260.025043:0:23311:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789136260.025045:0:23311:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1789136260.025046:0:23311:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1789136260.025051:0:23311:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789136260.025053:0:23311:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1789136260.025055:0:23311:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020005 00000020:01000004:3.0:1789136260.025058:0:23311:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1789136260.025059:0:23311:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1789136260.025060:0:23311:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789136260.025061:0:23311:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789136260.025062:0:23311:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789136260.025063:0:23311:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789136260.025064:0:23311:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1789136260.025065:0:23311:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1789136260.025066:0:23311:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789136260.025067:0:23311:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1789136260.025090:0:23311:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:3.0:1789136260.025108:0:23311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7ff64a940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b11da215-324d-4c8d-90a5-0b7f26186c4c:23311:1876044666898176:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1789136260.025183:0:23311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789136260.025226:0:23311:0:(client.c:2715:ptlrpc_set_wait()) set ffff90a6c2d5b300 going to sleep for 11 seconds 00000100:00100000:2.0:1789136260.025919:0:23327:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666898176 00000100:00100000:2.0:1789136260.025927:0:23327:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666898176 00000100:00100000:2.0:1789136260.025978:0:23327:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1789136260.025989:0:23327:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7fb154850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b11da215-324d-4c8d-90a5-0b7f26186c4c+5:23311:x1876044666898176:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1789136260.026037:0:23327:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:2.0:1789136260.026040:0:23327:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:2.0:1789136260.026043:0:23327:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0000 is running on 0@lo 10000000:01000000:2.0:1789136260.027100:0:23349:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:1.0:1789136260.028129:0:23327:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 10 20000000:01000000:3.0:1789136260.033638:0:23350:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 0 20000000:01000000:3.0:1789136260.033650:0:23350:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 1 20000000:01000000:3.0:1789136260.033655:0:23350:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0000_UUID is 0 (0) 20000000:01000000:3.0:1789136260.033657:0:23350:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0001_UUID is 1 (1) 00000040:00080000:3.0:1789136260.034286:0:23350:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 20000000:01000000:1.0:1789136260.034631:0:23327:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:1.0:1789136260.034647:0:23327:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:1.0:1789136260.044980:0:23327:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7fb154850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b11da215-324d-4c8d-90a5-0b7f26186c4c+5:23311:x1876044666898176:12345-0@lo:253:mount.lustre.0 Request processed in 18976us (19780us total) trans 0 rc 0/0 00000100:00100000:1.0:1789136260.045007:0:23327:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1789136260.045402:0:23311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7ff64a940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b11da215-324d-4c8d-90a5-0b7f26186c4c:23311:1876044666898176:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1789136260.045425:0:23311:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:3.0:1789136260.045430:0:23311:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1789136260.045432:0:23311:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1789136260.045434:0:23311:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789136260.045435:0:23311:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789136260.045436:0:23311:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789136260.045437:0:23311:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789136260.045444:0:23311:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1789136260.045446:0:23311:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1789136260.045448:0:23311:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789136260.045450:0:23311:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1789136260.045476:0:23311:0:(tgt_mount.c:101:server_register_mount()) register mount ffff90a7fa55b800 from lustre-MDT0000 10000000:01000000:3.0:1789136260.045525:0:23311:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:3.0:1789136260.045548:0:23311:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:3.0:1789136260.045554:0:23311:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff90a6c4709a48 10000000:01000000:3.0:1789136260.045560:0:23311:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1789136260.045573:0:23311:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff90a6c4709a48 from 1 10000000:01000000:3.0:1789136260.045577:0:23311:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1789136260.045630:0:23311:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.131@tcp lock: ffff90a7e1c9f400/0x559c8745c6de43ed lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 23311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136260.045644:0:23311:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.131@tcp lock: ffff90a7e1c9f400/0x559c8745c6de43ed lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 23311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136260.045656:0:23311:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.131@tcp lock: ffff90a7e1c9f400/0x559c8745c6de43ed lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 23311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789136260.045681:0:23311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7ff64a940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b11da215-324d-4c8d-90a5-0b7f26186c4c:23311:1876044666898304:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1789136260.045734:0:23311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789136260.045846:0:23311:0:(client.c:2715:ptlrpc_set_wait()) set ffff90a7f6407540 going to sleep for 11 seconds 00000100:00100000:0.0:1789136260.046243:0:23324:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666898304 00000100:00100000:0.0:1789136260.046254:0:23324:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666898304 00000100:00100000:0.0:1789136260.047306:0:23324:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1789136260.047326:0:23324:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7fb156c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b11da215-324d-4c8d-90a5-0b7f26186c4c+5:23311:x1876044666898304:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1789136260.047351:0:23324:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789136260.047391:0:23324:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90a6c3caf200/0x559c8745c6de43f4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x559c8745c6de43ed expref: -99 pid: 23324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136260.047424:0:23324:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90a6c3caf200/0x559c8745c6de43f4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x559c8745c6de43ed expref: 6 pid: 23324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136260.047438:0:23324:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90a6c3caf200/0x559c8745c6de43f4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x559c8745c6de43ed expref: 6 pid: 23324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136260.047462:0:23324:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a6c3caf200, rc 0) 00000100:00100000:0.0:1789136260.047598:0:23324:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7fb156c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b11da215-324d-4c8d-90a5-0b7f26186c4c+6:23311:x1876044666898304:12345-0@lo:101:mount.lustre.0 Request processed in 281us (1864us total) trans 0 rc 0/0 00000100:00100000:0.0:1789136260.047607:0:23324:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1789136260.048106:0:23311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7ff64a940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b11da215-324d-4c8d-90a5-0b7f26186c4c:23311:1876044666898304:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789136260.048131:0:23311:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.131@tcp lock: ffff90a7e1c9f400/0x559c8745c6de43ed lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x559c8745c6de43f4 expref: -99 pid: 23311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136260.048142:0:23311:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.131@tcp lock: ffff90a7e1c9f400/0x559c8745c6de43ed lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x559c8745c6de43f4 expref: -99 pid: 23311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789136260.048246:0:23311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7ff64a940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b11da215-324d-4c8d-90a5-0b7f26186c4c:23311:1876044666898432:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789136260.048291:0:23311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789136260.050711:0:23311:0:(client.c:2715:ptlrpc_set_wait()) set ffff90a7f6407540 going to sleep for 11 seconds 00000100:00100000:0.0:1789136260.051057:0:23324:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666898432 00000100:00100000:0.0:1789136260.051069:0:23324:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666898432 00000100:00100000:0.0:1789136260.051146:0:23324:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1789136260.051154:0:23324:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7fb155050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b11da215-324d-4c8d-90a5-0b7f26186c4c+6:23311:x1876044666898432:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789136260.051300:0:23324:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7fb155050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b11da215-324d-4c8d-90a5-0b7f26186c4c+6:23311:x1876044666898432:12345-0@lo:501:mount.lustre.0 Request processed in 146us (3009us total) trans 0 rc -2/-2 00000100:00100000:0.0:1789136260.051306:0:23324:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1789136260.051835:0:23311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7ff64a940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b11da215-324d-4c8d-90a5-0b7f26186c4c:23311:1876044666898432:0@lo:501:mount.lustre.0 10000000:01000000:3.0:1789136260.051920:0:23311:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.131@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:3.0:1789136260.051961:0:23311:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.131@tcp lock: ffff90a7e1c9f400/0x559c8745c6de43ed lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x559c8745c6de43f4 expref: -99 pid: 23311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136260.051973:0:23311:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.131@tcp lock: ffff90a7e1c9f400/0x559c8745c6de43ed lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x559c8745c6de43f4 expref: -99 pid: 23311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789136260.051985:0:23311:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff90a7fa55b800 10000000:01000000:3.0:1789136260.051990:0:23311:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1789136260.051995:0:23311:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff90a7fa55b800 10000000:01000000:3.0:1789136260.051998:0:23311:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:3.0:1789136260.052001:0:23311:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff90a7fa55b800 from 1 10000000:01000000:3.0:1789136260.052004:0:23311:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:3.0:1789136260.052056:0:23311:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.131@tcp lock: ffff90a7e1c9f000/0x559c8745c6de43fb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 23311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136260.052062:0:23311:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.131@tcp lock: ffff90a7e1c9f000/0x559c8745c6de43fb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 23311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136260.052071:0:23311:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.131@tcp lock: ffff90a7e1c9f000/0x559c8745c6de43fb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 23311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789136260.052091:0:23311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7ff64a940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b11da215-324d-4c8d-90a5-0b7f26186c4c:23311:1876044666898560:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1789136260.052129:0:23311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789136260.052154:0:23311:0:(client.c:2715:ptlrpc_set_wait()) set ffff90a7f6407540 going to sleep for 11 seconds 00000100:00100000:0.0:1789136260.052374:0:23324:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666898560 00000100:00100000:0.0:1789136260.052379:0:23324:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666898560 00000100:00100000:0.0:1789136260.052413:0:23324:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1789136260.052419:0:23324:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7fb157c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b11da215-324d-4c8d-90a5-0b7f26186c4c+6:23311:x1876044666898560:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1789136260.052430:0:23324:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789136260.052442:0:23324:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90a6c3cae000/0x559c8745c6de4402 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x559c8745c6de43fb expref: -99 pid: 23324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136260.052463:0:23324:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90a6c3cae000/0x559c8745c6de4402 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x559c8745c6de43fb expref: 7 pid: 23324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136260.052472:0:23324:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90a6c3cae000/0x559c8745c6de4402 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x559c8745c6de43fb expref: 7 pid: 23324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136260.052479:0:23324:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a6c3cae000, rc 0) 00000100:00100000:0.0:1789136260.052511:0:23324:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7fb157c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b11da215-324d-4c8d-90a5-0b7f26186c4c+7:23311:x1876044666898560:12345-0@lo:101:mount.lustre.0 Request processed in 91us (381us total) trans 0 rc 0/0 00000100:00100000:0.0:1789136260.052521:0:23324:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1789136260.052657:0:23311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7ff64a940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b11da215-324d-4c8d-90a5-0b7f26186c4c:23311:1876044666898560:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789136260.052671:0:23311:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.131@tcp lock: ffff90a7e1c9f000/0x559c8745c6de43fb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x559c8745c6de4402 expref: -99 pid: 23311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136260.052680:0:23311:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.131@tcp lock: ffff90a7e1c9f000/0x559c8745c6de43fb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x559c8745c6de4402 expref: -99 pid: 23311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789136260.052705:0:23311:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.131@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:3.0:1789136260.052718:0:23311:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.131@tcp lock: ffff90a7e1c9f000/0x559c8745c6de43fb lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x559c8745c6de4402 expref: -99 pid: 23311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136260.052725:0:23311:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.131@tcp lock: ffff90a7e1c9f000/0x559c8745c6de43fb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x559c8745c6de4402 expref: -99 pid: 23311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789136260.052733:0:23311:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:3.0:1789136260.052737:0:23311:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1789136260.052742:0:23311:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff90a7fa55b800 10000000:01000000:3.0:1789136260.052745:0:23311:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:3.0:1789136260.052748:0:23311:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:3.0:1789136260.052749:0:23311:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:3.0:1789136260.052763:0:23311:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.131@tcp lock: ffff90a7e1c9e000/0x559c8745c6de4409 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 23311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136260.052768:0:23311:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.131@tcp lock: ffff90a7e1c9e000/0x559c8745c6de4409 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 23311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136260.052773:0:23311:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.131@tcp lock: ffff90a7e1c9e000/0x559c8745c6de4409 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 23311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789136260.052782:0:23311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7ff64a940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b11da215-324d-4c8d-90a5-0b7f26186c4c:23311:1876044666898688:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1789136260.052818:0:23311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789136260.052840:0:23311:0:(client.c:2715:ptlrpc_set_wait()) set ffff90a7f6407540 going to sleep for 11 seconds 00000100:00100000:0.0:1789136260.053188:0:23324:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666898688 00000100:00100000:0.0:1789136260.053194:0:23324:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666898688 00000100:00100000:0.0:1789136260.053235:0:23324:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1789136260.053242:0:23324:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7fb156450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b11da215-324d-4c8d-90a5-0b7f26186c4c+7:23311:x1876044666898688:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1789136260.053251:0:23324:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789136260.053261:0:23324:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90a6c3cae200/0x559c8745c6de4410 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x559c8745c6de4409 expref: -99 pid: 23324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136260.053278:0:23324:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90a6c3cae200/0x559c8745c6de4410 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x559c8745c6de4409 expref: 8 pid: 23324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136260.053286:0:23324:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90a6c3cae200/0x559c8745c6de4410 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x559c8745c6de4409 expref: 8 pid: 23324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136260.053294:0:23324:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a6c3cae200, rc 0) 00000100:00100000:0.0:1789136260.053331:0:23324:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7fb156450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b11da215-324d-4c8d-90a5-0b7f26186c4c+8:23311:x1876044666898688:12345-0@lo:101:mount.lustre.0 Request processed in 90us (513us total) trans 0 rc 0/0 00000100:00100000:0.0:1789136260.053338:0:23324:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1789136260.053460:0:23311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7ff64a940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b11da215-324d-4c8d-90a5-0b7f26186c4c:23311:1876044666898688:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789136260.053648:0:23311:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.131@tcp lock: ffff90a7e1c9e000/0x559c8745c6de4409 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x559c8745c6de4410 expref: -99 pid: 23311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136260.053667:0:23311:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.131@tcp lock: ffff90a7e1c9e000/0x559c8745c6de4409 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x559c8745c6de4410 expref: -99 pid: 23311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789136260.053742:0:23311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7ff64a940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b11da215-324d-4c8d-90a5-0b7f26186c4c:23311:1876044666898816:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789136260.053777:0:23311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789136260.053962:0:23311:0:(client.c:2715:ptlrpc_set_wait()) set ffff90a7f6407540 going to sleep for 11 seconds 00000100:00100000:0.0:1789136260.054242:0:23324:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666898816 00000100:00100000:0.0:1789136260.054248:0:23324:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666898816 00000100:00100000:0.0:1789136260.054327:0:23324:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1789136260.054335:0:23324:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7fb155c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b11da215-324d-4c8d-90a5-0b7f26186c4c+8:23311:x1876044666898816:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789136260.054526:0:23324:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7fb155c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b11da215-324d-4c8d-90a5-0b7f26186c4c+9:23311:x1876044666898816:12345-0@lo:501:mount.lustre.0 Request processed in 191us (747us total) trans 0 rc 0/0 00000100:00100000:0.0:1789136260.054533:0:23324:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1789136260.054616:0:23311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7ff64a940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b11da215-324d-4c8d-90a5-0b7f26186c4c:23311:1876044666898816:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789136260.054662:0:23311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7ff64a940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b11da215-324d-4c8d-90a5-0b7f26186c4c:23311:1876044666898944:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1789136260.054714:0:23311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789136260.054744:0:23311:0:(client.c:2715:ptlrpc_set_wait()) set ffff90a7f6407540 going to sleep for 11 seconds 00000100:00100000:0.0:1789136260.054905:0:23324:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666898944 00000100:00100000:0.0:1789136260.054926:0:23324:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666898944 00000100:00100000:0.0:1789136260.054949:0:23324:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1789136260.054955:0:23324:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7fb154050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b11da215-324d-4c8d-90a5-0b7f26186c4c+9:23311:x1876044666898944:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1789136260.059354:0:23324:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7fb154050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b11da215-324d-4c8d-90a5-0b7f26186c4c+9:23311:x1876044666898944:12345-0@lo:503:mount.lustre.0 Request processed in 4382us (4623us total) trans 0 rc 0/0 00000100:00100000:0.0:1789136260.059373:0:23324:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1789136260.059527:0:23311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7ff64a940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b11da215-324d-4c8d-90a5-0b7f26186c4c:23311:1876044666898944:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1789136260.060319:0:23351:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7f662ed00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b11da215-324d-4c8d-90a5-0b7f26186c4c:23351:1876044666899072:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789136260.060399:0:23351:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789136260.060456:0:23351:0:(client.c:2715:ptlrpc_set_wait()) set ffff90a7c7881540 going to sleep for 11 seconds 00000100:00100000:2.0:1789136260.060604:0:23327:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666899072 00000100:00100000:2.0:1789136260.060612:0:23327:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666899072 00000100:00100000:2.0:1789136260.060667:0:23327:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1789136260.060678:0:23327:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7fb155850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b11da215-324d-4c8d-90a5-0b7f26186c4c+9:23351:x1876044666899072:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789136260.061724:0:23327:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7fb155850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b11da215-324d-4c8d-90a5-0b7f26186c4c+9:23351:x1876044666899072:12345-0@lo:502:llog_process_th.0 Request processed in 1038us (1316us total) trans 0 rc 0/0 00000100:00100000:2.0:1789136260.061738:0:23327:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1789136260.061770:0:23351:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7f662ed00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b11da215-324d-4c8d-90a5-0b7f26186c4c:23351:1876044666899072:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1789136260.061841:0:23351:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789136260.061893:0:23351:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789136260.061897:0:23351:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:1.0:1789136260.061905:0:23351:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:1.0:1789136260.061908:0:23351:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1789136260.061930:0:23351:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (ffff90a7e6e98000) 00000020:00000080:1.0:1789136260.062208:0:23351:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:1.0:1789136260.062219:0:23351:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:1.0:1789136260.062342:0:23351:0:(osd_handler.c:8895:osd_obd_connect()) connect #2 00000020:00000080:1.0:1789136260.062350:0:23351:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x559c8745c6de441e 00000020:00000080:1.0:1789136260.063137:0:23351:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:1.0:1789136260.063146:0:23351:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789136260.063155:0:23351:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789136260.063158:0:23351:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:1.0:1789136260.063161:0:23351:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789136260.063167:0:23351:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789136260.063169:0:23351:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:1.0:1789136260.063173:0:23351:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1789136260.063194:0:23351:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (ffff90a7e6e99a48) 00000020:00000080:1.0:1789136260.063211:0:23351:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:1.0:1789136260.063215:0:23351:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:1.0:1789136260.063218:0:23351:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:1.0:1789136260.063221:0:23351:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:1.0:1789136260.063228:0:23351:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1789136260.063294:0:23351:0:(tgt_mount.c:153:server_get_mount()) get mount ffff90a7fa55b800 from lustre-MDT0000, refs=3 00000020:00000080:1.0:1789136260.063309:0:23351:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (ffff90a7e6e9b490) 00000020:00000080:1.0:1789136260.063317:0:23351:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:1.0:1789136260.063371:0:23351:0:(lod_dev.c:2292:lod_obd_connect()) connect #0 00000020:00000080:1.0:1789136260.063378:0:23351:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x559c8745c6de4433 00000020:00000080:1.0:1789136260.063486:0:23351:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:1.0:1789136260.063494:0:23351:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:1.0:1789136260.063500:0:23351:0:(genops.c:1385:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0x559c8745c6de443a 00080000:01000000:1.0:1789136260.063520:0:23351:0:(osd_handler.c:8895:osd_obd_connect()) connect #3 00000020:00000080:1.0:1789136260.063526:0:23351:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x559c8745c6de4441 00010000:00010000:2.0:1789136260.184827:0:23351:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:00000004:2.0:1789136260.187284:0:23351:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 3, last_transno is 8589934628 00000001:00080000:2.0:1789136260.188494:0:23351:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:3.0:1789136260.192619:0:23351:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (ffff90a7d1848000) 00000020:00000080:3.0:1789136260.192657:0:23351:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:3.0:1789136260.192782:0:23351:0:(osd_handler.c:8895:osd_obd_connect()) connect #4 00000020:00000080:3.0:1789136260.192804:0:23351:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x559c8745c6de444f 00000020:00000080:2.0:1789136260.195414:0:23351:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:3.0:1789136260.207170:0:23351:0:(genops.c:1385:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0x559c8745c6de4456 00000020:00000080:3.0:1789136260.208148:0:23351:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:3.0:1789136260.208160:0:23351:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789136260.208168:0:23351:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789136260.208170:0:23351:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:3.0:1789136260.208173:0:23351:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:3.0:1789136260.208175:0:23351:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #9 00000020:01000000:3.0:1789136260.208177:0:23351:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1789136260.208178:0:23351:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1789136260.208180:0:23351:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:3.0:1789136260.208182:0:23351:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789136260.208184:0:23351:0:(obd_config.c:1563:class_process_config()) marker 9 (0x6) lustre sys.timeout 00000020:01000000:3.0:1789136260.208193:0:23351:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789136260.208199:0:23351:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789136260.208200:0:23351:0:(obd_config.c:1563:class_process_config()) marker 10 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:3.0:1789136260.208204:0:23351:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:3.0:1789136260.208245:0:23351:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:3.0:1789136260.208263:0:23351:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789136260.208266:0:23351:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789136260.208267:0:23351:0:(obd_config.c:1563:class_process_config()) marker 10 (0x2) lustre-MDT0000 mdt.identity_upcall 00000020:01000000:3.0:1789136260.208269:0:23351:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789136260.208272:0:23351:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789136260.208273:0:23351:0:(obd_config.c:1563:class_process_config()) marker 17 (0x1) lustre-MDT0001 add osp 00000020:00000080:3.0:1789136260.208276:0:23351:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1789136260.208281:0:23351:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.201.131@tcp to nid 0x20000c0a8c983 (192.168.201.131@tcp) 00000020:00000080:3.0:1789136260.208306:0:23351:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1789136260.208322:0:23351:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osp-MDT0000 (ffff90a7d1849a48) 00000020:00000080:3.0:1789136260.208335:0:23351:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type osp with refcount 2 00000020:00000080:3.0:1789136260.208339:0:23351:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1789136260.208390:0:23351:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0001-osp-MDT0000: connect to lustre-MDT0000-osd (lustre-MDT0001-osp-MDT0000) 00080000:01000000:3.0:1789136260.208395:0:23351:0:(osd_handler.c:8895:osd_obd_connect()) connect #5 00000020:00000080:3.0:1789136260.208401:0:23351:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x559c8745c6de4464 00010000:00080000:3.0:1789136260.208436:0:23351:0:(ldlm_lib.c:102:import_set_conn()) imp ffff90a7fa659000@lustre-MDT0001-osp-MDT0000: add connection 192.168.201.131@tcp at head 00010000:00010000:3.0:1789136260.219297:0:23351:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-osp-MDT0000-1 is initialized 00000020:00000080:3.0:1789136260.220419:0:23351:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1789136260.220435:0:23351:0:(obd_config.c:1472:class_process_config()) processing cmd: cf014 00000004:01000000:3.0:1789136260.220471:0:23351:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0001_UUID idx:1 gen:1 00000020:00000080:3.0:1789136260.220494:0:23351:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x559c8745c6de446b 00000100:00080000:3.0:1789136260.220505:0:23351:0:(import.c:510:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1789136260.220512:0:23351:0:(import.c:624:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff90a7fa659000 using connection 192.168.201.131@tcp/0@lo 00000100:00100000:3.0:1789136260.220554:0:23351:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff90a7ff64a940 x1876044666899200/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1789136260.220622:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7ff64a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3637:1876044666899200:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1789136260.220697:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789136260.220954:0:23338:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666899200 00000100:00100000:1.0:1789136260.220962:0:23338:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666899200 00000100:00100000:1.0:1789136260.220998:0:23338:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789136260.221005:0:23338:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7fa3bf840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3637:x1876044666899200:12345-0@lo:38:llog_process_th.0 00010000:00020000:1.0:1789136260.221029:0:23338:0:(ldlm_lib.c:1228:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00080000:3.0:1789136260.224208:0:23351:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000020:01000000:3.0:1789136260.224337:0:23351:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789136260.224345:0:23351:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789136260.224348:0:23351:0:(obd_config.c:1563:class_process_config()) marker 17 (0x2) lustre-MDT0001 add osp 00000020:01000000:3.0:1789136260.224352:0:23351:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:3.0:1789136260.224354:0:23351:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #19 00000020:01000000:3.0:1789136260.224356:0:23351:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1789136260.224358:0:23351:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1789136260.224359:0:23351:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:3.0:1789136260.224362:0:23351:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789136260.224363:0:23351:0:(obd_config.c:1563:class_process_config()) marker 19 (0x6) lustre sys.timeout 00000020:01000000:3.0:1789136260.224366:0:23351:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1789136260.224371:0:23351:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:3.0:1789136260.224374:0:23351:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789136260.224376:0:23351:0:(obd_config.c:1563:class_process_config()) marker 22 (0x1) lustre-OST0000 add osc 00000020:00000080:3.0:1789136260.224379:0:23351:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1789136260.224382:0:23351:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.201.131@tcp to nid 0x20000c0a8c983 (192.168.201.131@tcp) 00000020:01000000:3.0:1789136260.224409:0:23351:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:3.0:1789136260.224411:0:23351:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1789136260.224429:0:23351:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff90a7d184ced8) 00000020:00000080:3.0:1789136260.224451:0:23351:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osp with refcount 2 00000020:00000080:3.0:1789136260.224456:0:23351:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1789136260.224547:0:23351:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:3.0:1789136260.224554:0:23351:0:(osd_handler.c:8895:osd_obd_connect()) connect #6 00000020:00000080:3.0:1789136260.224561:0:23351:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x559c8745c6de4479 00010000:00080000:3.0:1789136260.224591:0:23351:0:(ldlm_lib.c:102:import_set_conn()) imp ffff90a7ff553800@lustre-OST0000-osc-MDT0000: add connection 192.168.201.131@tcp at head 00010000:00010000:3.0:1789136260.225327:0:23351:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-2 is initialized 00000040:01000000:3.0:1789136260.232745:0:23351:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:3.0:1789136260.233177:0:23351:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:3.0:1789136260.234896:0:23351:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1789136260.236132:0:23351:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].3, 64 off8384 00000040:00080000:3.0:1789136260.246141:0:23351:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x10:0x0].1, 64 off8256 00000040:00080000:3.0:1789136260.246614:0:23357:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:3.0:1789136260.246625:0:23357:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x10:0x0] at index 3 of catalog [0x1:0x2:0x0] 00000020:00000080:0.0:1789136260.248279:0:23351:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1789136260.248294:0:23351:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:0.0:1789136260.248337:0:23351:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:0.0:1789136260.248360:0:23351:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x559c8745c6de4480 00000100:00080000:0.0:1789136260.248372:0:23351:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1789136260.248378:0:23351:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff90a7ff553800 using connection 192.168.201.131@tcp/0@lo 00000100:00100000:0.0:1789136260.248415:0:23351:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff90a7fa3bd680 x1876044666899328/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1789136260.248446:0:23351:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:0.0:1789136260.248524:0:23351:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789136260.248528:0:23351:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789136260.248530:0:23351:0:(obd_config.c:1563:class_process_config()) marker 22 (0x2) lustre-OST0000 add osc 00000020:01000000:0.0:1789136260.248533:0:23351:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:0.0:1789136260.248536:0:23351:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #27 00000020:01000000:0.0:1789136260.248538:0:23351:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1789136260.248540:0:23351:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1789136260.248541:0:23351:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:0.0:1789136260.248544:0:23351:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789136260.248545:0:23351:0:(obd_config.c:1563:class_process_config()) marker 27 (0x6) lustre sys.timeout 00000020:01000000:0.0:1789136260.248548:0:23351:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1789136260.248553:0:23351:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:0.0:1789136260.248565:0:23351:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789136260.248566:0:23351:0:(obd_config.c:1563:class_process_config()) marker 30 (0x1) lustre-OST0001 add osc 00000020:00000080:0.0:1789136260.248569:0:23351:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:0.0:1789136260.248573:0:23351:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.201.131@tcp to nid 0x20000c0a8c983 (192.168.201.131@tcp) 00000020:01000000:0.0:1789136260.248600:0:23351:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:0.0:1789136260.248603:0:23351:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1789136260.248616:0:23351:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff90a8018d1a48) 00000020:00000080:0.0:1789136260.248629:0:23351:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type osp with refcount 2 00000020:00000080:0.0:1789136260.248635:0:23351:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000100:00100000:2.0:1789136260.248898:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7fa3bd680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3637:1876044666899328:0@lo:8:llog_process_th.0 00000400:00000100:2.0:1789136260.248968:0:3637:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1876044666899328 offset 0 length 520: 4 00000004:00080000:0.0:1789136260.249092:0:23351:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:0.0:1789136260.249101:0:23351:0:(osd_handler.c:8895:osd_obd_connect()) connect #7 00000020:00000080:0.0:1789136260.249108:0:23351:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x559c8745c6de448e 00010000:00080000:0.0:1789136260.249147:0:23351:0:(ldlm_lib.c:102:import_set_conn()) imp ffff90a6c228c000@lustre-OST0001-osc-MDT0000: add connection 192.168.201.131@tcp at head 00010000:00010000:0.0:1789136260.249342:0:23351:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-3 is initialized 00000040:01000000:0.0:1789136260.249411:0:23351:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:0.0:1789136260.249428:0:23351:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000100:00100000:1.0:1789136260.251240:0:23338:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7fa3bf840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3637:x1876044666899200:12345-0@lo:38:llog_process_th.0 Request processed in 30227us (30535us total) trans 0 rc -19/-19 00000100:00100000:1.0:1789136260.251255:0:23338:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:2.0:1789136260.254080:0:3637:0:(import.c:65:import_set_state_nolock()) ffff90a7fa659000 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1789136260.254096:0:3637:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1789136260.254101:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7ff64a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3637:1876044666899200:0@lo:38:llog_process_th.0 00000040:00080000:0.0:1789136260.256429:0:23351:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1789136260.256675:0:23351:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].3, 64 off8384 00000040:00080000:0.0:1789136260.257050:0:23351:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x12:0x0].1, 64 off8256 00000040:00080000:2.0:1789136260.261083:0:23359:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:2.0:1789136260.261092:0:23359:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x12:0x0] at index 3 of catalog [0x1:0x5:0x0] 00000020:00000080:1.0:1789136260.262605:0:23351:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1789136260.262623:0:23351:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:1.0:1789136260.262666:0:23351:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:1.0:1789136260.262688:0:23351:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x559c8745c6de4495 00000100:00080000:1.0:1789136260.262711:0:23351:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1789136260.262718:0:23351:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff90a6c228c000 using connection 192.168.201.131@tcp/0@lo 00000100:00100000:1.0:1789136260.262754:0:23351:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff90a7f662ed00 x1876044666899456/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1789136260.262781:0:23351:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:1.0:1789136260.262849:0:23351:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789136260.262881:0:23351:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789136260.262883:0:23351:0:(obd_config.c:1563:class_process_config()) marker 30 (0x2) lustre-OST0001 add osc 00000020:01000000:1.0:1789136260.262887:0:23351:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789136260.262892:0:23351:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789136260.262893:0:23351:0:(obd_config.c:1563:class_process_config()) marker 35 (0x1) lustre sys.timeout 00000020:00000080:1.0:1789136260.262896:0:23351:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1789136260.262898:0:23351:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:1.0:1789136260.262901:0:23351:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789136260.262903:0:23351:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789136260.262912:0:23351:0:(obd_config.c:1563:class_process_config()) marker 35 (0x2) lustre sys.timeout 00000020:01000000:1.0:1789136260.262915:0:23351:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789136260.262917:0:23351:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789136260.262918:0:23351:0:(obd_config.c:1563:class_process_config()) marker 40 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1789136260.262923:0:23351:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:1.0:1789136260.262957:0:23351:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7f662d680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b11da215-324d-4c8d-90a5-0b7f26186c4c:23351:1876044666899584:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789136260.263114:0:23351:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789136260.263160:0:23351:0:(client.c:2715:ptlrpc_set_wait()) set ffff90a7c7881840 going to sleep for 11 seconds 00000100:00100000:2.0:1789136260.263459:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7f662ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3637:1876044666899456:0@lo:8:llog_process_th.0 00000400:00000100:2.0:1789136260.263491:0:3637:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1876044666899456 offset 0 length 520: 4 00000100:00100000:2.0:1789136260.263523:0:23325:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666899584 00000100:00100000:2.0:1789136260.263529:0:23325:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666899584 00000100:00100000:2.0:1789136260.263577:0:23325:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1789136260.263587:0:23325:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7fb155450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b11da215-324d-4c8d-90a5-0b7f26186c4c+9:23351:x1876044666899584:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789136260.263734:0:23325:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7fb155450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b11da215-324d-4c8d-90a5-0b7f26186c4c+9:23351:x1876044666899584:12345-0@lo:502:llog_process_th.0 Request processed in 147us (619us total) trans 0 rc 0/0 00000100:00100000:2.0:1789136260.263749:0:23325:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1789136260.265654:0:23351:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7f662d680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b11da215-324d-4c8d-90a5-0b7f26186c4c:23351:1876044666899584:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1789136260.265714:0:23351:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789136260.265726:0:23351:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789136260.265728:0:23351:0:(obd_config.c:1563:class_process_config()) marker 40 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1789136260.265732:0:23351:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 46 count 46 00000020:01000000:0.0:1789136260.266301:0:23311:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-45 (rc=0) 10000000:01000000:0.0:1789136260.266327:0:23311:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.131@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:0.0:1789136260.266343:0:23311:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.131@tcp lock: ffff90a7e1c9e000/0x559c8745c6de4409 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x559c8745c6de4410 expref: -99 pid: 23311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136260.266355:0:23311:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.131@tcp lock: ffff90a7e1c9e000/0x559c8745c6de4409 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x559c8745c6de4410 expref: -99 pid: 23311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789136260.266365:0:23311:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff90a7fa55b800 from 1 10000000:01000000:0.0:1789136260.266368:0:23311:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1789136260.266410:0:23311:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.131@tcp lock: ffff90a6c3caee00/0x559c8745c6de449c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 23311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136260.266433:0:23311:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.131@tcp lock: ffff90a6c3caee00/0x559c8745c6de449c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 23311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136260.266444:0:23311:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.131@tcp lock: ffff90a6c3caee00/0x559c8745c6de449c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 23311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789136260.266466:0:23311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7fa3bed00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b11da215-324d-4c8d-90a5-0b7f26186c4c:23311:1876044666899712:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1789136260.266528:0:23311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789136260.266579:0:23311:0:(client.c:2715:ptlrpc_set_wait()) set ffff90a7ef985e40 going to sleep for 11 seconds 00000100:00100000:1.0:1789136260.266722:0:23327:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666899712 00000100:00100000:1.0:1789136260.266729:0:23327:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666899712 00000100:00100000:1.0:1789136260.266780:0:23327:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1789136260.266799:0:23327:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7fb156850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b11da215-324d-4c8d-90a5-0b7f26186c4c+9:23311:x1876044666899712:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789136260.266813:0:23327:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789136260.266828:0:23327:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90a7c167d600/0x559c8745c6de44a3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x559c8745c6de449c expref: -99 pid: 23327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136260.266850:0:23327:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90a7c167d600/0x559c8745c6de44a3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x559c8745c6de449c expref: 10 pid: 23327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136260.267365:0:23327:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90a7c167d600/0x559c8745c6de44a3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x559c8745c6de449c expref: 10 pid: 23327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136260.267374:0:23327:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a7c167d600, rc 0) 00000100:00100000:0.0:1789136260.267595:0:23327:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7fb156850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b11da215-324d-4c8d-90a5-0b7f26186c4c+10:23311:x1876044666899712:12345-0@lo:101:mount.lustre.0 Request processed in 805us (1066us total) trans 0 rc 0/0 00000100:00100000:0.0:1789136260.267604:0:23327:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1789136260.267683:0:23311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7fa3bed00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b11da215-324d-4c8d-90a5-0b7f26186c4c:23311:1876044666899712:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789136260.267900:0:23311:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.131@tcp lock: ffff90a6c3caee00/0x559c8745c6de449c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x559c8745c6de44a3 expref: -99 pid: 23311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136260.267911:0:23311:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.131@tcp lock: ffff90a6c3caee00/0x559c8745c6de449c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x559c8745c6de44a3 expref: -99 pid: 23311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789136260.268836:0:23311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7ff648780 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b11da215-324d-4c8d-90a5-0b7f26186c4c:23311:1876044666899840:0@lo:256:mount.lustre.0 00000100:00100000:3.0:1789136260.269183:0:23311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789136260.269273:0:23311:0:(client.c:2715:ptlrpc_set_wait()) set ffff90a7d28c03c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789136260.269340:0:23324:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666899840 00000100:00100000:0.0:1789136260.269346:0:23324:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666899840 00000100:00100000:0.0:1789136260.269443:0:23324:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1789136260.269455:0:23324:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7fb156050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b11da215-324d-4c8d-90a5-0b7f26186c4c+10:23311:x1876044666899840:12345-0@lo:256:mount.lustre.0 20000000:01000000:0.0:1789136260.269479:0:23324:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:0.0:1789136260.269486:0:23324:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:0.0:1789136260.269564:0:23324:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7fb156050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b11da215-324d-4c8d-90a5-0b7f26186c4c+10:23311:x1876044666899840:12345-0@lo:256:mount.lustre.0 Request processed in 111us (382us total) trans 0 rc 0/0 00000100:00100000:0.0:1789136260.269572:0:23324:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1789136260.269642:0:23311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7ff648780 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b11da215-324d-4c8d-90a5-0b7f26186c4c:23311:1876044666899840:0@lo:256:mount.lustre.0 10000000:01000000:3.0:1789136260.270314:0:23311:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.131@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1789136260.270337:0:23311:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.131@tcp lock: ffff90a6c3caee00/0x559c8745c6de449c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x559c8745c6de44a3 expref: -99 pid: 23311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136260.270348:0:23311:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.131@tcp lock: ffff90a6c3caee00/0x559c8745c6de449c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x559c8745c6de44a3 expref: -99 pid: 23311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789136260.270356:0:23311:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff90a7fa55b800 from 1 10000000:01000000:3.0:1789136260.270359:0:23311:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1789136260.270390:0:23311:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.131@tcp lock: ffff90a7e1c9f600/0x559c8745c6de44aa lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 23311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136260.270398:0:23311:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.131@tcp lock: ffff90a7e1c9f600/0x559c8745c6de44aa lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 23311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136260.270406:0:23311:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.131@tcp lock: ffff90a7e1c9f600/0x559c8745c6de44aa lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 23311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789136260.270431:0:23311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7ff648780 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b11da215-324d-4c8d-90a5-0b7f26186c4c:23311:1876044666899968:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1789136260.270465:0:23311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789136260.270956:0:23311:0:(client.c:2715:ptlrpc_set_wait()) set ffff90a7d28c03c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789136260.271141:0:23325:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666899968 00000100:00100000:2.0:1789136260.271148:0:23325:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666899968 00000100:00100000:2.0:1789136260.271184:0:23325:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1789136260.271193:0:23325:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7fb157050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b11da215-324d-4c8d-90a5-0b7f26186c4c+10:23311:x1876044666899968:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789136260.271204:0:23325:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789136260.271220:0:23325:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90a7d1879200/0x559c8745c6de44b1 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x559c8745c6de44aa expref: -99 pid: 23325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136260.271242:0:23325:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90a7d1879200/0x559c8745c6de44b1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x559c8745c6de44aa expref: 11 pid: 23325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136260.271253:0:23325:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90a7d1879200/0x559c8745c6de44b1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x559c8745c6de44aa expref: 11 pid: 23325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136260.271262:0:23325:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a7d1879200, rc 0) 00000100:00100000:2.0:1789136260.271348:0:23325:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7fb157050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b11da215-324d-4c8d-90a5-0b7f26186c4c+11:23311:x1876044666899968:12345-0@lo:101:mount.lustre.0 Request processed in 155us (880us total) trans 0 rc 0/0 00000100:00100000:2.0:1789136260.271355:0:23325:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1789136260.271489:0:23311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7ff648780 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b11da215-324d-4c8d-90a5-0b7f26186c4c:23311:1876044666899968:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789136260.271503:0:23311:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.131@tcp lock: ffff90a7e1c9f600/0x559c8745c6de44aa lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x559c8745c6de44b1 expref: -99 pid: 23311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136260.271512:0:23311:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.131@tcp lock: ffff90a7e1c9f600/0x559c8745c6de44aa lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x559c8745c6de44b1 expref: -99 pid: 23311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789136260.271578:0:23311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7ff648780 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b11da215-324d-4c8d-90a5-0b7f26186c4c:23311:1876044666900096:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789136260.271608:0:23311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789136260.271681:0:23311:0:(client.c:2715:ptlrpc_set_wait()) set ffff90a7d28c03c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789136260.273909:0:23325:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666900096 00000100:00100000:2.0:1789136260.273920:0:23325:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666900096 00000100:00100000:2.0:1789136260.273973:0:23325:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1789136260.273984:0:23325:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7fb157850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b11da215-324d-4c8d-90a5-0b7f26186c4c+11:23311:x1876044666900096:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789136260.275881:0:23325:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7fb157850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b11da215-324d-4c8d-90a5-0b7f26186c4c+11:23311:x1876044666900096:12345-0@lo:501:mount.lustre.0 Request processed in 1868us (4241us total) trans 0 rc 0/0 00000100:00100000:2.0:1789136260.275895:0:23325:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1789136260.276277:0:23311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7ff648780 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b11da215-324d-4c8d-90a5-0b7f26186c4c:23311:1876044666900096:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789136260.276338:0:23311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7fa3bcb40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b11da215-324d-4c8d-90a5-0b7f26186c4c:23311:1876044666900224:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1789136260.276396:0:23311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789136260.276441:0:23311:0:(client.c:2715:ptlrpc_set_wait()) set ffff90a7ef985e40 going to sleep for 11 seconds 00000100:00100000:1.0:1789136260.276502:0:23327:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666900224 00000100:00100000:1.0:1789136260.276509:0:23327:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666900224 00000100:00100000:1.0:1789136260.276565:0:23327:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1789136260.276573:0:23327:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7fb158c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b11da215-324d-4c8d-90a5-0b7f26186c4c+11:23311:x1876044666900224:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1789136260.276674:0:23327:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7fb158c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b11da215-324d-4c8d-90a5-0b7f26186c4c+11:23311:x1876044666900224:12345-0@lo:503:mount.lustre.0 Request processed in 102us (278us total) trans 0 rc 0/0 00000100:00100000:1.0:1789136260.276682:0:23327:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1789136260.277132:0:23311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7fa3bcb40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b11da215-324d-4c8d-90a5-0b7f26186c4c:23311:1876044666900224:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1789136260.277582:0:23361:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7fa3bc000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b11da215-324d-4c8d-90a5-0b7f26186c4c:23361:1876044666900352:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789136260.277637:0:23361:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789136260.277676:0:23361:0:(client.c:2715:ptlrpc_set_wait()) set ffff90a7e07c3a80 going to sleep for 11 seconds 00000100:00100000:2.0:1789136260.277800:0:23325:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666900352 00000100:00100000:2.0:1789136260.277805:0:23325:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666900352 00000100:00100000:2.0:1789136260.277840:0:23325:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1789136260.277848:0:23325:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7fb158450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b11da215-324d-4c8d-90a5-0b7f26186c4c+11:23361:x1876044666900352:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789136260.278431:0:23325:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7fb158450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b11da215-324d-4c8d-90a5-0b7f26186c4c+11:23361:x1876044666900352:12345-0@lo:502:llog_process_th.0 Request processed in 581us (793us total) trans 0 rc 0/0 00000100:00100000:2.0:1789136260.278440:0:23325:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1789136260.278622:0:23361:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7fa3bc000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b11da215-324d-4c8d-90a5-0b7f26186c4c:23361:1876044666900352:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1789136260.278649:0:23361:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789136260.278659:0:23361:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789136260.278661:0:23361:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1789136260.278669:0:23361:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff90a7fa55b800 00000020:00000080:0.0:1789136260.278672:0:23361:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1789136260.278679:0:23361:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789136260.278682:0:23361:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789136260.278683:0:23361:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:0.0:1789136260.278686:0:23361:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789136260.278688:0:23361:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789136260.278690:0:23361:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1789136260.278693:0:23361:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff90a7fa55b800 00000020:00000080:0.0:1789136260.278695:0:23361:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1789136260.278771:0:23361:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789136260.278775:0:23361:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789136260.278776:0:23361:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:0.0:1789136260.278779:0:23361:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789136260.278782:0:23361:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789136260.278783:0:23361:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre lod.lustre-MDT0000-mdtlov.enable_compr_rotational 00000020:01000000:0.0:1789136260.278798:0:23361:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff90a7fa55b800 00000020:00000080:0.0:1789136260.278801:0:23361:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1789136260.278821:0:23361:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789136260.278824:0:23361:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789136260.278825:0:23361:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre lod.lustre-MDT0000-mdtlov.enable_compr_rotational 00000020:01000000:0.0:1789136260.278827:0:23361:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789136260.278830:0:23361:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789136260.278831:0:23361:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre lod.lustre-MDT0001-mdtlov.enable_compr_rotational 00000020:01000000:0.0:1789136260.278834:0:23361:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff90a7fa55b800 00000020:00000080:0.0:1789136260.278842:0:23361:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1789136260.278886:0:23361:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789136260.278890:0:23361:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789136260.278891:0:23361:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre lod.lustre-MDT0001-mdtlov.enable_compr_rotational 00000020:01000000:0.0:1789136260.278893:0:23361:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789136260.278896:0:23361:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789136260.278897:0:23361:0:(obd_config.c:1563:class_process_config()) marker 6 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1789136260.278901:0:23361:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff90a7fa55b800 00000020:00000080:0.0:1789136260.278902:0:23361:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1789136260.278919:0:23361:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789136260.278922:0:23361:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789136260.278924:0:23361:0:(obd_config.c:1563:class_process_config()) marker 6 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1789136260.278926:0:23361:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789136260.278928:0:23361:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789136260.278930:0:23361:0:(obd_config.c:1563:class_process_config()) marker 7 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:0.0:1789136260.278933:0:23361:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff90a7fa55b800 00000020:00000080:0.0:1789136260.278935:0:23361:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1789136260.278975:0:23361:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7fa3bc000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b11da215-324d-4c8d-90a5-0b7f26186c4c:23361:1876044666900480:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789136260.279015:0:23361:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789136260.279063:0:23361:0:(client.c:2715:ptlrpc_set_wait()) set ffff90a7d89d23c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789136260.279126:0:23324:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666900480 00000100:00100000:2.0:1789136260.279131:0:23324:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666900480 00000100:00100000:2.0:1789136260.279170:0:23324:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1789136260.279179:0:23324:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7fb15b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b11da215-324d-4c8d-90a5-0b7f26186c4c+11:23361:x1876044666900480:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789136260.279258:0:23324:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7fb15b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b11da215-324d-4c8d-90a5-0b7f26186c4c+11:23361:x1876044666900480:12345-0@lo:502:llog_process_th.0 Request processed in 79us (242us total) trans 0 rc 0/0 00000100:00100000:2.0:1789136260.279265:0:23324:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1789136260.289755:0:23361:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7fa3bc000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b11da215-324d-4c8d-90a5-0b7f26186c4c:23361:1876044666900480:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1789136260.289812:0:23361:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789136260.289823:0:23361:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789136260.289826:0:23361:0:(obd_config.c:1563:class_process_config()) marker 7 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:0.0:1789136260.289831:0:23361:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 19 count 19 00000020:01000000:0.0:1789136260.290920:0:23311:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-18 (rc=0) 10000000:01000000:0.0:1789136260.290951:0:23311:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.131@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1789136260.290975:0:23311:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.131@tcp lock: ffff90a7e1c9f600/0x559c8745c6de44aa lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x559c8745c6de44b1 expref: -99 pid: 23311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136260.290987:0:23311:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.131@tcp lock: ffff90a7e1c9f600/0x559c8745c6de44aa lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x559c8745c6de44b1 expref: -99 pid: 23311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789136260.291066:0:23311:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:0.0:1789136260.291069:0:23311:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff90a7fa55b800 10000000:01000000:0.0:1789136260.291072:0:23311:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff90a7fa55b800 10000000:01000000:0.0:1789136260.291077:0:23311:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1789136260.291083:0:23311:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff90a7fa55b800 from 1 10000000:01000000:0.0:1789136260.291086:0:23311:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1789136260.291124:0:23311:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.131@tcp lock: ffff90a6c3cafc00/0x559c8745c6de44b8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 23311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136260.291132:0:23311:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.131@tcp lock: ffff90a6c3cafc00/0x559c8745c6de44b8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 23311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136260.291143:0:23311:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.131@tcp lock: ffff90a6c3cafc00/0x559c8745c6de44b8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 23311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789136260.291164:0:23311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7fa3bc000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b11da215-324d-4c8d-90a5-0b7f26186c4c:23311:1876044666900608:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1789136260.291227:0:23311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789136260.291268:0:23311:0:(client.c:2715:ptlrpc_set_wait()) set ffff90a7f6407f00 going to sleep for 11 seconds 00000100:00100000:1.0:1789136260.295181:0:23327:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666900608 00000100:00100000:1.0:1789136260.295196:0:23327:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666900608 00000100:00100000:1.0:1789136260.298441:0:23327:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1789136260.298467:0:23327:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7fb158850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b11da215-324d-4c8d-90a5-0b7f26186c4c+11:23311:x1876044666900608:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789136260.298490:0:23327:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789136260.298510:0:23327:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90a7c167c400/0x559c8745c6de44bf lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x559c8745c6de44b8 expref: -99 pid: 23327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136260.298541:0:23327:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90a7c167c400/0x559c8745c6de44bf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x559c8745c6de44b8 expref: 12 pid: 23327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136260.298553:0:23327:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90a7c167c400/0x559c8745c6de44bf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x559c8745c6de44b8 expref: 12 pid: 23327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136260.298563:0:23327:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a7c167c400, rc 0) 00000100:00100000:1.0:1789136260.298654:0:23327:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7fb158850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b11da215-324d-4c8d-90a5-0b7f26186c4c+12:23311:x1876044666900608:12345-0@lo:101:mount.lustre.0 Request processed in 199us (7427us total) trans 0 rc 0/0 00000100:00100000:1.0:1789136260.298662:0:23327:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1789136260.308199:0:23311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7fa3bc000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b11da215-324d-4c8d-90a5-0b7f26186c4c:23311:1876044666900608:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789136260.308231:0:23311:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.131@tcp lock: ffff90a6c3cafc00/0x559c8745c6de44b8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x559c8745c6de44bf expref: -99 pid: 23311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136260.308244:0:23311:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.131@tcp lock: ffff90a6c3cafc00/0x559c8745c6de44b8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x559c8745c6de44bf expref: -99 pid: 23311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789136260.308344:0:23311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7c14b52c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b11da215-324d-4c8d-90a5-0b7f26186c4c:23311:1876044666900736:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789136260.308418:0:23311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789136260.308478:0:23311:0:(client.c:2715:ptlrpc_set_wait()) set ffff90a7efa89b40 going to sleep for 11 seconds 00000100:00100000:0.0:1789136260.308584:0:23325:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666900736 00000100:00100000:0.0:1789136260.308591:0:23325:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666900736 00000100:00100000:0.0:1789136260.308647:0:23325:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1789136260.308659:0:23325:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7fb15ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b11da215-324d-4c8d-90a5-0b7f26186c4c+12:23311:x1876044666900736:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789136260.308799:0:23325:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7fb15ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b11da215-324d-4c8d-90a5-0b7f26186c4c+12:23311:x1876044666900736:12345-0@lo:501:mount.lustre.0 Request processed in 143us (381us total) trans 0 rc 0/0 00000100:00100000:0.0:1789136260.308808:0:23325:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1789136260.310998:0:23311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7c14b52c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b11da215-324d-4c8d-90a5-0b7f26186c4c:23311:1876044666900736:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789136260.311267:0:23311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7c14b52c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b11da215-324d-4c8d-90a5-0b7f26186c4c:23311:1876044666900864:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1789136260.311335:0:23311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789136260.311382:0:23311:0:(client.c:2715:ptlrpc_set_wait()) set ffff90a7efa89b40 going to sleep for 11 seconds 00000100:00100000:0.0:1789136260.311456:0:23325:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666900864 00000100:00100000:0.0:1789136260.311463:0:23325:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666900864 00000100:00100000:0.0:1789136260.311526:0:23325:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1789136260.311542:0:23325:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7fb159050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b11da215-324d-4c8d-90a5-0b7f26186c4c+12:23311:x1876044666900864:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1789136260.311649:0:23325:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7fb159050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b11da215-324d-4c8d-90a5-0b7f26186c4c+12:23311:x1876044666900864:12345-0@lo:503:mount.lustre.0 Request processed in 108us (314us total) trans 0 rc 0/0 00000100:00100000:0.0:1789136260.311656:0:23325:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1789136260.313334:0:23311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7c14b52c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b11da215-324d-4c8d-90a5-0b7f26186c4c:23311:1876044666900864:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1789136260.316814:0:23365:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7fa3bd2c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b11da215-324d-4c8d-90a5-0b7f26186c4c:23365:1876044666900992:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789136260.316931:0:23365:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789136260.316987:0:23365:0:(client.c:2715:ptlrpc_set_wait()) set ffff90a7c9798c00 going to sleep for 11 seconds 00000100:00100000:3.0:1789136260.323187:0:23324:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666900992 00000100:00100000:3.0:1789136260.323204:0:23324:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666900992 00000100:00100000:3.0:1789136260.323267:0:23324:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1789136260.323277:0:23324:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7fb15bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b11da215-324d-4c8d-90a5-0b7f26186c4c+12:23365:x1876044666900992:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789136260.323451:0:23324:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7fb15bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b11da215-324d-4c8d-90a5-0b7f26186c4c+12:23365:x1876044666900992:12345-0@lo:502:llog_process_th.0 Request processed in 175us (6521us total) trans 0 rc 0/0 00000100:00100000:3.0:1789136260.323459:0:23324:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1789136260.323481:0:23365:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7fa3bd2c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b11da215-324d-4c8d-90a5-0b7f26186c4c:23365:1876044666900992:0@lo:502:llog_process_th.0 00000020:01000004:1.0:1789136260.323553:0:23365:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:1.0:1789136260.323569:0:23365:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (ffff90a7fc3ab490) 00000020:00000080:1.0:1789136260.323601:0:23365:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type lwp with refcount 2 00000020:01000004:1.0:1789136260.323692:0:23365:0:(tgt_mount.c:153:server_get_mount()) get mount ffff90a7fa55b800 from lustre-MDT0000, refs=4 00000020:01000004:1.0:1789136260.323703:0:23365:0:(tgt_mount.c:187:server_put_mount()) put mount ffff90a7fa55b800 from lustre-MDT0000, refs=4 00000020:01000004:1.0:1789136260.323708:0:23365:0:(obd_mount.c:710:lustre_put_lsi()) put ffff90a7fa55b800 4 00010000:00080000:1.0:1789136260.323739:0:23365:0:(ldlm_lib.c:102:import_set_conn()) imp ffff90a6c228b800@lustre-MDT0000-lwp-MDT0000: add connection 192.168.201.131@tcp at head 00010000:00010000:1.0:1789136260.325289:0:23365:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-4 is initialized 00000020:00000080:1.0:1789136260.325507:0:23365:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:1.0:1789136260.325545:0:23365:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1789136260.325557:0:23365:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0x559c8745c6de44cd 00000100:00080000:1.0:1789136260.325566:0:23365:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1789136260.325572:0:23365:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff90a6c228b800 using connection 192.168.201.131@tcp/0@lo 00000100:00100000:1.0:1789136260.325606:0:23365:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff90a7f662d680 x1876044666901120/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1789136260.325630:0:23365:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:1.0:1789136260.325666:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7f662d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3637:1876044666901120:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1789136260.325745:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789136260.327911:0:23332:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666901120 00000100:00100000:3.0:1789136260.327923:0:23332:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666901120 00000100:00100000:3.0:1789136260.327970:0:23332:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1789136260.327978:0:23332:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7f662c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3637:x1876044666901120:12345-0@lo:38:llog_process_th.0 00000100:00100000:3.0:1789136260.328081:0:23332:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7f662c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3637:x1876044666901120:12345-0@lo:38:llog_process_th.0 Request processed in 103us (2335us total) trans 0 rc -11/-11 00000100:00100000:3.0:1789136260.328096:0:23332:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1789136260.328145:0:3637:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1789136260.328153:0:3637:0:(import.c:65:import_set_state_nolock()) ffff90a6c228b800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1789136260.328157:0:3637:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:3.0:1789136260.328161:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7f662d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3637:1876044666901120:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1789136260.328320:0:23365:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7f662cb40 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b11da215-324d-4c8d-90a5-0b7f26186c4c:23365:1876044666901248:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789136260.329561:0:23365:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789136260.329695:0:23365:0:(client.c:2715:ptlrpc_set_wait()) set ffff90a7fa5da180 going to sleep for 11 seconds 00000100:00100000:3.0:1789136260.329850:0:23327:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666901248 00000100:00100000:3.0:1789136260.329940:0:23327:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666901248 00000100:00100000:3.0:1789136260.329984:0:23327:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1789136260.329993:0:23327:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7fb15a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b11da215-324d-4c8d-90a5-0b7f26186c4c+12:23365:x1876044666901248:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789136260.330215:0:23327:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7fb15a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b11da215-324d-4c8d-90a5-0b7f26186c4c+12:23365:x1876044666901248:12345-0@lo:502:llog_process_th.0 Request processed in 223us (657us total) trans 0 rc 0/0 00000100:00100000:3.0:1789136260.330224:0:23327:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1789136260.330699:0:23365:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7f662cb40 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b11da215-324d-4c8d-90a5-0b7f26186c4c:23365:1876044666901248:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789136260.330759:0:23365:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7f662cb40 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b11da215-324d-4c8d-90a5-0b7f26186c4c:23365:1876044666901376:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789136260.331117:0:23365:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789136260.331149:0:23365:0:(client.c:2715:ptlrpc_set_wait()) set ffff90a7fa5da180 going to sleep for 11 seconds 00000100:00100000:1.0:1789136260.331166:0:23324:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666901376 00000100:00100000:1.0:1789136260.331169:0:23324:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666901376 00000100:00100000:1.0:1789136260.331200:0:23324:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1789136260.331206:0:23324:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7fb159c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b11da215-324d-4c8d-90a5-0b7f26186c4c+12:23365:x1876044666901376:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789136260.331288:0:23324:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7fb159c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b11da215-324d-4c8d-90a5-0b7f26186c4c+12:23365:x1876044666901376:12345-0@lo:502:llog_process_th.0 Request processed in 81us (171us total) trans 0 rc 0/0 00000100:00100000:1.0:1789136260.331302:0:23324:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1789136260.331341:0:23365:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7f662cb40 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b11da215-324d-4c8d-90a5-0b7f26186c4c:23365:1876044666901376:0@lo:502:llog_process_th.0 00000040:00080000:1.0:1789136260.331372:0:23365:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:2.0:1789136260.332399:0:23311:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:2.0:1789136260.332427:0:23311:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.131@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1789136260.332445:0:23311:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.131@tcp lock: ffff90a6c3cafc00/0x559c8745c6de44b8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x559c8745c6de44bf expref: -99 pid: 23311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136260.332457:0:23311:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.131@tcp lock: ffff90a6c3cafc00/0x559c8745c6de44b8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x559c8745c6de44bf expref: -99 pid: 23311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1789136260.332504:0:23311:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1789136260.332506:0:23311:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1789136260.332508:0:23311:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789136260.332509:0:23311:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789136260.332510:0:23311:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789136260.332512:0:23311:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789136260.332513:0:23311:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1789136260.332515:0:23311:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1789136260.332517:0:23311:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789136260.332518:0:23311:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1789136260.332522:0:23311:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020005 00000020:01000004:2.0:1789136260.332525:0:23311:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1789136260.332526:0:23311:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1789136260.332527:0:23311:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789136260.332528:0:23311:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789136260.332529:0:23311:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789136260.332530:0:23311:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789136260.332531:0:23311:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1789136260.332533:0:23311:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1789136260.332534:0:23311:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789136260.332535:0:23311:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1789136260.332559:0:23311:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:2.0:1789136260.332574:0:23311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7c14b52c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b11da215-324d-4c8d-90a5-0b7f26186c4c:23311:1876044666901504:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1789136260.332619:0:23311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789136260.332652:0:23311:0:(client.c:2715:ptlrpc_set_wait()) set ffff90a7efa89180 going to sleep for 11 seconds 00000100:00100000:3.0:1789136260.333887:0:23325:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666901504 00000100:00100000:3.0:1789136260.333897:0:23325:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666901504 00000100:00100000:3.0:1789136260.333948:0:23325:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1789136260.333958:0:23325:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7fb158050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b11da215-324d-4c8d-90a5-0b7f26186c4c+12:23311:x1876044666901504:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1789136260.333998:0:23325:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:3.0:1789136260.334012:0:23325:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:3.0:1789136260.356590:0:23325:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1789136260.356610:0:23325:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:3.0:1789136260.356998:0:23325:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7fb158050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b11da215-324d-4c8d-90a5-0b7f26186c4c+12:23311:x1876044666901504:12345-0@lo:253:mount.lustre.0 Request processed in 23037us (24373us total) trans 0 rc 0/0 00000100:00100000:3.0:1789136260.357012:0:23325:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 20000000:01000000:2.0:1789136260.357156:0:23349:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1789136260.357161:0:23349:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1789136260.357183:0:23349:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff90a7d1878c00/0x559c8745c6de44d4 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 23349 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136260.357199:0:23349:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90a7c167d600/0x559c8745c6de44a3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x559c8745c6de449c expref: 11 pid: 23327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136260.357208:0:23349:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff90a7d1878c00/0x559c8745c6de44d4 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 23349 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136260.357248:0:23349:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90a7c167d600/0x559c8745c6de44a3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x559c8745c6de449c expref: 11 pid: 23327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136260.357263:0:23349:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff90a7c167d600/0x559c8745c6de44a3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x559c8745c6de449c expref: 11 pid: 23327 timeout: 808 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789136260.357277:0:23349:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7c14b6580 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:23349:1876044666901632:0@lo:104: 00000100:00100000:2.0:1789136260.357315:0:23349:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789136260.357368:0:23349:0:(client.c:2715:ptlrpc_set_wait()) set ffff90a7efa89480 going to sleep for 11 seconds 00000100:00100000:2.0:1789136260.357423:0:23311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7c14b52c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b11da215-324d-4c8d-90a5-0b7f26186c4c:23311:1876044666901504:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1789136260.357435:0:23311:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:2.0:1789136260.357439:0:23311:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1789136260.357441:0:23311:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1789136260.357442:0:23311:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789136260.357443:0:23311:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789136260.357445:0:23311:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789136260.357451:0:23311:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789136260.357452:0:23311:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1789136260.357454:0:23311:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1789136260.357456:0:23311:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789136260.357458:0:23311:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1789136260.357477:0:23311:0:(tgt_mount.c:2692:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00000100:00100000:3.0:1789136260.357908:0:23315:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666901632 00000100:00100000:3.0:1789136260.357916:0:23315:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666901632 00000100:00100000:3.0:1789136260.357957:0:23315:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1789136260.357966:0:23315:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7c14b7840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:b11da215-324d-4c8d-90a5-0b7f26186c4c+3:23349:x1876044666901632:12345-0@lo:104: 00010000:00010000:3.0:1789136260.357987:0:23315:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.131@tcp lock: ffff90a6c3caee00/0x559c8745c6de449c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x559c8745c6de44a3 expref: -99 pid: 23311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136260.358051:0:23315:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1789136260.358058:0:23315:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7c14b7840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:b11da215-324d-4c8d-90a5-0b7f26186c4c+3:23349:x1876044666901632:12345-0@lo:104: Request processed in 93us (743us total) trans 0 rc 0/0 00000100:00100000:3.0:1789136260.358065:0:23315:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:0.0:1789136260.363126:0:23321:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789136260.363140:0:23321:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.131@tcp lock: ffff90a6c3caee00/0x559c8745c6de449c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x559c8745c6de44a3 expref: -99 pid: 23311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136260.363152:0:23321:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a6c3caee00 already unused, calling callback (ffffffffc13bbc20) 10000000:00010000:0.0:1789136260.363157:0:23321:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.131@tcp lock: ffff90a6c3caee00/0x559c8745c6de449c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x559c8745c6de44a3 expref: -99 pid: 23311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136260.363168:0:23321:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.131@tcp lock: ffff90a6c3caee00/0x559c8745c6de449c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x559c8745c6de44a3 expref: -99 pid: 23311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789136260.363175:0:23321:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.131@tcp lock: ffff90a6c3caee00/0x559c8745c6de449c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x559c8745c6de44a3 expref: -99 pid: 23311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789136260.363181:0:23321:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1789136260.363229:0:23321:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.131@tcp lock: ffff90a6c3caee00/0x559c8745c6de449c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x559c8745c6de44a3 expref: -99 pid: 23311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136260.363235:0:23321:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789136260.363258:0:23321:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.131@tcp lock: ffff90a6c3caee00/0x559c8745c6de449c lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x559c8745c6de44a3 expref: -99 pid: 23311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136260.363274:0:23321:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.131@tcp lock: ffff90a6c3caee00/0x559c8745c6de449c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x559c8745c6de44a3 expref: -99 pid: 23311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136260.363294:0:23321:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789136260.363296:0:23321:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789136260.363298:0:23321:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789136260.363351:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7fa3bd2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b11da215-324d-4c8d-90a5-0b7f26186c4c:3641:1876044666901760:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789136260.363426:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789136260.363528:0:23317:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666901760 00000100:00100000:0.0:1789136260.363535:0:23317:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666901760 00010000:00010000:0.0:1789136260.363561:0:23317:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90a7c167d600/0x559c8745c6de44a3 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x559c8745c6de449c expref: 12 pid: 23327 timeout: 808 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789136260.363588:0:23317:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789136260.363597:0:23317:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7fa3bc000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b11da215-324d-4c8d-90a5-0b7f26186c4c+12:3641:x1876044666901760:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789136260.363622:0:23317:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789136260.363628:0:23317:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90a7c167d600/0x559c8745c6de44a3 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x559c8745c6de449c expref: 12 pid: 23327 timeout: 808 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136260.363640:0:23317:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90a7c167d600/0x559c8745c6de44a3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x559c8745c6de449c expref: 12 pid: 23327 timeout: 808 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136260.363658:0:23317:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff90a7d1878c00/0x559c8745c6de44d4 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 23349 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136260.363667:0:23317:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90a7d1878c00/0x559c8745c6de44d4 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 23349 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1789136260.363683:0:23317:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.006523026s 00010000:00010000:0.0:1789136260.363694:0:23317:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff90a7d1878c00/0x559c8745c6de44d4 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 23349 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136260.370000:0:23317:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff90a7d1878c00/0x559c8745c6de44d4 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 23349 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136260.370016:0:23317:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff90a7d1878c00/0x559c8745c6de44d4 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 23349 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136260.370026:0:23317:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff90a7d1878c00/0x559c8745c6de44d4 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 23349 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136260.370032:0:23317:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a7d1878c00 already unused, calling callback (ffffffffc0dbf540) 00010000:00010000:0.0:1789136260.370037:0:23317:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff90a7d1878c00/0x559c8745c6de44d4 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 23349 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136260.370047:0:23317:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff90a7d1878c00/0x559c8745c6de44d4 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 23349 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136260.370063:0:23317:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff90a7d1878c00/0x559c8745c6de44d4 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 23349 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136260.370080:0:23317:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789136260.370165:0:23317:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7fa3bc000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b11da215-324d-4c8d-90a5-0b7f26186c4c+12:3641:x1876044666901760:12345-0@lo:103:ldlm_bl.0 Request processed in 6565us (6735us total) trans 0 rc 0/0 00000100:00100000:0.0:1789136260.370176:0:23317:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789136260.370266:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7fa3bd2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b11da215-324d-4c8d-90a5-0b7f26186c4c:3641:1876044666901760:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789136260.379262:0:23349:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90a7c167d600/0x559c8745c6de44a3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x559c8745c6de449c expref: 11 pid: 23327 timeout: 808 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789136260.379280:0:23349:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7c14b6580 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:23349:1876044666901632:0@lo:104: 00010000:00010000:2.0:1789136260.379302:0:23349:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff90a7d1878c00/0x559c8745c6de44d4 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 23349 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136260.379312:0:23349:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff90a7d1878c00/0x559c8745c6de44d4 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 23349 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136260.379317:0:23349:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff90a7d1878c00/0x559c8745c6de44d4 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 23349 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136260.379323:0:23349:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90a7d1878c00/0x559c8745c6de44d4 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 23349 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:0.0:1789136260.406176:0:23311:0:(update_trans.c:1496:distribute_txn_commit_batchid_init()) lustre-MDT0000: committed batchid 4294967529 00000040:01000000:0.0:1789136260.406557:0:23311:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000020:00080000:2.0:1789136260.406565:0:23375:0:(update_trans.c:1539:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 4294967529 00000020:00080000:2.0:1789136260.406569:0:23375:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4294967529 00000040:01000000:2.0:1789136260.409600:0:23376:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:0.0:1789136260.410040:0:23311:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osp-MDT0000 ctxt 16 is initialized 00000100:00080000:3.0:1789136260.410481:0:23377:0:(client.c:1845:ptlrpc_send_new_req()) @@@ req waiting for recovery: (FULL != DISCONN) req@ffff90a7ff64b840 x1876044666901888/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'lod0000_rec0001.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789136260.410494:0:23377:0:(client.c:2715:ptlrpc_set_wait()) set ffff90a7e6eb83c0 going to sleep for 0 seconds 00000040:00080000:2.0:1789136260.410548:0:23376:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:01000000:0.0:1789136260.411198:0:23311:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:0.0:1789136260.411251:0:23311:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:0.0:1789136260.411634:0:23311:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:0.0:1789136260.411643:0:23311:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:0.0:1789136260.411676:0:23311:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1789136260.413490:0:23311:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:1.0:1789136260.415340:0:23311:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:1.0:1789136260.415418:0:23311:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00000040:00080000:1.0:1789136260.418412:0:23311:0:(llog_cat.c:403:llog_cat_set_first_idx()) catlog [0xa:0x7:0x0] first idx 1, last_idx 2 00080000:10000000:1.0:1789136260.419074:0:23311:0:(osd_handler.c:5551:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x36:0x0] (8/32) registered 00000040:00080000:2.0:1789136260.422290:0:23376:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:2.0:1789136260.422370:0:23376:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000001:00000004:1.0:1789136260.423734:0:23311:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 3, last_transno is 12884901888 00000001:00080000:2.0:1789136260.427462:0:23311:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:2.0:1789136260.427504:0:23311:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffbb1d40d9b988 00100000:10000000:2.0:1789136260.427512:0:23311:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:1.0:1789136260.428209:0:23311:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:1.0:1789136260.428226:0:23311:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.201.131@tcp: cl_mgc_mutex unlock 00000020:01000004:1.0:1789136260.428247:0:23311:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=46 00000080:00000004:1.0:1789136260.428266:0:23311:0:(super25.c:182:lustre_fill_super()) /dev/mapper/mds1_flakey: Mount complete 00000020:00000004:1.0:1789136260.435496:0:23311:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1789136260.435914:0:23311:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1789136260.841129:0:23320:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789136261.416903:0:23377:0:(client.c:2715:ptlrpc_set_wait()) set ffff90a7e6eb83c0 going to sleep for 0 seconds 00000040:00080000:0.0:1789136261.423588:0:23370:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:0.0:1789136261.423597:0:23370:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1789136261.434726:0:23370:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:3.0:1789136261.434746:0:23370:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 10000000:01000000:3.0:1789136261.673701:0:23329:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1789136261.673709:0:23329:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff90a7fa55b800 from 11 10000000:01000000:3.0:1789136261.673715:0:23329:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1789136261.673800:0:23329:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.131@tcp lock: ffff90a7e1c9fe00/0x559c8745c6de44db lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 23329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136261.673812:0:23329:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.131@tcp lock: ffff90a7e1c9fe00/0x559c8745c6de44db lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 23329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136261.673825:0:23329:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.131@tcp lock: ffff90a7e1c9fe00/0x559c8745c6de44db lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 23329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789136261.673884:0:23329:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7ff64b0c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b11da215-324d-4c8d-90a5-0b7f26186c4c:23329:1876044666902016:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1789136261.673966:0:23329:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789136261.674031:0:23329:0:(client.c:2715:ptlrpc_set_wait()) set ffff90a7e6eb8600 going to sleep for 11 seconds 00000100:00100000:0.0:1789136261.674155:0:23327:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666902016 00000100:00100000:0.0:1789136261.674164:0:23327:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666902016 00000100:00100000:0.0:1789136261.676344:0:23327:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1789136261.676368:0:23327:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7fb159850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b11da215-324d-4c8d-90a5-0b7f26186c4c+11:23329:x1876044666902016:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789136261.676387:0:23327:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789136261.676407:0:23327:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90a6c3caf600/0x559c8745c6de44e2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x559c8745c6de44db expref: -99 pid: 23327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136261.676449:0:23327:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90a6c3caf600/0x559c8745c6de44e2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x559c8745c6de44db expref: 12 pid: 23327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136261.676460:0:23327:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90a6c3caf600/0x559c8745c6de44e2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x559c8745c6de44db expref: 12 pid: 23327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136261.676468:0:23327:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a6c3caf600, rc 0) 00000100:00100000:0.0:1789136261.676549:0:23327:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7fb159850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b11da215-324d-4c8d-90a5-0b7f26186c4c+12:23329:x1876044666902016:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 192us (2583us total) trans 0 rc 0/0 00000100:00100000:0.0:1789136261.676556:0:23327:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1789136261.678267:0:23329:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7ff64b0c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b11da215-324d-4c8d-90a5-0b7f26186c4c:23329:1876044666902016:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789136261.678294:0:23329:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.131@tcp lock: ffff90a7e1c9fe00/0x559c8745c6de44db lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x559c8745c6de44e2 expref: -99 pid: 23329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136261.678305:0:23329:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.131@tcp lock: ffff90a7e1c9fe00/0x559c8745c6de44db lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x559c8745c6de44e2 expref: -99 pid: 23329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789136261.678375:0:23329:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7f662d2c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b11da215-324d-4c8d-90a5-0b7f26186c4c:23329:1876044666902144:0@lo:256:ll_cfg_requeue.0 00000100:00100000:1.0:1789136261.678447:0:23329:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789136261.683154:0:23329:0:(client.c:2715:ptlrpc_set_wait()) set ffff90a7e01d6c00 going to sleep for 11 seconds 00000100:00100000:3.0:1789136261.690689:0:23324:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666902144 00000100:00100000:3.0:1789136261.690723:0:23324:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666902144 00000100:00100000:3.0:1789136261.690798:0:23324:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1789136261.690808:0:23324:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7fb159450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b11da215-324d-4c8d-90a5-0b7f26186c4c+12:23329:x1876044666902144:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:3.0:1789136261.690833:0:23324:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1789136261.690848:0:23324:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1789136261.690851:0:23324:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 11 00000100:00100000:3.0:1789136261.691033:0:23324:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7fb159450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b11da215-324d-4c8d-90a5-0b7f26186c4c+12:23329:x1876044666902144:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 226us (12585us total) trans 0 rc 0/0 00000100:00100000:3.0:1789136261.691040:0:23324:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1789136261.695235:0:23329:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7f662d2c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b11da215-324d-4c8d-90a5-0b7f26186c4c:23329:1876044666902144:0@lo:256:ll_cfg_requeue.0 10000000:01000000:1.0:1789136261.695311:0:23329:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.131@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1789136261.695324:0:23329:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.131@tcp lock: ffff90a7e1c9fe00/0x559c8745c6de44db lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x559c8745c6de44e2 expref: -99 pid: 23329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136261.695345:0:23329:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.131@tcp lock: ffff90a7e1c9fe00/0x559c8745c6de44db lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x559c8745c6de44e2 expref: -99 pid: 23329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136261.864684:0:23321:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789136262.465794:0:23377:0:(client.c:2715:ptlrpc_set_wait()) set ffff90a7e6eb83c0 going to sleep for 0 seconds 00000040:00080000:1.0:1789136262.465950:0:23370:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:1.0:1789136262.465955:0:23370:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1789136262.468922:0:23370:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 1 count 1 00000040:00080000:1.0:1789136262.468986:0:23370:0:(llog_cat_server.c:902:llog_cat_cleanup()) cancel plain log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1789136262.469133:0:23370:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 1 00010000:00010000:1.0:1789136262.888051:0:23320:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789136263.530094:0:23377:0:(client.c:2715:ptlrpc_set_wait()) set ffff90a7e6eb83c0 going to sleep for 0 seconds 00010000:00010000:1.0:1789136263.913325:0:23321:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789136264.558344:0:23377:0:(client.c:2715:ptlrpc_set_wait()) set ffff90a7e6eb83c0 going to sleep for 0 seconds 00010000:00010000:1.0:1789136264.937206:0:23320:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1789136265.429613:0:23619:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg131-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00100000:1.0:1789136265.577151:0:23377:0:(client.c:2715:ptlrpc_set_wait()) set ffff90a7e6eb83c0 going to sleep for 0 seconds 00000100:00100000:1.0:1789136265.579712:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7c14b7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b11da215-324d-4c8d-90a5-0b7f26186c4c:3638:1876044666902272:0@lo:400:kworker.0 00000100:00100000:1.0:1789136265.579788:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1789136265.579874:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:2.0:1789136265.579891:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:2.0:1789136265.579896:0:38:0:(import.c:65:import_set_state_nolock()) ffff90a7fa659000 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1789136265.579902:0:38:0:(import.c:510:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 708 00000100:00080000:2.0:1789136265.579907:0:38:0:(import.c:589:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1789136265.579914:0:38:0:(import.c:624:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff90a7fa659000 using connection 192.168.201.131@tcp/0@lo 00000100:00100000:2.0:1789136265.581170:0:38:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff90a7c14b6d00 x1876044666902400/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1789136265.581197:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1789136265.581200:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1789136265.581203:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1789136265.581207:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1789136265.581209:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:2.0:1789136265.581212:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1789136265.581214:0:38:0:(import.c:65:import_set_state_nolock()) ffff90a6c228b800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1789136265.581221:0:38:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff90a6c228b800 using connection 192.168.201.131@tcp/0@lo 00000100:00100000:2.0:1789136265.581236:0:38:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff90a7c14b4f00 x1876044666902528/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1789136265.581305:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7c14b6d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3637:1876044666902400:0@lo:38:kworker.0 00000100:00100000:2.0:1789136265.581380:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789136265.581415:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7c14b4f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3637:1876044666902528:0@lo:38:kworker.0 00000100:00100000:2.0:1789136265.581445:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789136265.581553:0:23334:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666902528 00000100:00100000:2.0:1789136265.581561:0:23334:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666902528 00000100:00100000:2.0:1789136265.581595:0:23334:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1789136265.581609:0:23334:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7c14b61c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3637:x1876044666902528:12345-0@lo:38:kworker.0 00010000:00080000:2.0:1789136265.581635:0:23334:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 713 last 0 00000020:00000080:2.0:1789136265.581672:0:23334:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0x559c8745c6de44e9 00000004:00100000:2.0:1789136265.581687:0:23334:0:(mdt_handler.c:7306:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1789136265.581850:0:23334:0:(import.c:65:import_set_state_nolock()) ffff90a6c4c45000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789136265.582560:0:23334:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7c14b61c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3637:x1876044666902528:12345-0@lo:38:kworker.0 Request processed in 316us (478us total) trans 0 rc 0/0 00000100:00100000:2.0:1789136265.582572:0:23334:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1789136265.582624:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff90a7c14b4f00 x1876044666902528/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789136275 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1789136265.582638:0:3637:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 3 00000100:00080000:2.0:1789136265.582645:0:3637:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:2.0:1789136265.582649:0:3637:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1789136265.582652:0:3637:0:(import.c:65:import_set_state_nolock()) ffff90a6c228b800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1789136265.582657:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7c14b4f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3637:1876044666902528:0@lo:38:kworker.0 00000100:00100000:3.0:1789136265.582793:0:23324:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666902272 00000100:00100000:3.0:1789136265.582800:0:23324:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666902272 00000100:00100000:3.0:1789136265.582845:0:23324:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1789136265.582873:0:23324:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7fb15a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b11da215-324d-4c8d-90a5-0b7f26186c4c+12:3638:x1876044666902272:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789136265.584967:0:23339:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666902400 00000100:00100000:0.0:1789136265.584979:0:23339:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666902400 00000100:00100000:0.0:1789136265.585023:0:23339:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1789136265.585030:0:23339:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7c14b5a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3637:x1876044666902400:12345-0@lo:38:kworker.0 00010000:00020000:0.0:1789136265.585064:0:23339:0:(ldlm_lib.c:1228:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1789136265.585138:0:23339:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7c14b5a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3637:x1876044666902400:12345-0@lo:38:kworker.0 Request processed in 106us (3758us total) trans 0 rc -19/-19 00000100:00100000:0.0:1789136265.585146:0:23339:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:0.0:1789136265.585194:0:3637:0:(import.c:65:import_set_state_nolock()) ffff90a7fa659000 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1789136265.585199:0:3637:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1789136265.585203:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7c14b6d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3637:1876044666902400:0@lo:38:kworker.0 00000100:00100000:3.0:1789136265.591609:0:23324:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7fb15a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b11da215-324d-4c8d-90a5-0b7f26186c4c+12:3638:x1876044666902272:12345-0@lo:400:kworker.0 Request processed in 8744us (11809us total) trans 0 rc 0/0 00000100:00100000:3.0:1789136265.591625:0:23324:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1789136265.595275:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7c14b7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b11da215-324d-4c8d-90a5-0b7f26186c4c:3638:1876044666902272:0@lo:400:kworker.0 00010000:00010000:1.0:1789136265.965059:0:23321:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789136266.601754:0:23377:0:(client.c:2715:ptlrpc_set_wait()) set ffff90a7e6eb83c0 going to sleep for 0 seconds 00000020:00000004:3.0:1789136266.624256:0:23671:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1789136266.625122:0:23671:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1789136266.987125:0:23320:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:0.0:1789136267.619189:0:23722:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1789136267.619397:0:23722:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:3.0:1789136267.627343:0:23377:0:(client.c:2715:ptlrpc_set_wait()) set ffff90a7e6eb83c0 going to sleep for 0 seconds 00010000:00010000:1.0:1789136268.009159:0:23321:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789136268.648076:0:23377:0:(client.c:2715:ptlrpc_set_wait()) set ffff90a7e6eb83c0 going to sleep for 0 seconds 00010000:00010000:0.0:1789136269.032301:0:23320:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789136269.673184:0:23377:0:(client.c:2715:ptlrpc_set_wait()) set ffff90a7e6eb83c0 going to sleep for 0 seconds 00010000:00010000:1.0:1789136270.057605:0:23321:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789136270.695973:0:3637:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789136260/real 1789136260] req@ffff90a7f662ed00 x1876044666899456/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789136270 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789136270.696005:0:3637:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff90a7f662ed00 x1876044666899456/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789136270 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789136270.696026:0:3637:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789136260/real 1789136260] req@ffff90a7fa3bd680 x1876044666899328/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789136270 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789136270.696039:0:3637:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff90a7fa3bd680 x1876044666899328/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789136270 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1789136270.696059:0:3637:0:(import.c:65:import_set_state_nolock()) ffff90a6c228c000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1789136270.696089:0:3637:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1789136270.696093:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7f662ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3637:1876044666899456:0@lo:8:llog_process_th.0 00000100:00080000:0.0:1789136270.696100:0:3637:0:(import.c:65:import_set_state_nolock()) ffff90a7ff553800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1789136270.696106:0:3637:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1789136270.696117:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7fa3bd680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3637:1876044666899328:0@lo:8:llog_process_th.0 00000100:00080000:3.0:1789136270.696308:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:3.0:1789136270.696314:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:3.0:1789136270.696317:0:38:0:(import.c:65:import_set_state_nolock()) ffff90a7fa659000 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1789136270.696322:0:38:0:(import.c:510:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 713 00000100:00080000:3.0:1789136270.696327:0:38:0:(import.c:589:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:3.0:1789136270.696339:0:38:0:(import.c:624:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff90a7fa659000 using connection 192.168.201.131@tcp/0@lo 00000100:00100000:3.0:1789136270.696361:0:38:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff90a7ff6483c0 x1876044666902784/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1789136270.696373:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789136270.696375:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:3.0:1789136270.696377:0:38:0:(import.c:65:import_set_state_nolock()) ffff90a7ff553800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1789136270.696380:0:38:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 708 00000100:00080000:3.0:1789136270.696382:0:38:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1789136270.696385:0:38:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff90a7ff553800 using connection 192.168.201.131@tcp/0@lo 00000100:00100000:3.0:1789136270.696395:0:38:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff90a7ff648f00 x1876044666902912/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1789136270.696403:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789136270.696405:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1789136270.696407:0:38:0:(import.c:65:import_set_state_nolock()) ffff90a6c228c000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1789136270.696409:0:38:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 708 00000100:00080000:3.0:1789136270.696412:0:38:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1789136270.696414:0:38:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff90a6c228c000 using connection 192.168.201.131@tcp/0@lo 00000100:00100000:3.0:1789136270.696424:0:38:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff90a7ff64b0c0 x1876044666903040/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1789136270.696456:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789136270.696467:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7ff649e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b11da215-324d-4c8d-90a5-0b7f26186c4c:3638:1876044666902656:0@lo:400:kworker.0 00000100:00100000:3.0:1789136270.696532:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789136270.696784:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7ff648000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3640:1876044666903168:0@lo:400:kworker.0 00000100:00100000:0.0:1789136270.696821:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789136270.696889:0:23327:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666902656 00000100:00100000:0.0:1789136270.696896:0:23327:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666902656 00000100:00100000:0.0:1789136270.696939:0:23327:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1789136270.696948:0:23327:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7fb15a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b11da215-324d-4c8d-90a5-0b7f26186c4c+12:3638:x1876044666902656:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789136270.696994:0:23327:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7fb15a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b11da215-324d-4c8d-90a5-0b7f26186c4c+12:3638:x1876044666902656:12345-0@lo:400:kworker.0 Request processed in 47us (462us total) trans 0 rc 0/0 00000100:00100000:0.0:1789136270.697001:0:23327:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1789136270.697131:0:23333:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666903168 00000100:00100000:3.0:1789136270.697136:0:23333:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666903168 00000100:00100000:3.0:1789136270.697169:0:23333:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1789136270.697183:0:23333:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7fa3bd680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1876044666903168:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789136270.697220:0:23333:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7fa3bd680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1876044666903168:12345-0@lo:400:kworker.0 Request processed in 39us (399us total) trans 0 rc 0/0 00000100:00100000:3.0:1789136270.697226:0:23333:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1789136270.697247:0:23377:0:(client.c:2715:ptlrpc_set_wait()) set ffff90a7e6eb83c0 going to sleep for 0 seconds 00010000:00080000:0.0:1789136270.697324:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff90a7ff648000 x1876044666903168/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789136286 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789136270.697335:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7ff648000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3640:1876044666903168:0@lo:400:kworker.0 00000100:00100000:0.0:1789136270.697359:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7ff649e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b11da215-324d-4c8d-90a5-0b7f26186c4c:3638:1876044666902656:0@lo:400:kworker.0 00000100:00100000:0.0:1789136270.697374:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7ff6483c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3637:1876044666902784:0@lo:38:kworker.0 00000100:00100000:0.0:1789136270.697414:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789136270.697485:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7ff648f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3637:1876044666902912:0@lo:8:kworker.0 00000400:00000100:0.0:1789136270.697507:0:3637:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1876044666902912 offset 0 length 520: 4 00000100:00100000:0.0:1789136270.697519:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7ff64b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3637:1876044666903040:0@lo:8:kworker.0 00000400:00000100:0.0:1789136270.697539:0:3637:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1876044666903040 offset 0 length 520: 4 00000100:00100000:3.0:1789136270.700275:0:23339:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666902784 00000100:00100000:3.0:1789136270.700289:0:23339:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666902784 00000100:00100000:3.0:1789136270.700334:0:23339:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1789136270.700344:0:23339:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7fa3bcf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3637:x1876044666902784:12345-0@lo:38:kworker.0 00010000:00020000:3.0:1789136270.700364:0:23339:0:(ldlm_lib.c:1228:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1789136270.700444:0:23339:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7fa3bcf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3637:x1876044666902784:12345-0@lo:38:kworker.0 Request processed in 101us (3028us total) trans 0 rc -19/-19 00000100:00100000:3.0:1789136270.700452:0:23339:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00080000:1.0:1789136270.700485:0:3637:0:(import.c:65:import_set_state_nolock()) ffff90a7fa659000 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1789136270.700492:0:3637:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1789136270.700496:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7ff6483c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3637:1876044666902784:0@lo:38:kworker.0 00010000:00010000:3.0:1789136271.080237:0:23320:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789136271.733660:0:23377:0:(client.c:2715:ptlrpc_set_wait()) set ffff90a7e6eb83c0 going to sleep for 0 seconds 00010000:00010000:0.0:1789136272.104549:0:23321:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1789136272.745435:0:23370:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1789136272.746169:0:23377:0:(client.c:2715:ptlrpc_set_wait()) set ffff90a7e6eb83c0 going to sleep for 0 seconds 00010000:00010000:3.0:1789136273.128079:0:23320:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789136273.777682:0:23377:0:(client.c:2715:ptlrpc_set_wait()) set ffff90a7e6eb83c0 going to sleep for 0 seconds 00010000:00010000:3.0:1789136274.152527:0:23321:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789136274.793700:0:23377:0:(client.c:2715:ptlrpc_set_wait()) set ffff90a7e6eb83c0 going to sleep for 0 seconds 00000020:01000004:1.0:1789136274.825893:0:24068:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:1.0:1789136274.825898:0:24068:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/mds2_flakey 00000020:01000004:1.0:1789136274.825908:0:24068:0:(obd_mount.c:929:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:1.0:1789136274.827256:0:24068:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff90a6c3ba1800 00000020:01000004:1.0:1789136274.827276:0:24068:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-MDT0001, type=osd-ldiskfs, lsifl=200001, mountfl=0 00000020:01000004:1.0:1789136274.827290:0:24068:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-osd (typ=osd-ldiskfs) 00000020:00000080:1.0:1789136274.827304:0:24068:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osd (ffff90a7fc3a8000) 00000020:00000080:1.0:1789136274.827320:0:24068:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type osd-ldiskfs with refcount 2 00100000:10000000:0.0:1789136274.980510:0:24068:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0xd:0x0] (16/1) registered 00100000:10000000:0.0:1789136274.988217:0:24068:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:0.0:1789136274.992851:0:24068:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:2.0:1789136274.994177:0:24068:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x7:0x0] (8/32) registered 00100000:10000000:2.0:1789136274.994707:0:24068:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x20001:0x0] (8/8) registered 00100000:10000000:2.0:1789136274.995903:0:24068:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x4:0x0] (8/32) registered 00100000:10000000:2.0:1789136274.996205:0:24068:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x20002:0x0] (8/8) registered 00100000:10000000:2.0:1789136274.996655:0:24068:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x6:0x0] (8/32) registered 00100000:10000000:3.0:1789136274.998206:0:24068:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x3:0x0] (8/32) registered 00100000:10000000:3.0:1789136275.001688:0:24068:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:3.0:1789136275.002672:0:24068:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x5:0x0] (8/32) registered 00100000:10000000:3.0:1789136275.003218:0:24068:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x8:0x0] (8/32) registered 00100000:10000000:3.0:1789136275.003623:0:24068:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x20003:0x0] (8/8) registered 00100000:10000000:3.0:1789136275.003890:0:24068:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:3.0:1789136275.009897:0:24068:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x29:0x0] (24/16) registered 00100000:10000000:3.0:1789136275.010391:0:24068:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x11:0x0] (16/1) registered 00100000:10000000:3.0:1789136275.011586:0:24068:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1f:0x0] (24/16) registered 00100000:10000000:3.0:1789136275.011957:0:24068:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1b:0x0] (16/1) registered 00100000:10000000:3.0:1789136275.013351:0:24068:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2d:0x0] (24/16) registered 00100000:10000000:3.0:1789136275.016242:0:24068:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x25:0x0] (24/16) registered 00100000:10000000:3.0:1789136275.017190:0:24068:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x12:0x0] (16/1) registered 00100000:10000000:2.0:1789136275.021006:0:24068:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x18:0x0] (16/1) registered 00100000:10000000:2.0:1789136275.027470:0:24068:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1d:0x0] (16/1) registered 00100000:10000000:2.0:1789136275.028167:0:24068:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x10:0x0] (16/1) registered 00100000:10000000:2.0:1789136275.028690:0:24068:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x17:0x0] (16/1) registered 00100000:10000000:2.0:1789136275.028974:0:24068:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x13:0x0] (16/1) registered 00100000:10000000:2.0:1789136275.029208:0:24068:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0xf:0x0] (16/1) registered 00100000:10000000:2.0:1789136275.029685:0:24068:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0xe:0x0] (16/1) registered 00100000:10000000:2.0:1789136275.031837:0:24068:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x28:0x0] (24/16) registered 00100000:10000000:2.0:1789136275.032549:0:24068:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x27:0x0] (24/16) registered 00100000:10000000:2.0:1789136275.032962:0:24068:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2b:0x0] (24/16) registered 00100000:10000000:2.0:1789136275.033635:0:24068:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x15:0x0] (16/1) registered 00100000:10000000:2.0:1789136275.035280:0:24068:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x20:0x0] (24/16) registered 00100000:10000000:2.0:1789136275.036551:0:24068:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2e:0x0] (24/16) registered 00100000:10000000:2.0:1789136275.037598:0:24068:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x16:0x0] (16/1) registered 00100000:10000000:3.0:1789136275.043960:0:24068:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x24:0x0] (24/16) registered 00100000:10000000:3.0:1789136275.046527:0:24068:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1a:0x0] (16/1) registered 00100000:10000000:3.0:1789136275.047176:0:24068:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x26:0x0] (24/16) registered 00100000:10000000:3.0:1789136275.047635:0:24068:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x22:0x0] (24/16) registered 00100000:10000000:3.0:1789136275.048577:0:24068:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2a:0x0] (24/16) registered 00100000:10000000:3.0:1789136275.048877:0:24068:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x14:0x0] (16/1) registered 00100000:10000000:3.0:1789136275.049126:0:24068:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2c:0x0] (24/16) registered 00100000:10000000:3.0:1789136275.049598:0:24068:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x19:0x0] (16/1) registered 00100000:10000000:3.0:1789136275.050610:0:24068:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x21:0x0] (24/16) registered 00100000:10000000:3.0:1789136275.051038:0:24068:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x23:0x0] (24/16) registered 00100000:10000000:3.0:1789136275.051270:0:24068:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1c:0x0] (16/1) registered 00080000:01000000:3.0:1789136275.057224:0:24068:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0001: register osd-ldiskfs tunable parameters 00000020:00000080:3.0:1789136275.058191:0:24068:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osd (uuid lustre-MDT0001-osd_UUID) 00080000:01000000:3.0:1789136275.058204:0:24068:0:(osd_handler.c:8895:osd_obd_connect()) connect #0 00000020:00000080:3.0:1789136275.058217:0:24068:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x559c8745c6de44f7 00000020:01000004:3.0:1789136275.058225:0:24068:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-MDT0001 on device /dev/mapper/mds2_flakey 00000020:01000004:3.0:1789136275.058246:0:24068:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.201.131@tcp:Set MGC reconnect 1 10000000:01000000:3.0:1789136275.058250:0:24068:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.201.131@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:3.0:1789136275.058257:0:24068:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-MDT0001 00000020:01000004:3.0:1789136275.058289:0:24068:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds2_flakey 10000000:01000000:3.0:1789136275.058304:0:24068:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.201.131@tcp: cl_mgc_mutex lustre-MDT0001-osd for locked: rc = 0 00000040:01000000:0.0:1789136275.080573:0:24068:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.201.131@tcp ctxt 0 is initialized 00000020:01000004:0.0:1789136275.080633:0:24068:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0001, fs=lustre, 192.168.201.131@tcp, index=0001, flags=0x20001 00000020:01000004:0.0:1789136275.080638:0:24068:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:0.0:1789136275.080640:0:24068:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:0.0:1789136275.080641:0:24068:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789136275.080643:0:24068:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789136275.080644:0:24068:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789136275.080645:0:24068:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789136275.080647:0:24068:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1789136275.080648:0:24068:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789136275.080650:0:24068:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1789136275.080653:0:24068:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0001 0x10020001 00000020:01000004:0.0:1789136275.080656:0:24068:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1789136275.080657:0:24068:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:0.0:1789136275.080658:0:24068:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789136275.080659:0:24068:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789136275.080660:0:24068:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789136275.080661:0:24068:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789136275.080662:0:24068:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1789136275.080663:0:24068:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789136275.080664:0:24068:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1789136275.080709:0:24068:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0001 00000100:00100000:0.0:1789136275.080731:0:24068:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7fa3bf480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b11da215-324d-4c8d-90a5-0b7f26186c4c:24068:1876044666903296:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1789136275.080809:0:24068:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789136275.080954:0:24068:0:(client.c:2715:ptlrpc_set_wait()) set ffff90a7d0e1a000 going to sleep for 11 seconds 00000100:00100000:3.0:1789136275.085898:0:23324:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666903296 00000100:00100000:3.0:1789136275.085915:0:23324:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666903296 00000100:00100000:0.0:1789136275.086125:0:23324:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1789136275.086138:0:23324:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7fb15b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b11da215-324d-4c8d-90a5-0b7f26186c4c+12:24068:x1876044666903296:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1789136275.086183:0:23324:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:0.0:1789136275.086186:0:23324:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0001 is running on 0@lo 20000000:01000000:0.0:1789136275.086194:0:23324:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 00000100:00100000:0.0:1789136275.086748:0:23324:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7fb15b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b11da215-324d-4c8d-90a5-0b7f26186c4c+12:24068:x1876044666903296:12345-0@lo:253:mount.lustre.0 Request processed in 611us (5936us total) trans 0 rc 0/0 00000100:00100000:0.0:1789136275.086784:0:23324:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1789136275.086912:0:24068:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7fa3bf480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b11da215-324d-4c8d-90a5-0b7f26186c4c:24068:1876044666903296:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1789136275.086927:0:24068:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0001 got index = 1 00000020:01000004:1.0:1789136275.086930:0:24068:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1789136275.086931:0:24068:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:1.0:1789136275.086933:0:24068:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789136275.086934:0:24068:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789136275.086935:0:24068:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789136275.086936:0:24068:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789136275.086938:0:24068:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1789136275.086939:0:24068:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789136275.086941:0:24068:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:1.0:1789136275.086965:0:24068:0:(tgt_mount.c:101:server_register_mount()) register mount ffff90a6c3ba1800 from lustre-MDT0001 10000000:01000000:1.0:1789136275.086995:0:24068:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0001 from 0 10000000:01000000:1.0:1789136275.086998:0:24068:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0001-0000000000000000 10000000:01000000:1.0:1789136275.087005:0:24068:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff90a6c4709a48 local copy 00010000:00010000:1.0:1789136275.087016:0:24068:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.131@tcp lock: ffff90a7e1c9f400/0x559c8745c6de43ed lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x559c8745c6de43f4 expref: -99 pid: 23311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789136275.087124:0:24068:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7f662e580 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b11da215-324d-4c8d-90a5-0b7f26186c4c:24068:1876044666903424:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789136275.087160:0:24068:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789136275.096094:0:24068:0:(client.c:2715:ptlrpc_set_wait()) set ffff90a7e6e91840 going to sleep for 11 seconds 00000100:00100000:2.0:1789136275.096703:0:23327:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666903424 00000100:00100000:2.0:1789136275.096715:0:23327:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666903424 00000100:00100000:2.0:1789136275.096785:0:23327:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1789136275.096795:0:23327:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7fb15b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b11da215-324d-4c8d-90a5-0b7f26186c4c+12:24068:x1876044666903424:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789136275.096953:0:23327:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7fb15b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b11da215-324d-4c8d-90a5-0b7f26186c4c+12:24068:x1876044666903424:12345-0@lo:501:mount.lustre.0 Request processed in 159us (9792us total) trans 0 rc -2/-2 00000100:00100000:2.0:1789136275.096961:0:23327:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1789136275.097132:0:24068:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7f662e580 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b11da215-324d-4c8d-90a5-0b7f26186c4c:24068:1876044666903424:0@lo:501:mount.lustre.0 10000000:01000000:1.0:1789136275.097158:0:24068:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.201.131@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:1.0:1789136275.097185:0:24068:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.201.131@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:1.0:1789136275.097195:0:24068:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.131@tcp lock: ffff90a7e1c9f400/0x559c8745c6de43ed lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x559c8745c6de43f4 expref: -99 pid: 23311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136275.097218:0:24068:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.131@tcp lock: ffff90a7e1c9f400/0x559c8745c6de43ed lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x559c8745c6de43f4 expref: -99 pid: 23311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789136275.097252:0:24068:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff90a6c3ba1800 10000000:01000000:1.0:1789136275.097257:0:24068:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1789136275.097263:0:24068:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff90a6c4709a48 10000000:01000000:1.0:1789136275.097266:0:24068:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:1.0:1789136275.097269:0:24068:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff90a6c4709a48 from 1 10000000:01000000:1.0:1789136275.097272:0:24068:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:1.0:1789136275.097305:0:24068:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.131@tcp lock: ffff90a7c167d800/0x559c8745c6de44fe lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 24068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136275.097313:0:24068:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.131@tcp lock: ffff90a7c167d800/0x559c8745c6de44fe lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 24068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136275.097323:0:24068:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.131@tcp lock: ffff90a7c167d800/0x559c8745c6de44fe lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 24068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789136275.097362:0:24068:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7f662e580 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b11da215-324d-4c8d-90a5-0b7f26186c4c:24068:1876044666903552:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1789136275.097564:0:24068:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789136275.097605:0:24068:0:(client.c:2715:ptlrpc_set_wait()) set ffff90a7e6e91840 going to sleep for 11 seconds 00000100:00100000:2.0:1789136275.098057:0:23327:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666903552 00000100:00100000:2.0:1789136275.098062:0:23327:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666903552 00000100:00100000:2.0:1789136275.098092:0:23327:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1789136275.098098:0:23327:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7c4fff450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b11da215-324d-4c8d-90a5-0b7f26186c4c+12:24068:x1876044666903552:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789136275.098108:0:23327:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789136275.098123:0:23327:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90a7d1879400/0x559c8745c6de4505 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x559c8745c6de44fe expref: -99 pid: 23327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136275.098145:0:23327:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90a7d1879400/0x559c8745c6de4505 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x559c8745c6de44fe expref: 13 pid: 23327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136275.098169:0:23327:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90a7d1879400/0x559c8745c6de4505 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x559c8745c6de44fe expref: 13 pid: 23327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136275.098177:0:23327:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a7d1879400, rc 0) 00000100:00100000:2.0:1789136275.098225:0:23327:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7c4fff450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b11da215-324d-4c8d-90a5-0b7f26186c4c+13:24068:x1876044666903552:12345-0@lo:101:mount.lustre.0 Request processed in 127us (661us total) trans 0 rc 0/0 00000100:00100000:2.0:1789136275.098232:0:23327:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1789136275.099083:0:24068:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7f662e580 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b11da215-324d-4c8d-90a5-0b7f26186c4c:24068:1876044666903552:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789136275.099102:0:24068:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.131@tcp lock: ffff90a7c167d800/0x559c8745c6de44fe lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x559c8745c6de4505 expref: -99 pid: 24068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136275.099112:0:24068:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.131@tcp lock: ffff90a7c167d800/0x559c8745c6de44fe lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x559c8745c6de4505 expref: -99 pid: 24068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789136275.099150:0:24068:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.131@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:1.0:1789136275.099172:0:24068:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.131@tcp lock: ffff90a7c167d800/0x559c8745c6de44fe lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x559c8745c6de4505 expref: -99 pid: 24068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136275.099178:0:24068:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.131@tcp lock: ffff90a7c167d800/0x559c8745c6de44fe lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x559c8745c6de4505 expref: -99 pid: 24068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789136275.099189:0:24068:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff90a6c3ba1800 10000000:01000000:1.0:1789136275.099194:0:24068:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:1.0:1789136275.099198:0:24068:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff90a6c3ba1800 from 1 10000000:01000000:1.0:1789136275.099201:0:24068:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:1.0:1789136275.099225:0:24068:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.131@tcp lock: ffff90a7c167c000/0x559c8745c6de450c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 24068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136275.099232:0:24068:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.131@tcp lock: ffff90a7c167c000/0x559c8745c6de450c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 24068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136275.099239:0:24068:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.131@tcp lock: ffff90a7c167c000/0x559c8745c6de450c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 24068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789136275.099257:0:24068:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7f662e580 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b11da215-324d-4c8d-90a5-0b7f26186c4c:24068:1876044666903680:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1789136275.099295:0:24068:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789136275.099337:0:24068:0:(client.c:2715:ptlrpc_set_wait()) set ffff90a7e6e91840 going to sleep for 11 seconds 00000100:00100000:2.0:1789136275.099586:0:23327:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666903680 00000100:00100000:2.0:1789136275.099591:0:23327:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666903680 00000100:00100000:2.0:1789136275.099631:0:23327:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1789136275.099639:0:23327:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7c4ffc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b11da215-324d-4c8d-90a5-0b7f26186c4c+13:24068:x1876044666903680:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789136275.099650:0:23327:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789136275.099659:0:23327:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90a7d1879000/0x559c8745c6de4513 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x559c8745c6de450c expref: -99 pid: 23327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136275.099676:0:23327:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90a7d1879000/0x559c8745c6de4513 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x559c8745c6de450c expref: 14 pid: 23327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136275.099686:0:23327:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90a7d1879000/0x559c8745c6de4513 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x559c8745c6de450c expref: 14 pid: 23327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136275.099694:0:23327:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a7d1879000, rc 0) 00000100:00100000:2.0:1789136275.099736:0:23327:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7c4ffc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b11da215-324d-4c8d-90a5-0b7f26186c4c+14:24068:x1876044666903680:12345-0@lo:101:mount.lustre.0 Request processed in 98us (439us total) trans 0 rc 0/0 00000100:00100000:2.0:1789136275.099742:0:23327:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1789136275.099910:0:24068:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7f662e580 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b11da215-324d-4c8d-90a5-0b7f26186c4c:24068:1876044666903680:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789136275.099922:0:24068:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.131@tcp lock: ffff90a7c167c000/0x559c8745c6de450c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x559c8745c6de4513 expref: -99 pid: 24068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136275.099931:0:24068:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.131@tcp lock: ffff90a7c167c000/0x559c8745c6de450c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x559c8745c6de4513 expref: -99 pid: 24068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789136275.099950:0:24068:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.131@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:1.0:1789136275.099964:0:24068:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.131@tcp lock: ffff90a7c167c000/0x559c8745c6de450c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x559c8745c6de4513 expref: -99 pid: 24068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136275.099971:0:24068:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.131@tcp lock: ffff90a7c167c000/0x559c8745c6de450c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x559c8745c6de4513 expref: -99 pid: 24068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789136275.099978:0:24068:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0001-0000000000000000 10000000:01000000:1.0:1789136275.099981:0:24068:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1789136275.099987:0:24068:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff90a6c3ba1800 10000000:01000000:1.0:1789136275.099989:0:24068:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:1.0:1789136275.099993:0:24068:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 1 10000000:01000000:1.0:1789136275.099995:0:24068:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:1.0:1789136275.100009:0:24068:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.131@tcp lock: ffff90a7c167de00/0x559c8745c6de451a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 24068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136275.100016:0:24068:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.131@tcp lock: ffff90a7c167de00/0x559c8745c6de451a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 24068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136275.100023:0:24068:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.131@tcp lock: ffff90a7c167de00/0x559c8745c6de451a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 24068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789136275.100037:0:24068:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7f662e580 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b11da215-324d-4c8d-90a5-0b7f26186c4c:24068:1876044666903808:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1789136275.100065:0:24068:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789136275.100087:0:24068:0:(client.c:2715:ptlrpc_set_wait()) set ffff90a7e6e91840 going to sleep for 11 seconds 00000100:00100000:0.0:1789136275.100157:0:23324:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666903808 00000100:00100000:0.0:1789136275.100162:0:23324:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666903808 00000100:00100000:0.0:1789136275.100183:0:23324:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1789136275.100189:0:23324:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7c4ffc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b11da215-324d-4c8d-90a5-0b7f26186c4c+14:24068:x1876044666903808:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1789136275.100195:0:23324:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789136275.100204:0:23324:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90a6c3caf000/0x559c8745c6de4521 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x559c8745c6de451a expref: -99 pid: 23324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136275.100217:0:23324:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90a6c3caf000/0x559c8745c6de4521 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x559c8745c6de451a expref: 15 pid: 23324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136275.100226:0:23324:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90a6c3caf000/0x559c8745c6de4521 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x559c8745c6de451a expref: 15 pid: 23324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136275.100232:0:23324:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a6c3caf000, rc 0) 00000100:00100000:0.0:1789136275.100268:0:23324:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7c4ffc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b11da215-324d-4c8d-90a5-0b7f26186c4c+15:24068:x1876044666903808:12345-0@lo:101:mount.lustre.0 Request processed in 79us (202us total) trans 0 rc 0/0 00000100:00100000:0.0:1789136275.100274:0:23324:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1789136275.100634:0:24068:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7f662e580 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b11da215-324d-4c8d-90a5-0b7f26186c4c:24068:1876044666903808:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789136275.100647:0:24068:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.131@tcp lock: ffff90a7c167de00/0x559c8745c6de451a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x559c8745c6de4521 expref: -99 pid: 24068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136275.100662:0:24068:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.131@tcp lock: ffff90a7c167de00/0x559c8745c6de451a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x559c8745c6de4521 expref: -99 pid: 24068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1789136275.103888:0:24068:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 46 count 46 00000040:00080000:1.0:1789136275.106278:0:24068:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1789136275.106566:0:24068:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].1, 224 off8416 00000040:00080000:1.0:1789136275.106593:0:24068:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].2, 136 off8552 00000040:00080000:1.0:1789136275.106608:0:24068:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].3, 176 off8728 00000040:00080000:1.0:1789136275.106621:0:24068:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].4, 224 off8952 00000040:00080000:1.0:1789136275.106637:0:24068:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].5, 224 off9176 00000040:00080000:1.0:1789136275.106652:0:24068:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].6, 120 off9296 00000040:00080000:1.0:1789136275.106666:0:24068:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].7, 112 off9408 00000040:00080000:1.0:1789136275.106680:0:24068:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].8, 160 off9568 00000040:00080000:1.0:1789136275.106705:0:24068:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].9, 224 off9792 00000040:00080000:1.0:1789136275.106720:0:24068:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].10, 224 off10016 00000040:00080000:1.0:1789136275.106733:0:24068:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].11, 88 off10104 00000040:00080000:1.0:1789136275.106746:0:24068:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].12, 144 off10248 00000040:00080000:1.0:1789136275.106779:0:24068:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].13, 152 off10400 00000040:00080000:1.0:1789136275.106796:0:24068:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].14, 168 off10568 00000040:00080000:1.0:1789136275.106810:0:24068:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].15, 224 off10792 00000040:00080000:1.0:1789136275.106823:0:24068:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].16, 224 off11016 00000040:00080000:1.0:1789136275.106837:0:24068:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].17, 80 off11096 00000040:00080000:1.0:1789136275.106851:0:24068:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].18, 224 off11320 00000040:00080000:1.0:1789136275.106891:0:24068:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].19, 224 off11544 00000040:00080000:1.0:1789136275.106905:0:24068:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].20, 160 off11704 00000040:00080000:1.0:1789136275.106918:0:24068:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].21, 224 off11928 00000040:00080000:1.0:1789136275.106934:0:24068:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].22, 224 off12152 00000040:00080000:1.0:1789136275.106948:0:24068:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].23, 80 off12232 00000040:00080000:1.0:1789136275.106961:0:24068:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].24, 224 off12456 00000040:00080000:1.0:1789136275.106974:0:24068:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].25, 224 off12680 00000040:00080000:1.0:1789136275.106987:0:24068:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].26, 88 off12768 00000040:00080000:1.0:1789136275.107013:0:24068:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].27, 144 off12912 00000040:00080000:1.0:1789136275.107027:0:24068:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].28, 152 off13064 00000040:00080000:1.0:1789136275.107041:0:24068:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].29, 136 off13200 00000040:00080000:1.0:1789136275.107055:0:24068:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].30, 224 off13424 00000040:00080000:1.0:1789136275.107067:0:24068:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].31, 224 off13648 00000040:00080000:1.0:1789136275.107080:0:24068:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].32, 80 off13728 00000040:00080000:1.0:1789136275.107093:0:24068:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].33, 224 off13952 00000040:00080000:1.0:1789136275.107106:0:24068:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].34, 224 off14176 00000040:00080000:1.0:1789136275.107119:0:24068:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].35, 88 off14264 00000040:00080000:1.0:1789136275.107131:0:24068:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].36, 144 off14408 00000040:00080000:1.0:1789136275.107144:0:24068:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].37, 152 off14560 00000040:00080000:1.0:1789136275.107157:0:24068:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].38, 136 off14696 00000040:00080000:1.0:1789136275.107169:0:24068:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].39, 224 off14920 00000040:00080000:1.0:1789136275.107180:0:24068:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].40, 224 off15144 00000040:00080000:1.0:1789136275.107192:0:24068:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].41, 80 off15224 00000040:00080000:1.0:1789136275.107206:0:24068:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].42, 224 off15448 00000040:00080000:1.0:1789136275.107219:0:24068:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].43, 224 off15672 00000040:00080000:1.0:1789136275.107232:0:24068:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].44, 120 off15792 00000040:00080000:1.0:1789136275.107252:0:24068:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].45, 224 off16016 00000040:00080000:1.0:1789136275.107258:0:24068:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 45 count 46 00000100:00100000:1.0:1789136275.107356:0:24068:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7f662e580 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b11da215-324d-4c8d-90a5-0b7f26186c4c:24068:1876044666903936:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789136275.107425:0:24068:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789136275.107477:0:24068:0:(client.c:2715:ptlrpc_set_wait()) set ffff90a7e6e91d80 going to sleep for 11 seconds 00000100:00100000:3.0:1789136275.107768:0:23324:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666903936 00000100:00100000:3.0:1789136275.107775:0:23324:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666903936 00000100:00100000:3.0:1789136275.107826:0:23324:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1789136275.107834:0:23324:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7c4ffd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b11da215-324d-4c8d-90a5-0b7f26186c4c+15:24068:x1876044666903936:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789136275.107977:0:23324:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7c4ffd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b11da215-324d-4c8d-90a5-0b7f26186c4c+15:24068:x1876044666903936:12345-0@lo:501:mount.lustre.0 Request processed in 143us (552us total) trans 0 rc 0/0 00000100:00100000:3.0:1789136275.107985:0:23324:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1789136275.108272:0:24068:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7f662e580 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b11da215-324d-4c8d-90a5-0b7f26186c4c:24068:1876044666903936:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789136275.108308:0:24068:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7f662e580 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b11da215-324d-4c8d-90a5-0b7f26186c4c:24068:1876044666904064:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1789136275.108390:0:24068:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789136275.108575:0:24068:0:(client.c:2715:ptlrpc_set_wait()) set ffff90a7e6e91d80 going to sleep for 11 seconds 00000100:00100000:3.0:1789136275.108738:0:23325:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666904064 00000100:00100000:3.0:1789136275.108742:0:23325:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666904064 00000100:00100000:3.0:1789136275.108944:0:23325:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1789136275.108952:0:23325:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7c4fffc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b11da215-324d-4c8d-90a5-0b7f26186c4c+15:24068:x1876044666904064:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1789136275.109841:0:24068:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7f662e580 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b11da215-324d-4c8d-90a5-0b7f26186c4c:24068:1876044666904064:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1789136275.110256:0:24068:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1789136275.110334:0:24068:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7f662e580 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b11da215-324d-4c8d-90a5-0b7f26186c4c:24068:1876044666904192:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789136275.110621:0:23325:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7c4fffc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b11da215-324d-4c8d-90a5-0b7f26186c4c+15:24068:x1876044666904064:12345-0@lo:503:mount.lustre.0 Request processed in 1668us (2274us total) trans 0 rc 0/0 00000100:00100000:3.0:1789136275.110631:0:23325:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1789136275.110993:0:24068:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789136275.111199:0:24068:0:(client.c:2715:ptlrpc_set_wait()) set ffff90a7e6e91c00 going to sleep for 11 seconds 00000100:00100000:0.0:1789136275.111235:0:23324:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666904192 00000100:00100000:0.0:1789136275.111242:0:23324:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666904192 00000100:00100000:3.0:1789136275.111296:0:23325:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1789136275.111305:0:23325:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7c4ffe450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b11da215-324d-4c8d-90a5-0b7f26186c4c+15:24068:x1876044666904192:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789136275.112211:0:23325:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7c4ffe450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b11da215-324d-4c8d-90a5-0b7f26186c4c+15:24068:x1876044666904192:12345-0@lo:502:mount.lustre.0 Request processed in 904us (1215us total) trans 0 rc 0/0 00000100:00100000:3.0:1789136275.112221:0:23325:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1789136275.112315:0:24068:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7f662e580 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b11da215-324d-4c8d-90a5-0b7f26186c4c:24068:1876044666904192:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1789136275.112622:0:24068:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].1, 224 off8416 00000040:00080000:1.0:1789136275.112654:0:24068:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].2, 136 off8552 00000040:00080000:1.0:1789136275.112668:0:24068:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].3, 176 off8728 00000040:00080000:1.0:1789136275.112681:0:24068:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].4, 224 off8952 00000040:00080000:1.0:1789136275.112693:0:24068:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].5, 224 off9176 00000040:00080000:1.0:1789136275.112708:0:24068:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].6, 120 off9296 00000040:00080000:1.0:1789136275.112721:0:24068:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].7, 112 off9408 00000040:00080000:1.0:1789136275.112733:0:24068:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].8, 160 off9568 00000040:00080000:1.0:1789136275.112751:0:24068:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].9, 224 off9792 00000040:00080000:1.0:1789136275.112839:0:24068:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].10, 224 off10016 00000040:00080000:1.0:1789136275.112891:0:24068:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].11, 88 off10104 00000040:00080000:1.0:1789136275.112910:0:24068:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].12, 144 off10248 00000040:00080000:1.0:1789136275.112924:0:24068:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].13, 152 off10400 00000040:00080000:1.0:1789136275.112939:0:24068:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].14, 168 off10568 00000040:00080000:1.0:1789136275.112952:0:24068:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].15, 224 off10792 00000040:00080000:1.0:1789136275.112963:0:24068:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].16, 224 off11016 00000040:00080000:1.0:1789136275.112975:0:24068:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].17, 80 off11096 00000040:00080000:1.0:1789136275.112987:0:24068:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].18, 224 off11320 00000040:00080000:1.0:1789136275.112999:0:24068:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].19, 224 off11544 00000040:00080000:1.0:1789136275.113012:0:24068:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].20, 160 off11704 00000040:00080000:1.0:1789136275.113025:0:24068:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].21, 224 off11928 00000040:00080000:1.0:1789136275.113037:0:24068:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].22, 224 off12152 00000040:00080000:1.0:1789136275.113048:0:24068:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].23, 80 off12232 00000040:00080000:1.0:1789136275.113062:0:24068:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].24, 224 off12456 00000040:00080000:1.0:1789136275.113075:0:24068:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].25, 224 off12680 00000040:00080000:1.0:1789136275.113090:0:24068:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].26, 88 off12768 00000040:00080000:1.0:1789136275.113104:0:24068:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].27, 144 off12912 00000040:00080000:1.0:1789136275.113128:0:24068:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].28, 152 off13064 00000040:00080000:1.0:1789136275.113141:0:24068:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].29, 136 off13200 00000040:00080000:1.0:1789136275.113153:0:24068:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].30, 224 off13424 00000040:00080000:1.0:1789136275.113167:0:24068:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].31, 224 off13648 00000040:00080000:1.0:1789136275.113180:0:24068:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].32, 80 off13728 00000040:00080000:1.0:1789136275.113192:0:24068:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].33, 224 off13952 00000040:00080000:1.0:1789136275.113205:0:24068:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].34, 224 off14176 00000040:00080000:1.0:1789136275.113218:0:24068:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].35, 88 off14264 00000040:00080000:1.0:1789136275.113232:0:24068:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].36, 144 off14408 00000040:00080000:1.0:1789136275.113247:0:24068:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].37, 152 off14560 00000040:00080000:1.0:1789136275.113262:0:24068:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].38, 136 off14696 00000040:00080000:1.0:1789136275.113276:0:24068:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].39, 224 off14920 00000040:00080000:1.0:1789136275.113291:0:24068:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].40, 224 off15144 00000040:00080000:1.0:1789136275.113307:0:24068:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].41, 80 off15224 00000040:00080000:1.0:1789136275.113320:0:24068:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].42, 224 off15448 00000040:00080000:1.0:1789136275.113335:0:24068:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].43, 224 off15672 00000040:00080000:1.0:1789136275.113348:0:24068:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].44, 120 off15792 00000100:00100000:1.0:1789136275.113384:0:24068:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7f662e580 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b11da215-324d-4c8d-90a5-0b7f26186c4c:24068:1876044666904320:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789136275.113527:0:24068:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789136275.113568:0:24068:0:(client.c:2715:ptlrpc_set_wait()) set ffff90a7e6e91c00 going to sleep for 11 seconds 00000100:00100000:2.0:1789136275.113662:0:23327:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666904320 00000100:00100000:2.0:1789136275.113669:0:23327:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666904320 00000100:00100000:2.0:1789136275.113727:0:23327:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1789136275.113736:0:23327:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7c4ffdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b11da215-324d-4c8d-90a5-0b7f26186c4c+15:24068:x1876044666904320:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789136275.114835:0:23327:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7c4ffdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b11da215-324d-4c8d-90a5-0b7f26186c4c+15:24068:x1876044666904320:12345-0@lo:502:mount.lustre.0 Request processed in 1094us (1312us total) trans 0 rc 0/0 00000100:00100000:2.0:1789136275.114845:0:23327:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1789136275.114980:0:24068:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7f662e580 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b11da215-324d-4c8d-90a5-0b7f26186c4c:24068:1876044666904320:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1789136275.115048:0:24068:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].45, 224 off16016 00000040:00080000:1.0:1789136275.115061:0:24068:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 45 count 46 00000020:01000000:1.0:1789136275.118136:0:24072:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789136275.118151:0:24072:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789136275.118154:0:24072:0:(obd_config.c:1563:class_process_config()) marker 11 (0x1) lustre-MDT0001-m lov setup 00000020:01000000:1.0:1789136275.118160:0:24072:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0001) 00000020:00000080:1.0:1789136275.118163:0:24072:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1789136275.118178:0:24072:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-mdtlov (ffff90a7fc3a9a48) 00000020:00000080:1.0:1789136275.118203:0:24072:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type lod with refcount 2 00000020:00000080:1.0:1789136275.118209:0:24072:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:1.0:1789136275.118318:0:24072:0:(osd_handler.c:8895:osd_obd_connect()) connect #1 00000020:00000080:1.0:1789136275.118325:0:24072:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x559c8745c6de452f 00000020:00000080:1.0:1789136275.118575:0:24072:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-mdtlov (uuid lustre-MDT0001-mdtlov_UUID) 00000020:01000000:1.0:1789136275.118579:0:24072:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789136275.118583:0:24072:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789136275.118584:0:24072:0:(obd_config.c:1563:class_process_config()) marker 11 (0x2) lustre-MDT0001-m lov setup 00000020:01000000:1.0:1789136275.118587:0:24072:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789136275.118591:0:24072:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789136275.118592:0:24072:0:(obd_config.c:1563:class_process_config()) marker 12 (0x1) lustre-MDT0001 add mdt 00000020:00000080:1.0:1789136275.118596:0:24072:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1789136275.118603:0:24072:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001 (ffff90a7fc3aced8) 00000020:00000080:1.0:1789136275.118613:0:24072:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type mdt with refcount 2 00000020:00000080:1.0:1789136275.118618:0:24072:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:1.0:1789136275.118620:0:24072:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0001 osc lustre-MDT0001-mdtlov mdc (null) 00000020:01000000:1.0:1789136275.118622:0:24072:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0001 00000020:00000080:1.0:1789136275.118628:0:24072:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1789136275.118670:0:24072:0:(tgt_mount.c:153:server_get_mount()) get mount ffff90a6c3ba1800 from lustre-MDT0001, refs=2 00000020:00000080:1.0:1789136275.118683:0:24072:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0001 (ffff90a6c3a41a48) 00000020:00000080:1.0:1789136275.118691:0:24072:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type mdd with refcount 2 00000004:01000000:1.0:1789136275.118765:0:24072:0:(lod_dev.c:2292:lod_obd_connect()) connect #0 00000020:00000080:1.0:1789136275.118771:0:24072:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x559c8745c6de4544 00000020:00000080:1.0:1789136275.118920:0:24072:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0001 (uuid lustre-MDD0001_UUID) 00000004:01000000:1.0:1789136275.118928:0:24072:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:1.0:1789136275.118932:0:24072:0:(genops.c:1385:class_connect()) connect: client lustre-MDD0001_UUID, cookie 0x559c8745c6de454b 00080000:01000000:1.0:1789136275.118938:0:24072:0:(osd_handler.c:8895:osd_obd_connect()) connect #2 00000020:00000080:1.0:1789136275.118941:0:24072:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x559c8745c6de4552 00010000:00010000:3.0:1789136275.176448:0:23320:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789136275.206512:0:24072:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0001_UUID-2 is initialized 00000001:00000004:2.0:1789136275.207850:0:24072:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 3, last_transno is 8589934595 00000001:00080000:2.0:1789136275.208301:0:24072:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0001: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:0.0:1789136275.211651:0:24072:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001 (uuid lustre-MDT0001_UUID) 00000020:01000000:0.0:1789136275.211667:0:24072:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789136275.211675:0:24072:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789136275.211677:0:24072:0:(obd_config.c:1563:class_process_config()) marker 12 (0x2) lustre-MDT0001 add mdt 00000020:01000000:0.0:1789136275.211681:0:24072:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789136275.211687:0:24072:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789136275.211689:0:24072:0:(obd_config.c:1563:class_process_config()) marker 13 (0x1) lustre-MDT0000 add osp 00000020:00000080:0.0:1789136275.211692:0:24072:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:0.0:1789136275.211705:0:24072:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.201.131@tcp to nid 0x20000c0a8c983 (192.168.201.131@tcp) 00000020:00000080:0.0:1789136275.211733:0:24072:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1789136275.211749:0:24072:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osp-MDT0001 (ffff90a8018d0000) 00000020:00000080:0.0:1789136275.211939:0:24072:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type osp with refcount 2 00000020:00000080:0.0:1789136275.211946:0:24072:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:0.0:1789136275.212023:0:24072:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0000-osp-MDT0001: connect to lustre-MDT0001-osd (lustre-MDT0000-osp-MDT0001) 00080000:01000000:0.0:1789136275.212030:0:24072:0:(osd_handler.c:8895:osd_obd_connect()) connect #3 00000020:00000080:0.0:1789136275.212036:0:24072:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x559c8745c6de4560 00010000:00080000:0.0:1789136275.212066:0:24072:0:(ldlm_lib.c:102:import_set_conn()) imp ffff90a7f0960000@lustre-MDT0000-osp-MDT0001: add connection 192.168.201.131@tcp at head 00010000:00010000:3.0:1789136275.226067:0:24072:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-osp-MDT0001-5 is initialized 00000020:00000080:1.0:1789136275.230219:0:24072:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osp-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:1.0:1789136275.230236:0:24072:0:(obd_config.c:1472:class_process_config()) processing cmd: cf014 00000004:01000000:1.0:1789136275.230282:0:24072:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0000_UUID idx:0 gen:1 00000020:00000080:1.0:1789136275.230309:0:24072:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x559c8745c6de4567 00000100:00080000:1.0:1789136275.230320:0:24072:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1789136275.230326:0:24072:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff90a7f0960000 using connection 192.168.201.131@tcp/0@lo 00000100:00100000:1.0:1789136275.230363:0:24072:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff90a7f662e580 x1876044666904448/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1789136275.230694:0:24072:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID 00000100:00100000:2.0:1789136275.230893:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7f662e580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3637:1876044666904448:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1789136275.230990:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789136275.231068:0:23338:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666904448 00000100:00100000:2.0:1789136275.231075:0:23338:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666904448 00000100:00100000:2.0:1789136275.231105:0:23338:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1789136275.231112:0:23338:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7c14b70c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3637:x1876044666904448:12345-0@lo:38:llog_process_th.0 00010000:00080000:2.0:1789136275.231134:0:23338:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 723 last 0 00000020:00000080:2.0:1789136275.231176:0:23338:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x559c8745c6de456e 00000004:00100000:2.0:1789136275.231190:0:23338:0:(mdt_handler.c:7306:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000001:00000004:2.0:1789136275.231197:0:23338:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 3, last_transno is 12884901888 00000020:01000000:1.0:1789136275.231352:0:24072:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789136275.231358:0:24072:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789136275.231360:0:24072:0:(obd_config.c:1563:class_process_config()) marker 13 (0x2) lustre-MDT0000 add osp 00000020:01000000:1.0:1789136275.231364:0:24072:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1789136275.231367:0:24072:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #14 00000020:01000000:1.0:1789136275.231368:0:24072:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1789136275.231370:0:24072:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1789136275.231372:0:24072:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1789136275.231374:0:24072:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789136275.231375:0:24072:0:(obd_config.c:1563:class_process_config()) marker 14 (0x6) lustre sys.timeout 00000020:01000000:1.0:1789136275.231378:0:24072:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789136275.231383:0:24072:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789136275.231384:0:24072:0:(obd_config.c:1563:class_process_config()) marker 15 (0x1) lustre-MDT0001 mdt.identity_upcall 00000020:00000080:1.0:1789136275.231460:0:24072:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:1.0:1789136275.231505:0:24072:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0001: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:1.0:1789136275.231537:0:24072:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789136275.231541:0:24072:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789136275.231542:0:24072:0:(obd_config.c:1563:class_process_config()) marker 15 (0x2) lustre-MDT0001 mdt.identity_upcall 00000020:01000000:1.0:1789136275.231545:0:24072:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1789136275.231547:0:24072:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #20 00000020:01000000:1.0:1789136275.231548:0:24072:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1789136275.231550:0:24072:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1789136275.231551:0:24072:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1789136275.231554:0:24072:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789136275.231555:0:24072:0:(obd_config.c:1563:class_process_config()) marker 20 (0x6) lustre sys.timeout 00000020:01000000:1.0:1789136275.231558:0:24072:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1789136275.231561:0:24072:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds2_flakey 00000020:00000080:1.0:1789136275.231564:0:24072:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789136275.231566:0:24072:0:(obd_config.c:1563:class_process_config()) marker 23 (0x1) lustre-OST0000 add osc 00000020:00000080:1.0:1789136275.231569:0:24072:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1789136275.231572:0:24072:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.201.131@tcp to nid 0x20000c0a8c983 (192.168.201.131@tcp) 00000020:01000000:1.0:1789136275.231600:0:24072:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0001) 00000020:00000080:1.0:1789136275.231602:0:24072:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1789136275.231616:0:24072:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0001 (ffff90a6c3a43490) 00000020:00000080:1.0:1789136275.231629:0:24072:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type osp with refcount 2 00000020:00000080:1.0:1789136275.231633:0:24072:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1789136275.231710:0:24072:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0001: connect to lustre-MDT0001-osd (lustre-OST0000-osc-MDT0001) 00080000:01000000:1.0:1789136275.231717:0:24072:0:(osd_handler.c:8895:osd_obd_connect()) connect #4 00000020:00000080:1.0:1789136275.231723:0:24072:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x559c8745c6de457c 00000100:00080000:3.0:1789136275.232525:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:3.0:1789136275.232532:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:3.0:1789136275.232536:0:487:0:(import.c:65:import_set_state_nolock()) ffff90a7fa659000 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1789136275.232541:0:487:0:(import.c:510:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 718 00000100:00080000:3.0:1789136275.232546:0:487:0:(import.c:589:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:3.0:1789136275.232551:0:487:0:(import.c:624:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff90a7fa659000 using connection 192.168.201.131@tcp/0@lo 00000100:00100000:3.0:1789136275.232593:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff90a7ff649a40 x1876044666904576/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1789136275.232616:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789136275.232620:0:487:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1789136275.232623:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789136275.232626:0:487:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1789136275.232671:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7ff6492c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3641:1876044666904704:0@lo:400:kworker.0 00000100:00100000:3.0:1789136275.232723:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:1.0:1789136275.233531:0:24072:0:(ldlm_lib.c:102:import_set_conn()) imp ffff90a7ff507800@lustre-OST0000-osc-MDT0001: add connection 192.168.201.131@tcp at head 00000100:00100000:2.0:1789136275.233910:0:23332:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666904704 00000100:00100000:2.0:1789136275.233919:0:23332:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666904704 00000100:00100000:2.0:1789136275.233967:0:23332:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1789136275.233977:0:23332:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7ff64b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1876044666904704:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789136275.234041:0:23332:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7ff64b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1876044666904704:12345-0@lo:400:kworker.0 Request processed in 66us (1317us total) trans 0 rc 0/0 00000100:00100000:2.0:1789136275.234048:0:23332:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1789136275.234094:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff90a7ff6492c0 x1876044666904704/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789136291 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789136275.234116:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7ff6492c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3641:1876044666904704:0@lo:400:kworker.0 00000100:00100000:2.0:1789136275.234146:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7ff649a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3637:1876044666904576:0@lo:38:kworker.0 00000100:00100000:2.0:1789136275.234189:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789136275.234226:0:23339:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 2 min 2 max 116 00000100:00100000:2.0:1789136275.234233:0:23339:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_002' 00000100:00100000:2.0:1789136275.234362:0:23339:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666904576 00000100:00100000:2.0:1789136275.234366:0:23339:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666904576 00000100:00100000:2.0:1789136275.234548:0:24077:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1789136275.234554:0:24077:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7c14b5680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3637:x1876044666904576:12345-0@lo:38:kworker.0 00000100:00100000:2.0:1789136275.234604:0:24077:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7c14b5680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3637:x1876044666904576:12345-0@lo:38:kworker.0 Request processed in 48us (414us total) trans 0 rc -11/-11 00000100:00100000:2.0:1789136275.234610:0:24077:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1789136275.234631:0:3637:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1789136275.234637:0:3637:0:(import.c:65:import_set_state_nolock()) ffff90a7fa659000 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1789136275.234641:0:3637:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-11) 00000100:00100000:2.0:1789136275.234645:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7ff649a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3637:1876044666904576:0@lo:38:kworker.0 00010000:00010000:1.0:1789136275.235346:0:24072:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0001-6 is initialized 00000040:01000000:2.0:1789136275.248897:0:24072:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:2.0:1789136275.249917:0:24072:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0001 ctxt 2 is initialized 00000040:00080000:2.0:1789136275.251977:0:24072:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00080000:2.0:1789136275.252723:0:23338:0:(import.c:65:import_set_state_nolock()) ffff90a7c6317800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789136275.252848:0:23338:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7c14b70c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3637:x1876044666904448:12345-0@lo:38:llog_process_th.0 Request processed in 21731us (21854us total) trans 0 rc 0/0 00000100:00100000:2.0:1789136275.252884:0:23338:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000040:00080000:0.0:1789136275.253021:0:24072:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].3, 64 off8384 00000040:00080000:0.0:1789136275.253191:0:24072:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xc:0x0].1, 64 off8256 00000100:00100000:1.0:1789136275.253593:0:3637:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:1.0:1789136275.253603:0:3637:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-osp-MDT0001: connect to target with instance 3 00000100:00080000:1.0:1789136275.253612:0:3637:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-osp-MDT0001: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:1.0:1789136275.253617:0:3637:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1789136275.253619:0:3637:0:(import.c:65:import_set_state_nolock()) ffff90a7f0960000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1789136275.253640:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7f662e580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3637:1876044666904448:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1789136275.253889:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7ff648b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1876044666904832:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1789136275.253946:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789136275.254244:0:23339:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666904832 00000100:00100000:3.0:1789136275.254251:0:23339:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666904832 00000100:00100000:3.0:1789136275.254297:0:23339:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1789136275.254306:0:23339:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7fa3bc3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3638:x1876044666904832:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1789136275.254336:0:23339:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446309888 avail 1300070400 00000100:00100000:3.0:1789136275.254586:0:23339:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7fa3bc3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3638:x1876044666904832:12345-0@lo:41:osp-pre-0-1.0 Request processed in 280us (639us total) trans 0 rc 0/0 00000100:00100000:3.0:1789136275.254594:0:23339:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000040:00080000:0.0:1789136275.254793:0:24078:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:0.0:1789136275.254798:0:24078:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xc:0x0] at index 3 of catalog [0x1:0x2:0x0] 00000020:00000080:0.0:1789136275.259509:0:24072:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:0.0:1789136275.259537:0:24072:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:0.0:1789136275.259589:0:24072:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:0.0:1789136275.259610:0:24072:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x559c8745c6de4583 00000100:00080000:0.0:1789136275.259620:0:24072:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1789136275.259627:0:24072:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff90a7ff507800 using connection 192.168.201.131@tcp/0@lo 00000100:00100000:0.0:1789136275.259662:0:24072:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff90a7fa3be580 x1876044666904960/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1789136275.259695:0:24072:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:0.0:1789136275.259763:0:24072:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789136275.259768:0:24072:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789136275.259770:0:24072:0:(obd_config.c:1563:class_process_config()) marker 23 (0x2) lustre-OST0000 add osc 00000020:01000000:0.0:1789136275.259773:0:24072:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:0.0:1789136275.259775:0:24072:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #28 00000020:01000000:0.0:1789136275.259791:0:24072:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1789136275.259793:0:24072:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1789136275.259794:0:24072:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:0.0:1789136275.259797:0:24072:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789136275.259798:0:24072:0:(obd_config.c:1563:class_process_config()) marker 28 (0x6) lustre sys.timeout 00000020:01000000:0.0:1789136275.259800:0:24072:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1789136275.259805:0:24072:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds2_flakey 00000020:00000080:0.0:1789136275.259809:0:24072:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789136275.259810:0:24072:0:(obd_config.c:1563:class_process_config()) marker 31 (0x1) lustre-OST0001 add osc 00000020:00000080:0.0:1789136275.259813:0:24072:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:0.0:1789136275.259817:0:24072:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.201.131@tcp to nid 0x20000c0a8c983 (192.168.201.131@tcp) 00000020:01000000:0.0:1789136275.259842:0:24072:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0001) 00000020:00000080:0.0:1789136275.259845:0:24072:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1789136275.259882:0:24072:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0001 (ffff90a8018d3490) 00000020:00000080:0.0:1789136275.259895:0:24072:0:(obd_config.c:720:class_attach_name()) OBD: dev 18 attached type osp with refcount 2 00000020:00000080:0.0:1789136275.259900:0:24072:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:0.0:1789136275.259984:0:24072:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0001: connect to lustre-MDT0001-osd (lustre-OST0001-osc-MDT0001) 00080000:01000000:0.0:1789136275.259993:0:24072:0:(osd_handler.c:8895:osd_obd_connect()) connect #5 00000020:00000080:0.0:1789136275.259999:0:24072:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x559c8745c6de4591 00010000:00080000:0.0:1789136275.260033:0:24072:0:(ldlm_lib.c:102:import_set_conn()) imp ffff90a7d8b2a800@lustre-OST0001-osc-MDT0001: add connection 192.168.201.131@tcp at head 00010000:00010000:0.0:1789136275.260232:0:24072:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0001-7 is initialized 00000040:01000000:0.0:1789136275.260309:0:24072:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:0.0:1789136275.260325:0:24072:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0001 ctxt 2 is initialized 00000100:00080000:3.0:1789136275.260533:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789136275.260539:0:487:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1789136275.260542:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789136275.260545:0:487:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1789136275.260883:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7fa3be580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3637:1876044666904960:0@lo:8:llog_process_th.0 00000400:00000100:2.0:1789136275.260951:0:3637:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1876044666904960 offset 0 length 520: 4 00000040:00080000:0.0:1789136275.265302:0:24072:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1789136275.266299:0:24072:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].3, 64 off8384 00000040:00080000:0.0:1789136275.266488:0:24072:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xe:0x0].1, 64 off8256 00000040:00080000:2.0:1789136275.267004:0:24080:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:2.0:1789136275.267010:0:24080:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 3 of catalog [0x1:0x5:0x0] 00000020:00000080:2.0:1789136275.267669:0:24072:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:2.0:1789136275.267685:0:24072:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:2.0:1789136275.267727:0:24072:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:2.0:1789136275.267767:0:24072:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x559c8745c6de4598 00000100:00080000:2.0:1789136275.267780:0:24072:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1789136275.267787:0:24072:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff90a7d8b2a800 using connection 192.168.201.131@tcp/0@lo 00000100:00100000:2.0:1789136275.267829:0:24072:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff90a7c14b6940 x1876044666905088/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1789136275.267887:0:24072:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:2.0:1789136275.267937:0:24072:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789136275.267941:0:24072:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789136275.267943:0:24072:0:(obd_config.c:1563:class_process_config()) marker 31 (0x2) lustre-OST0001 add osc 00000020:01000000:2.0:1789136275.267946:0:24072:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789136275.267951:0:24072:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789136275.267952:0:24072:0:(obd_config.c:1563:class_process_config()) marker 37 (0x1) lustre sys.timeout 00000020:00000080:2.0:1789136275.267956:0:24072:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1789136275.267957:0:24072:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1789136275.267960:0:24072:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789136275.267962:0:24072:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789136275.267963:0:24072:0:(obd_config.c:1563:class_process_config()) marker 37 (0x2) lustre sys.timeout 00000020:01000000:2.0:1789136275.267965:0:24072:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789136275.267968:0:24072:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789136275.267969:0:24072:0:(obd_config.c:1563:class_process_config()) marker 42 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1789136275.267972:0:24072:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:2.0:1789136275.267993:0:24072:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789136275.267995:0:24072:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789136275.267997:0:24072:0:(obd_config.c:1563:class_process_config()) marker 42 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1789136275.268000:0:24072:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xe:0x0] index 46 count 46 00000100:00100000:3.0:1789136275.268163:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7c14b6940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3637:1876044666905088:0@lo:8:llog_process_th.0 00000400:00000100:3.0:1789136275.268218:0:3637:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1876044666905088 offset 0 length 520: 4 00000100:00080000:3.0:1789136275.268277:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789136275.268281:0:487:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1789136275.268294:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789136275.268297:0:487:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000020:01000000:0.0:1789136275.268556:0:24068:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 1-45 (rc=0) 10000000:01000000:0.0:1789136275.268588:0:24068:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.131@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:0.0:1789136275.268613:0:24068:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.131@tcp lock: ffff90a7c167de00/0x559c8745c6de451a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x559c8745c6de4521 expref: -99 pid: 24068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136275.268623:0:24068:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.131@tcp lock: ffff90a7c167de00/0x559c8745c6de451a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x559c8745c6de4521 expref: -99 pid: 24068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789136275.268639:0:24068:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff90a6c3ba1800 from 1 10000000:01000000:0.0:1789136275.268642:0:24068:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1789136275.268668:0:24068:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.131@tcp lock: ffff90a6c3caea00/0x559c8745c6de459f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 24068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136275.268675:0:24068:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.131@tcp lock: ffff90a6c3caea00/0x559c8745c6de459f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 24068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136275.268686:0:24068:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.131@tcp lock: ffff90a6c3caea00/0x559c8745c6de459f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 24068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789136275.268702:0:24068:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7fa3bfc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b11da215-324d-4c8d-90a5-0b7f26186c4c:24068:1876044666905216:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1789136275.268742:0:24068:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789136275.269044:0:24068:0:(client.c:2715:ptlrpc_set_wait()) set ffff90a7d1bdee40 going to sleep for 11 seconds 00000100:00100000:1.0:1789136275.269169:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7ff648b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1876044666904832:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1789136275.274143:0:23324:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666905216 00000100:00100000:3.0:1789136275.274159:0:23324:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666905216 00000100:00100000:3.0:1789136275.274231:0:23324:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1789136275.274241:0:23324:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7c4ffc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b11da215-324d-4c8d-90a5-0b7f26186c4c+15:24068:x1876044666905216:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789136275.274259:0:23324:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789136275.274281:0:23324:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90a7e1c9fa00/0x559c8745c6de45a6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x559c8745c6de459f expref: -99 pid: 23324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136275.274307:0:23324:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90a7e1c9fa00/0x559c8745c6de45a6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x559c8745c6de459f expref: 16 pid: 23324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136275.274319:0:23324:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90a7e1c9fa00/0x559c8745c6de45a6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x559c8745c6de459f expref: 16 pid: 23324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136275.274327:0:23324:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a7e1c9fa00, rc 0) 00000100:00100000:3.0:1789136275.274438:0:23324:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7c4ffc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b11da215-324d-4c8d-90a5-0b7f26186c4c+16:24068:x1876044666905216:12345-0@lo:101:mount.lustre.0 Request processed in 197us (5695us total) trans 0 rc 0/0 00000100:00100000:3.0:1789136275.274446:0:23324:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1789136275.274601:0:24068:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7fa3bfc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b11da215-324d-4c8d-90a5-0b7f26186c4c:24068:1876044666905216:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1789136275.274620:0:24068:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.131@tcp lock: ffff90a6c3caea00/0x559c8745c6de459f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x559c8745c6de45a6 expref: -99 pid: 24068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136275.274631:0:24068:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.131@tcp lock: ffff90a6c3caea00/0x559c8745c6de459f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x559c8745c6de45a6 expref: -99 pid: 24068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789136275.275278:0:24068:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7fa3bfc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b11da215-324d-4c8d-90a5-0b7f26186c4c:24068:1876044666905344:0@lo:256:mount.lustre.0 00000100:00100000:0.0:1789136275.275328:0:24068:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789136275.275368:0:24068:0:(client.c:2715:ptlrpc_set_wait()) set ffff90a7d1bdee40 going to sleep for 11 seconds 00000100:00100000:2.0:1789136275.275441:0:23327:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666905344 00000100:00100000:2.0:1789136275.275447:0:23327:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666905344 00000100:00100000:2.0:1789136275.275485:0:23327:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1789136275.275491:0:23327:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7c4ffd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b11da215-324d-4c8d-90a5-0b7f26186c4c+16:24068:x1876044666905344:12345-0@lo:256:mount.lustre.0 20000000:01000000:2.0:1789136275.275507:0:23327:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:2.0:1789136275.275534:0:23327:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:2.0:1789136275.275538:0:23327:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 11 00000100:00100000:2.0:1789136275.275630:0:23327:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7c4ffd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b11da215-324d-4c8d-90a5-0b7f26186c4c+16:24068:x1876044666905344:12345-0@lo:256:mount.lustre.0 Request processed in 138us (301us total) trans 0 rc 0/0 00000100:00100000:2.0:1789136275.275637:0:23327:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1789136275.276141:0:24068:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7fa3bfc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b11da215-324d-4c8d-90a5-0b7f26186c4c:24068:1876044666905344:0@lo:256:mount.lustre.0 10000000:01000000:0.0:1789136275.277651:0:24068:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.131@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1789136275.277724:0:24068:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.131@tcp lock: ffff90a6c3caea00/0x559c8745c6de459f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x559c8745c6de45a6 expref: -99 pid: 24068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136275.277737:0:24068:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.131@tcp lock: ffff90a6c3caea00/0x559c8745c6de459f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x559c8745c6de45a6 expref: -99 pid: 24068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789136275.278398:0:24068:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff90a6c3ba1800 from 1 10000000:01000000:1.0:1789136275.278404:0:24068:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1789136275.278444:0:24068:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.131@tcp lock: ffff90a7c167d200/0x559c8745c6de45ad lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 24068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136275.278453:0:24068:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.131@tcp lock: ffff90a7c167d200/0x559c8745c6de45ad lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 24068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136275.278463:0:24068:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.131@tcp lock: ffff90a7c167d200/0x559c8745c6de45ad lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 24068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789136275.278487:0:24068:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7f662e580 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b11da215-324d-4c8d-90a5-0b7f26186c4c:24068:1876044666905472:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1789136275.278569:0:24068:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789136275.278627:0:24068:0:(client.c:2715:ptlrpc_set_wait()) set ffff90a7d95fc240 going to sleep for 11 seconds 00000100:00100000:3.0:1789136275.279662:0:23325:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666905472 00000100:00100000:3.0:1789136275.279672:0:23325:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666905472 00000100:00100000:3.0:1789136275.279732:0:23325:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1789136275.279742:0:23325:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7c4ffd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b11da215-324d-4c8d-90a5-0b7f26186c4c+16:24068:x1876044666905472:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789136275.279771:0:23325:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789136275.279789:0:23325:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90a7e1c9e200/0x559c8745c6de45b4 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x559c8745c6de45ad expref: -99 pid: 23325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136275.279833:0:23325:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90a7e1c9e200/0x559c8745c6de45b4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x559c8745c6de45ad expref: 17 pid: 23325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136275.279843:0:23325:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90a7e1c9e200/0x559c8745c6de45b4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x559c8745c6de45ad expref: 17 pid: 23325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136275.279881:0:23325:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a7e1c9e200, rc 0) 00000100:00100000:3.0:1789136275.279949:0:23325:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7c4ffd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b11da215-324d-4c8d-90a5-0b7f26186c4c+17:24068:x1876044666905472:12345-0@lo:101:mount.lustre.0 Request processed in 208us (1379us total) trans 0 rc 0/0 00000100:00100000:3.0:1789136275.279956:0:23325:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1789136275.280249:0:24068:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7f662e580 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b11da215-324d-4c8d-90a5-0b7f26186c4c:24068:1876044666905472:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1789136275.280266:0:24068:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.131@tcp lock: ffff90a7c167d200/0x559c8745c6de45ad lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x559c8745c6de45b4 expref: -99 pid: 24068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136275.280275:0:24068:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.131@tcp lock: ffff90a7c167d200/0x559c8745c6de45ad lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x559c8745c6de45b4 expref: -99 pid: 24068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1789136275.286722:0:24068:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 19 count 19 00000040:00080000:0.0:1789136275.287077:0:24068:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1789136275.287279:0:24068:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].1, 224 off8416 00000040:00080000:0.0:1789136275.287305:0:24068:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].2, 112 off8528 00000040:00080000:0.0:1789136275.287320:0:24068:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].3, 224 off8752 00000040:00080000:0.0:1789136275.287333:0:24068:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].4, 224 off8976 00000040:00080000:0.0:1789136275.287373:0:24068:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].5, 112 off9088 00000040:00080000:0.0:1789136275.287390:0:24068:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].6, 224 off9312 00000040:00080000:0.0:1789136275.287402:0:24068:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].7, 224 off9536 00000040:00080000:0.0:1789136275.287417:0:24068:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].8, 144 off9680 00000040:00080000:0.0:1789136275.287430:0:24068:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].9, 224 off9904 00000040:00080000:0.0:1789136275.287442:0:24068:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].10, 224 off10128 00000040:00080000:0.0:1789136275.287453:0:24068:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].11, 144 off10272 00000040:00080000:0.0:1789136275.287468:0:24068:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].12, 224 off10496 00000040:00080000:0.0:1789136275.287495:0:24068:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].13, 224 off10720 00000040:00080000:0.0:1789136275.287509:0:24068:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].14, 128 off10848 00000040:00080000:0.0:1789136275.287533:0:24068:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].15, 224 off11072 00000040:00080000:0.0:1789136275.287545:0:24068:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].16, 224 off11296 00000040:00080000:0.0:1789136275.287571:0:24068:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].17, 128 off11424 00000040:00080000:0.0:1789136275.287592:0:24068:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].18, 224 off11648 00000040:00080000:0.0:1789136275.287598:0:24068:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 18 count 19 00000100:00100000:0.0:1789136275.287673:0:24068:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7fa3bfc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b11da215-324d-4c8d-90a5-0b7f26186c4c:24068:1876044666905600:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789136275.287737:0:24068:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789136275.288174:0:24068:0:(client.c:2715:ptlrpc_set_wait()) set ffff90a7d1bde180 going to sleep for 11 seconds 00000100:00100000:3.0:1789136275.289489:0:23324:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666905600 00000100:00100000:3.0:1789136275.289500:0:23324:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666905600 00000100:00100000:3.0:1789136275.289625:0:23324:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1789136275.289636:0:23324:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7c4ffe850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b11da215-324d-4c8d-90a5-0b7f26186c4c+17:24068:x1876044666905600:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789136275.289812:0:23324:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7c4ffe850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b11da215-324d-4c8d-90a5-0b7f26186c4c+17:24068:x1876044666905600:12345-0@lo:501:mount.lustre.0 Request processed in 177us (2073us total) trans 0 rc 0/0 00000100:00100000:3.0:1789136275.289820:0:23324:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1789136275.289931:0:24068:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7fa3bfc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b11da215-324d-4c8d-90a5-0b7f26186c4c:24068:1876044666905600:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789136275.289978:0:24068:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7fa3bfc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b11da215-324d-4c8d-90a5-0b7f26186c4c:24068:1876044666905728:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1789136275.290032:0:24068:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789136275.296202:0:24068:0:(client.c:2715:ptlrpc_set_wait()) set ffff90a7d1bde180 going to sleep for 11 seconds 00000100:00100000:1.0:1789136275.299802:0:23325:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666905728 00000100:00100000:1.0:1789136275.299819:0:23325:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666905728 00000100:00100000:1.0:1789136275.299908:0:23325:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1789136275.299919:0:23325:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7c4ffe050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b11da215-324d-4c8d-90a5-0b7f26186c4c+17:24068:x1876044666905728:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1789136275.300144:0:23325:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7c4ffe050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b11da215-324d-4c8d-90a5-0b7f26186c4c+17:24068:x1876044666905728:12345-0@lo:503:mount.lustre.0 Request processed in 225us (10110us total) trans 0 rc 0/0 00000100:00100000:1.0:1789136275.300152:0:23325:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1789136275.300239:0:24068:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7fa3bfc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b11da215-324d-4c8d-90a5-0b7f26186c4c:24068:1876044666905728:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1789136275.300771:0:24068:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1789136275.300883:0:24068:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7f662f0c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b11da215-324d-4c8d-90a5-0b7f26186c4c:24068:1876044666905856:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789136275.300935:0:24068:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789136275.300974:0:24068:0:(client.c:2715:ptlrpc_set_wait()) set ffff90a7e1f7a3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789136275.300994:0:23325:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666905856 00000100:00100000:1.0:1789136275.300999:0:23325:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666905856 00000100:00100000:1.0:1789136275.301021:0:23325:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1789136275.301027:0:23325:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7c4fff050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b11da215-324d-4c8d-90a5-0b7f26186c4c+17:24068:x1876044666905856:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789136275.301112:0:23325:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7c4fff050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b11da215-324d-4c8d-90a5-0b7f26186c4c+17:24068:x1876044666905856:12345-0@lo:502:mount.lustre.0 Request processed in 83us (176us total) trans 0 rc 0/0 00000100:00100000:1.0:1789136275.301118:0:23325:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1789136275.301158:0:24068:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7f662f0c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b11da215-324d-4c8d-90a5-0b7f26186c4c:24068:1876044666905856:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1789136275.301309:0:24068:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].1, 224 off8416 00000040:00080000:1.0:1789136275.301332:0:24068:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].2, 112 off8528 00000040:00080000:1.0:1789136275.301346:0:24068:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].3, 224 off8752 00000040:00080000:1.0:1789136275.301360:0:24068:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].4, 224 off8976 00000040:00080000:1.0:1789136275.301385:0:24068:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].5, 112 off9088 00000040:00080000:1.0:1789136275.301400:0:24068:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].6, 224 off9312 00000040:00080000:1.0:1789136275.301425:0:24068:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].7, 224 off9536 00000040:00080000:1.0:1789136275.301441:0:24068:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].8, 144 off9680 00000040:00080000:1.0:1789136275.301453:0:24068:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].9, 224 off9904 00000040:00080000:1.0:1789136275.301465:0:24068:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].10, 224 off10128 00000040:00080000:1.0:1789136275.301477:0:24068:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].11, 144 off10272 00000040:00080000:1.0:1789136275.301490:0:24068:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].12, 224 off10496 00000040:00080000:1.0:1789136275.301501:0:24068:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].13, 224 off10720 00000040:00080000:1.0:1789136275.301527:0:24068:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].14, 128 off10848 00000040:00080000:1.0:1789136275.301543:0:24068:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].15, 224 off11072 00000040:00080000:1.0:1789136275.301556:0:24068:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].16, 224 off11296 00000040:00080000:1.0:1789136275.301570:0:24068:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].17, 128 off11424 00000100:00100000:1.0:1789136275.301591:0:24068:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7f662f0c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b11da215-324d-4c8d-90a5-0b7f26186c4c:24068:1876044666905984:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789136275.301624:0:24068:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789136275.301641:0:24068:0:(client.c:2715:ptlrpc_set_wait()) set ffff90a7fa6c5d80 going to sleep for 11 seconds 00000100:00100000:1.0:1789136275.301657:0:23325:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666905984 00000100:00100000:1.0:1789136275.301660:0:23325:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666905984 00000100:00100000:1.0:1789136275.301679:0:23325:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1789136275.301683:0:23325:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7c4fff850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b11da215-324d-4c8d-90a5-0b7f26186c4c+17:24068:x1876044666905984:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789136275.301744:0:23325:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7c4fff850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b11da215-324d-4c8d-90a5-0b7f26186c4c+17:24068:x1876044666905984:12345-0@lo:502:mount.lustre.0 Request processed in 59us (119us total) trans 0 rc 0/0 00000100:00100000:1.0:1789136275.301750:0:23325:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1789136275.301787:0:24068:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7f662f0c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b11da215-324d-4c8d-90a5-0b7f26186c4c:24068:1876044666905984:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1789136275.301822:0:24068:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].18, 224 off11648 00000040:00080000:1.0:1789136275.301830:0:24068:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 18 count 19 00000020:01000000:1.0:1789136275.302235:0:24082:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789136275.302244:0:24082:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789136275.302247:0:24082:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:1.0:1789136275.302259:0:24082:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff90a6c3ba1800 00000020:00000080:1.0:1789136275.302262:0:24082:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1789136275.302270:0:24082:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789136275.302272:0:24082:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789136275.302273:0:24082:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:1.0:1789136275.302276:0:24082:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789136275.302278:0:24082:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789136275.302280:0:24082:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:1.0:1789136275.302283:0:24082:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff90a6c3ba1800 00000020:00000080:1.0:1789136275.302285:0:24082:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1789136275.302336:0:24082:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789136275.306591:0:24082:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789136275.306599:0:24082:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:3.0:1789136275.306612:0:24082:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789136275.306619:0:24082:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789136275.306621:0:24082:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre lod.lustre-MDT0000-mdtlov.enable_compr_rotational 00000020:01000000:3.0:1789136275.306626:0:24082:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff90a6c3ba1800 00000020:00000080:3.0:1789136275.306630:0:24082:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1789136275.306687:0:24082:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789136275.306691:0:24082:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789136275.306692:0:24082:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre lod.lustre-MDT0000-mdtlov.enable_compr_rotational 00000020:01000000:3.0:1789136275.306694:0:24082:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789136275.306709:0:24082:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789136275.306711:0:24082:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre lod.lustre-MDT0001-mdtlov.enable_compr_rotational 00000020:01000000:3.0:1789136275.306715:0:24082:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff90a6c3ba1800 00000020:00000080:3.0:1789136275.306717:0:24082:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1789136275.306734:0:24082:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789136275.306737:0:24082:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789136275.306738:0:24082:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre lod.lustre-MDT0001-mdtlov.enable_compr_rotational 00000020:01000000:3.0:1789136275.306740:0:24082:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789136275.306743:0:24082:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789136275.306744:0:24082:0:(obd_config.c:1563:class_process_config()) marker 6 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1789136275.306747:0:24082:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff90a6c3ba1800 00000020:00000080:3.0:1789136275.306749:0:24082:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1789136275.306763:0:24082:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789136275.306766:0:24082:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789136275.306767:0:24082:0:(obd_config.c:1563:class_process_config()) marker 6 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1789136275.306769:0:24082:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789136275.306772:0:24082:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789136275.306773:0:24082:0:(obd_config.c:1563:class_process_config()) marker 7 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:3.0:1789136275.306776:0:24082:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff90a6c3ba1800 00000020:00000080:3.0:1789136275.306778:0:24082:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1789136275.306819:0:24082:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789136275.306822:0:24082:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789136275.306824:0:24082:0:(obd_config.c:1563:class_process_config()) marker 7 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:3.0:1789136275.306827:0:24082:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x10:0x0] index 19 count 19 00000020:01000000:2.0:1789136275.307706:0:24068:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-18 (rc=0) 10000000:01000000:2.0:1789136275.307745:0:24068:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.131@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1789136275.307768:0:24068:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.131@tcp lock: ffff90a7c167d200/0x559c8745c6de45ad lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x559c8745c6de45b4 expref: -99 pid: 24068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136275.307781:0:24068:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.131@tcp lock: ffff90a7c167d200/0x559c8745c6de45ad lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x559c8745c6de45b4 expref: -99 pid: 24068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789136275.307836:0:24068:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1789136275.307839:0:24068:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff90a6c3ba1800 10000000:01000000:2.0:1789136275.307842:0:24068:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff90a6c3ba1800 10000000:01000000:2.0:1789136275.307845:0:24068:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1789136275.307878:0:24068:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff90a6c3ba1800 from 1 10000000:01000000:2.0:1789136275.307882:0:24068:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1789136275.307920:0:24068:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.131@tcp lock: ffff90a7d1879e00/0x559c8745c6de45bb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 24068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136275.307929:0:24068:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.131@tcp lock: ffff90a7d1879e00/0x559c8745c6de45bb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 24068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136275.307940:0:24068:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.131@tcp lock: ffff90a7d1879e00/0x559c8745c6de45bb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 24068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789136275.307979:0:24068:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7c14b5e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b11da215-324d-4c8d-90a5-0b7f26186c4c:24068:1876044666906112:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1789136275.308043:0:24068:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789136275.309536:0:24068:0:(client.c:2715:ptlrpc_set_wait()) set ffff90a7fa302f00 going to sleep for 11 seconds 00000100:00100000:3.0:1789136275.316669:0:23325:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666906112 00000100:00100000:3.0:1789136275.316685:0:23325:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666906112 00000100:00100000:3.0:1789136275.316749:0:23325:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1789136275.316760:0:23325:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7c4ffcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b11da215-324d-4c8d-90a5-0b7f26186c4c+17:24068:x1876044666906112:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789136275.316778:0:23325:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789136275.316797:0:23325:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90a7e1c9ec00/0x559c8745c6de45c2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x559c8745c6de45bb expref: -99 pid: 23325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136275.316840:0:23325:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90a7e1c9ec00/0x559c8745c6de45c2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x559c8745c6de45bb expref: 18 pid: 23325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136275.316870:0:23325:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90a7e1c9ec00/0x559c8745c6de45c2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x559c8745c6de45bb expref: 18 pid: 23325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136275.316881:0:23325:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a7e1c9ec00, rc 0) 00000100:00100000:3.0:1789136275.316958:0:23325:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7c4ffcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b11da215-324d-4c8d-90a5-0b7f26186c4c+18:24068:x1876044666906112:12345-0@lo:101:mount.lustre.0 Request processed in 199us (8914us total) trans 0 rc 0/0 00000100:00100000:3.0:1789136275.316965:0:23325:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1789136275.317026:0:24068:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7c14b5e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b11da215-324d-4c8d-90a5-0b7f26186c4c:24068:1876044666906112:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789136275.317043:0:24068:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.131@tcp lock: ffff90a7d1879e00/0x559c8745c6de45bb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x559c8745c6de45c2 expref: -99 pid: 24068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136275.317053:0:24068:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.131@tcp lock: ffff90a7d1879e00/0x559c8745c6de45bb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x559c8745c6de45c2 expref: -99 pid: 24068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1789136275.334530:0:24068:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xc:0x0] index 52 count 51 00000040:00080000:3.0:1789136275.334844:0:24068:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1789136275.335069:0:24068:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].1, 224 off8416 00000040:00080000:3.0:1789136275.335092:0:24068:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].2, 120 off8536 00000040:00080000:3.0:1789136275.335119:0:24068:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].3, 168 off8704 00000040:00080000:3.0:1789136275.335133:0:24068:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].4, 224 off8928 00000040:00080000:3.0:1789136275.335145:0:24068:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].5, 224 off9152 00000040:00080000:3.0:1789136275.335157:0:24068:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].6, 120 off9272 00000040:00080000:3.0:1789136275.335169:0:24068:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].7, 168 off9440 00000040:00080000:3.0:1789136275.335181:0:24068:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].8, 224 off9664 00000040:00080000:3.0:1789136275.335192:0:24068:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].9, 224 off9888 00000040:00080000:3.0:1789136275.335211:0:24068:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].10, 120 off10008 00000040:00080000:3.0:1789136275.335223:0:24068:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].11, 224 off10232 00000040:00080000:3.0:1789136275.335236:0:24068:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].12, 224 off10456 00000040:00080000:3.0:1789136275.335249:0:24068:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].13, 88 off10544 00000040:00080000:3.0:1789136275.335261:0:24068:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].14, 128 off10672 00000040:00080000:3.0:1789136275.335275:0:24068:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].15, 144 off10816 00000040:00080000:3.0:1789136275.335289:0:24068:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].16, 160 off10976 00000040:00080000:3.0:1789136275.335301:0:24068:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].17, 224 off11200 00000040:00080000:3.0:1789136275.335312:0:24068:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].18, 224 off11424 00000040:00080000:3.0:1789136275.335337:0:24068:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].19, 80 off11504 00000040:00080000:3.0:1789136275.335606:0:24068:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].20, 224 off11728 00000040:00080000:3.0:1789136275.335623:0:24068:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].21, 224 off11952 00000040:00080000:3.0:1789136275.335638:0:24068:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].22, 88 off12040 00000040:00080000:3.0:1789136275.335652:0:24068:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].23, 128 off12168 00000040:00080000:3.0:1789136275.335666:0:24068:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].24, 144 off12312 00000040:00080000:3.0:1789136275.335678:0:24068:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].25, 160 off12472 00000040:00080000:3.0:1789136275.335690:0:24068:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].26, 224 off12696 00000040:00080000:3.0:1789136275.335702:0:24068:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].27, 224 off12920 00000040:00080000:3.0:1789136275.335713:0:24068:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].28, 80 off13000 00000040:00080000:3.0:1789136275.335725:0:24068:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].29, 224 off13224 00000040:00080000:3.0:1789136275.335737:0:24068:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].30, 224 off13448 00000040:00080000:3.0:1789136275.335811:0:24068:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].31, 88 off13536 00000040:00080000:3.0:1789136275.335828:0:24068:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].32, 128 off13664 00000040:00080000:3.0:1789136275.335840:0:24068:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].33, 144 off13808 00000040:00080000:3.0:1789136275.335990:0:24068:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].34, 128 off13936 00000040:00080000:3.0:1789136275.336025:0:24068:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].35, 224 off14160 00000040:00080000:3.0:1789136275.336041:0:24068:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].36, 224 off14384 00000040:00080000:3.0:1789136275.336055:0:24068:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].37, 80 off14464 00000040:00080000:3.0:1789136275.336069:0:24068:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].38, 224 off14688 00000040:00080000:3.0:1789136275.336080:0:24068:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].39, 224 off14912 00000040:00080000:3.0:1789136275.336092:0:24068:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].40, 88 off15000 00000040:00080000:3.0:1789136275.336104:0:24068:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].41, 128 off15128 00000040:00080000:3.0:1789136275.336118:0:24068:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].42, 144 off15272 00000040:00080000:3.0:1789136275.336140:0:24068:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].43, 128 off15400 00000040:00080000:3.0:1789136275.336156:0:24068:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].44, 224 off15624 00000040:00080000:3.0:1789136275.336168:0:24068:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].45, 224 off15848 00000040:00080000:3.0:1789136275.336181:0:24068:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].46, 80 off15928 00000040:00080000:3.0:1789136275.336194:0:24068:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].47, 224 off16152 00000040:00080000:3.0:1789136275.336207:0:24068:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].48, 232 off16384 00000040:00080000:3.0:1789136275.336330:0:24068:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].49, 224 off16608 00000040:00080000:3.0:1789136275.338596:0:24068:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].50, 120 off16728 00000040:00080000:3.0:1789136275.338640:0:24068:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].51, 224 off16952 00000040:00080000:3.0:1789136275.338647:0:24068:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xc:0x0] index 51 count 51 00000100:00100000:3.0:1789136275.338764:0:24068:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7ff64a580 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b11da215-324d-4c8d-90a5-0b7f26186c4c:24068:1876044666906240:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789136275.338833:0:24068:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789136275.338902:0:24068:0:(client.c:2715:ptlrpc_set_wait()) set ffff90a7e6eb8540 going to sleep for 11 seconds 00000100:00100000:2.0:1789136275.339131:0:23327:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666906240 00000100:00100000:2.0:1789136275.339139:0:23327:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666906240 00000100:00100000:2.0:1789136275.341106:0:23327:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1789136275.341126:0:23327:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7c4ffec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b11da215-324d-4c8d-90a5-0b7f26186c4c+18:24068:x1876044666906240:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789136275.341320:0:23327:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7c4ffec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b11da215-324d-4c8d-90a5-0b7f26186c4c+18:24068:x1876044666906240:12345-0@lo:501:mount.lustre.0 Request processed in 201us (2485us total) trans 0 rc 0/0 00000100:00100000:2.0:1789136275.341328:0:23327:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1789136275.341571:0:24068:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7ff64a580 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b11da215-324d-4c8d-90a5-0b7f26186c4c:24068:1876044666906240:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789136275.341620:0:24068:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7c14b4b40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b11da215-324d-4c8d-90a5-0b7f26186c4c:24068:1876044666906368:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1789136275.341670:0:24068:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789136275.341709:0:24068:0:(client.c:2715:ptlrpc_set_wait()) set ffff90a7fa3029c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789136275.341728:0:23324:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666906368 00000100:00100000:2.0:1789136275.341734:0:23324:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666906368 00000100:00100000:2.0:1789136275.342010:0:23324:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1789136275.342018:0:23324:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7dd563050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b11da215-324d-4c8d-90a5-0b7f26186c4c+18:24068:x1876044666906368:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1789136275.342102:0:23324:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7dd563050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b11da215-324d-4c8d-90a5-0b7f26186c4c+18:24068:x1876044666906368:12345-0@lo:503:mount.lustre.0 Request processed in 85us (432us total) trans 0 rc 0/0 00000100:00100000:2.0:1789136275.342109:0:23324:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1789136275.342150:0:24068:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7c14b4b40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b11da215-324d-4c8d-90a5-0b7f26186c4c:24068:1876044666906368:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1789136275.348236:0:24068:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1789136275.348375:0:24068:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7c14b4b40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b11da215-324d-4c8d-90a5-0b7f26186c4c:24068:1876044666906496:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789136275.348461:0:24068:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789136275.349910:0:24068:0:(client.c:2715:ptlrpc_set_wait()) set ffff90a7fa3029c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789136275.363682:0:23325:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666906496 00000100:00100000:3.0:1789136275.363697:0:23325:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666906496 00000100:00100000:3.0:1789136275.363765:0:23325:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1789136275.363776:0:23325:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7dd562050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b11da215-324d-4c8d-90a5-0b7f26186c4c+18:24068:x1876044666906496:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789136275.363974:0:23325:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7dd562050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b11da215-324d-4c8d-90a5-0b7f26186c4c+18:24068:x1876044666906496:12345-0@lo:502:mount.lustre.0 Request processed in 200us (15513us total) trans 0 rc 0/0 00000100:00100000:3.0:1789136275.363981:0:23325:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1789136275.365286:0:24068:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7c14b4b40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b11da215-324d-4c8d-90a5-0b7f26186c4c:24068:1876044666906496:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1789136275.365540:0:24068:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].1, 224 off8416 00000040:00080000:3.0:1789136275.365571:0:24068:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].2, 120 off8536 00000040:00080000:3.0:1789136275.365587:0:24068:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].3, 168 off8704 00000040:00080000:3.0:1789136275.365601:0:24068:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].4, 224 off8928 00000040:00080000:3.0:1789136275.365614:0:24068:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].5, 224 off9152 00000040:00080000:3.0:1789136275.365627:0:24068:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].6, 120 off9272 00000040:00080000:3.0:1789136275.365640:0:24068:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].7, 168 off9440 00000040:00080000:3.0:1789136275.365653:0:24068:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].8, 224 off9664 00000040:00080000:3.0:1789136275.365679:0:24068:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].9, 224 off9888 00000040:00080000:3.0:1789136275.365693:0:24068:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].10, 120 off10008 00000040:00080000:3.0:1789136275.365707:0:24068:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].11, 224 off10232 00000040:00080000:3.0:1789136275.365721:0:24068:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].12, 224 off10456 00000040:00080000:3.0:1789136275.365734:0:24068:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].13, 88 off10544 00000040:00080000:3.0:1789136275.366080:0:24068:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].14, 128 off10672 00000040:00080000:3.0:1789136275.366106:0:24068:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].15, 144 off10816 00000040:00080000:3.0:1789136275.366120:0:24068:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].16, 160 off10976 00000040:00080000:3.0:1789136275.366134:0:24068:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].17, 224 off11200 00000040:00080000:3.0:1789136275.366147:0:24068:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].18, 224 off11424 00000040:00080000:3.0:1789136275.366159:0:24068:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].19, 80 off11504 00000040:00080000:3.0:1789136275.366172:0:24068:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].20, 224 off11728 00000040:00080000:3.0:1789136275.366186:0:24068:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].21, 224 off11952 00000040:00080000:3.0:1789136275.366198:0:24068:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].22, 88 off12040 00000040:00080000:3.0:1789136275.366211:0:24068:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].23, 128 off12168 00000040:00080000:3.0:1789136275.366239:0:24068:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].24, 144 off12312 00000040:00080000:3.0:1789136275.366255:0:24068:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].25, 160 off12472 00000040:00080000:3.0:1789136275.366268:0:24068:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].26, 224 off12696 00000040:00080000:3.0:1789136275.366282:0:24068:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].27, 224 off12920 00000040:00080000:3.0:1789136275.366296:0:24068:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].28, 80 off13000 00000040:00080000:3.0:1789136275.366310:0:24068:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].29, 224 off13224 00000040:00080000:3.0:1789136275.366322:0:24068:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].30, 224 off13448 00000040:00080000:3.0:1789136275.366334:0:24068:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].31, 88 off13536 00000040:00080000:3.0:1789136275.366397:0:24068:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].32, 128 off13664 00000040:00080000:3.0:1789136275.366416:0:24068:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].33, 144 off13808 00000040:00080000:3.0:1789136275.366429:0:24068:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].34, 128 off13936 00000040:00080000:3.0:1789136275.366441:0:24068:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].35, 224 off14160 00000040:00080000:3.0:1789136275.366453:0:24068:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].36, 224 off14384 00000040:00080000:3.0:1789136275.366466:0:24068:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].37, 80 off14464 00000040:00080000:3.0:1789136275.366477:0:24068:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].38, 224 off14688 00000040:00080000:3.0:1789136275.366490:0:24068:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].39, 224 off14912 00000040:00080000:3.0:1789136275.366526:0:24068:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].40, 88 off15000 00000040:00080000:3.0:1789136275.366543:0:24068:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].41, 128 off15128 00000040:00080000:3.0:1789136275.366565:0:24068:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].42, 144 off15272 00000040:00080000:3.0:1789136275.366579:0:24068:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].43, 128 off15400 00000040:00080000:3.0:1789136275.366591:0:24068:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].44, 224 off15624 00000040:00080000:3.0:1789136275.366604:0:24068:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].45, 224 off15848 00000040:00080000:3.0:1789136275.366617:0:24068:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].46, 80 off15928 00000040:00080000:3.0:1789136275.366630:0:24068:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].47, 224 off16152 00000040:00080000:3.0:1789136275.366642:0:24068:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].48, 232 off16384 00000100:00100000:3.0:1789136275.366689:0:24068:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7ff64ad00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b11da215-324d-4c8d-90a5-0b7f26186c4c:24068:1876044666906624:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789136275.368458:0:24068:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789136275.368511:0:24068:0:(client.c:2715:ptlrpc_set_wait()) set ffff90a7e6eb8540 going to sleep for 11 seconds 00000100:00100000:3.0:1789136275.368569:0:23327:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666906624 00000100:00100000:3.0:1789136275.368578:0:23327:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666906624 00000100:00100000:3.0:1789136275.369983:0:23327:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1789136275.369997:0:23327:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7dd562850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b11da215-324d-4c8d-90a5-0b7f26186c4c+18:24068:x1876044666906624:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789136275.370154:0:23327:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7dd562850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b11da215-324d-4c8d-90a5-0b7f26186c4c+18:24068:x1876044666906624:12345-0@lo:502:mount.lustre.0 Request processed in 159us (1701us total) trans 0 rc 0/0 00000100:00100000:3.0:1789136275.370162:0:23327:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1789136275.371526:0:24068:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7ff64ad00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b11da215-324d-4c8d-90a5-0b7f26186c4c:24068:1876044666906624:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1789136275.371773:0:24068:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].49, 224 off16608 00000040:00080000:2.0:1789136275.371801:0:24068:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].50, 120 off16728 00000100:00100000:2.0:1789136275.371839:0:24068:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7c14b4b40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b11da215-324d-4c8d-90a5-0b7f26186c4c:24068:1876044666906752:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789136275.371906:0:24068:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789136275.378025:0:24068:0:(client.c:2715:ptlrpc_set_wait()) set ffff90a7fa302300 going to sleep for 11 seconds 00000100:00100000:1.0:1789136275.378231:0:23325:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666906752 00000100:00100000:1.0:1789136275.378242:0:23325:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666906752 00000100:00100000:1.0:1789136275.378291:0:23325:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1789136275.378300:0:23325:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7dd561450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b11da215-324d-4c8d-90a5-0b7f26186c4c+18:24068:x1876044666906752:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789136275.379697:0:23325:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7dd561450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b11da215-324d-4c8d-90a5-0b7f26186c4c+18:24068:x1876044666906752:12345-0@lo:502:mount.lustre.0 Request processed in 1392us (7785us total) trans 0 rc 0/0 00000100:00100000:1.0:1789136275.379708:0:23325:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1789136275.379886:0:24068:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7c14b4b40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b11da215-324d-4c8d-90a5-0b7f26186c4c:24068:1876044666906752:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1789136275.379971:0:24068:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].51, 224 off16952 00000040:00080000:2.0:1789136275.379984:0:24068:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 51 count 51 00000020:01000004:2.0:1789136275.390652:0:24088:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0001 (typ=lwp) 00000020:00000080:2.0:1789136275.390670:0:24088:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0001 (ffff90a6c4708000) 00000020:00000080:2.0:1789136275.390696:0:24088:0:(obd_config.c:720:class_attach_name()) OBD: dev 19 attached type lwp with refcount 2 00000020:01000004:2.0:1789136275.390786:0:24088:0:(tgt_mount.c:153:server_get_mount()) get mount ffff90a6c3ba1800 from lustre-MDT0001, refs=3 00000020:01000004:2.0:1789136275.390790:0:24088:0:(tgt_mount.c:187:server_put_mount()) put mount ffff90a6c3ba1800 from lustre-MDT0001, refs=3 00000020:01000004:2.0:1789136275.390793:0:24088:0:(obd_mount.c:710:lustre_put_lsi()) put ffff90a6c3ba1800 3 00010000:00080000:2.0:1789136275.390827:0:24088:0:(ldlm_lib.c:102:import_set_conn()) imp ffff90a7f0967800@lustre-MDT0000-lwp-MDT0001: add connection 192.168.201.131@tcp at head 00010000:00010000:2.0:1789136275.392508:0:24088:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0001-8 is initialized 00000020:00000080:2.0:1789136275.392737:0:24088:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0001 (uuid lustre-MDT0000-lwp-MDT0001_UUID) 00000010:01000000:2.0:1789136275.392775:0:24088:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1789136275.392787:0:24088:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001, cookie 0x559c8745c6de45d0 00000100:00080000:2.0:1789136275.392798:0:24088:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1789136275.392804:0:24088:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff90a7f0967800 using connection 192.168.201.131@tcp/0@lo 00000100:00100000:2.0:1789136275.392838:0:24088:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff90a7c14b4b40 x1876044666906880/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1789136275.392887:0:24088:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID 00000100:00080000:0.0:1789136275.392937:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789136275.392942:0:487:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1789136275.392945:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789136275.392948:0:487:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000040:00080000:0.0:1789136275.394331:0:24088:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x12:0x0] index 52 count 51 00000100:00100000:3.0:1789136275.399807:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7c14b4b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3637:1876044666906880:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1789136275.399908:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789136275.399993:0:23334:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666906880 00000100:00100000:3.0:1789136275.400000:0:23334:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666906880 00000100:00100000:3.0:1789136275.400036:0:23334:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1789136275.400043:0:23334:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7ff649680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3637:x1876044666906880:12345-0@lo:38:llog_process_th.0 00010000:00080000:3.0:1789136275.400069:0:23334:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0001_UUID@0@lo t0 exp 0000000000000000 cur 723 last 0 00000020:00000080:3.0:1789136275.400124:0:23334:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001_UUID, cookie 0x559c8745c6de45d7 00000004:00100000:3.0:1789136275.400138:0:23334:0:(mdt_handler.c:7306:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1789136275.400171:0:23334:0:(import.c:65:import_set_state_nolock()) ffff90a6c44f8800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789136275.400225:0:23334:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7ff649680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3637:x1876044666906880:12345-0@lo:38:llog_process_th.0 Request processed in 181us (318us total) trans 0 rc 0/0 00000100:00100000:3.0:1789136275.400233:0:23334:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:3.0:1789136275.400273:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff90a7c14b4b40 x1876044666906880/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789136285 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789136275.400283:0:3637:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:3.0:1789136275.400291:0:3637:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0001: connect to target with instance 3 00000100:00080000:3.0:1789136275.400298:0:3637:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0001: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:3.0:1789136275.400302:0:3637:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1789136275.400304:0:3637:0:(import.c:65:import_set_state_nolock()) ffff90a7f0967800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1789136275.400310:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7c14b4b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3637:1876044666906880:0@lo:38:llog_process_th.0 00000020:01000000:2.0:1789136275.405156:0:24068:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:2.0:1789136275.405208:0:24068:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.131@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1789136275.405229:0:24068:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.131@tcp lock: ffff90a7d1879e00/0x559c8745c6de45bb lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x559c8745c6de45c2 expref: -99 pid: 24068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136275.405242:0:24068:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.131@tcp lock: ffff90a7d1879e00/0x559c8745c6de45bb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x559c8745c6de45c2 expref: -99 pid: 24068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1789136275.405297:0:24068:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1789136275.405299:0:24068:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:2.0:1789136275.405301:0:24068:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789136275.405302:0:24068:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789136275.405303:0:24068:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789136275.405305:0:24068:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789136275.405307:0:24068:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1789136275.405308:0:24068:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789136275.405310:0:24068:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1789136275.405314:0:24068:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0001 0x40020001 00000020:01000004:2.0:1789136275.405316:0:24068:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1789136275.405318:0:24068:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:2.0:1789136275.405319:0:24068:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789136275.405320:0:24068:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789136275.405321:0:24068:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789136275.405322:0:24068:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789136275.405323:0:24068:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1789136275.405325:0:24068:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789136275.405326:0:24068:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1789136275.405368:0:24068:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0001 00000100:00100000:2.0:1789136275.405389:0:24068:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7c14b5e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b11da215-324d-4c8d-90a5-0b7f26186c4c:24068:1876044666907008:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1789136275.405456:0:24068:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789136275.405487:0:24068:0:(client.c:2715:ptlrpc_set_wait()) set ffff90a7fa3023c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789136275.405893:0:23327:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666907008 00000100:00100000:3.0:1789136275.405900:0:23327:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666907008 00000100:00100000:3.0:1789136275.405949:0:23327:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1789136275.405958:0:23327:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7dd561850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b11da215-324d-4c8d-90a5-0b7f26186c4c+18:24068:x1876044666907008:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1789136275.405984:0:23327:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:3.0:1789136275.405996:0:23327:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000001:00100000:2.0:1789136275.413531:0:23312:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 20000000:01000000:1.0:1789136275.414984:0:23327:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1789136275.415001:0:23327:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 20000000:01000000:2.0:1789136275.415013:0:23349:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1789136275.415019:0:23349:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1789136275.415041:0:23349:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff90a7d1878a00/0x559c8745c6de45de lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 23349 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136275.415062:0:23349:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90a6c3caf600/0x559c8745c6de44e2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x559c8745c6de44db expref: 18 pid: 23327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136275.415071:0:23349:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90a7e1c9fa00/0x559c8745c6de45a6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x559c8745c6de459f expref: 18 pid: 23324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136275.415079:0:23349:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff90a7d1878a00/0x559c8745c6de45de lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 23349 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136275.415113:0:23349:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90a7e1c9fa00/0x559c8745c6de45a6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x559c8745c6de459f expref: 18 pid: 23324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136275.415146:0:23349:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff90a7e1c9fa00/0x559c8745c6de45a6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x559c8745c6de459f expref: 18 pid: 23324 timeout: 823 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789136275.415159:0:23349:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7c14b43c0 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:23349:1876044666907136:0@lo:104: 00000100:00100000:2.0:1789136275.415223:0:23349:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1789136275.415275:0:23349:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90a6c3caf600/0x559c8745c6de44e2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x559c8745c6de44db expref: 18 pid: 23327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136275.415284:0:23349:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff90a6c3caf600/0x559c8745c6de44e2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x559c8745c6de44db expref: 18 pid: 23327 timeout: 823 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789136275.415292:0:23349:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7c14b7480 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:23349:1876044666907264:0@lo:104: 00000100:00100000:2.0:1789136275.415316:0:23349:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789136275.415331:0:23349:0:(client.c:2715:ptlrpc_set_wait()) set ffff90a7fa302480 going to sleep for 11 seconds 00000100:00100000:2.0:1789136275.415602:0:23316:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666907136 00000100:00100000:2.0:1789136275.415608:0:23316:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666907136 00000100:00100000:2.0:1789136275.415640:0:23316:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666907264 00000100:00100000:2.0:1789136275.415648:0:23316:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666907264 00000100:00100000:2.0:1789136275.415666:0:23316:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1789136275.415673:0:23316:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7c14b4f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:b11da215-324d-4c8d-90a5-0b7f26186c4c+4:23349:x1876044666907136:12345-0@lo:104: 00010000:00010000:2.0:1789136275.415686:0:23316:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.131@tcp lock: ffff90a6c3caea00/0x559c8745c6de459f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x559c8745c6de45a6 expref: -99 pid: 24068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136275.415736:0:23316:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1789136275.415742:0:23316:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7c14b4f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:b11da215-324d-4c8d-90a5-0b7f26186c4c+4:23349:x1876044666907136:12345-0@lo:104: Request processed in 70us (519us total) trans 0 rc 0/0 00000100:00100000:2.0:1789136275.415748:0:23316:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1789136275.415764:0:23316:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1789136275.415770:0:23316:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7c14b6d00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:b11da215-324d-4c8d-90a5-0b7f26186c4c+3:23349:x1876044666907264:12345-0@lo:104: 00010000:00010000:2.0:1789136275.415778:0:23316:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.131@tcp lock: ffff90a7e1c9fe00/0x559c8745c6de44db lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x559c8745c6de44e2 expref: -99 pid: 23329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136275.415809:0:23316:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1789136275.415814:0:23316:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7c14b6d00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:b11da215-324d-4c8d-90a5-0b7f26186c4c+3:23349:x1876044666907264:12345-0@lo:104: Request processed in 45us (498us total) trans 0 rc 0/0 00000100:00100000:2.0:1789136275.415819:0:23316:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1789136275.415876:0:23349:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7c14b43c0 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:23349:1876044666907136:0@lo:104: 00000100:00100000:2.0:1789136275.415888:0:23349:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7c14b7480 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:23349:1876044666907264:0@lo:104: 00010000:00010000:2.0:1789136275.415905:0:23349:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff90a7d1878a00/0x559c8745c6de45de lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 23349 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136275.415922:0:23321:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1789136275.415927:0:23321:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.131@tcp lock: ffff90a6c3caea00/0x559c8745c6de459f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x559c8745c6de45a6 expref: -99 pid: 24068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136275.415943:0:23321:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a6c3caea00 already unused, calling callback (ffffffffc13bbc20) 10000000:00010000:2.0:1789136275.415948:0:23321:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.131@tcp lock: ffff90a6c3caea00/0x559c8745c6de459f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x559c8745c6de45a6 expref: -99 pid: 24068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136275.415956:0:23321:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.131@tcp lock: ffff90a6c3caea00/0x559c8745c6de459f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x559c8745c6de45a6 expref: -99 pid: 24068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789136275.415963:0:23321:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.131@tcp lock: ffff90a6c3caea00/0x559c8745c6de459f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x559c8745c6de45a6 expref: -99 pid: 24068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789136275.415968:0:23321:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1789136275.416001:0:23321:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.131@tcp lock: ffff90a6c3caea00/0x559c8745c6de459f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x559c8745c6de45a6 expref: -99 pid: 24068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136275.416007:0:23321:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789136275.416026:0:23321:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.131@tcp lock: ffff90a6c3caea00/0x559c8745c6de459f lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x559c8745c6de45a6 expref: -99 pid: 24068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136275.416033:0:23321:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.131@tcp lock: ffff90a6c3caea00/0x559c8745c6de459f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x559c8745c6de45a6 expref: -99 pid: 24068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136275.416045:0:23321:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789136275.416047:0:23321:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.131@tcp lock: ffff90a7e1c9fe00/0x559c8745c6de44db lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x559c8745c6de44e2 expref: -99 pid: 23329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136275.416052:0:23321:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a7e1c9fe00 already unused, calling callback (ffffffffc13bbc20) 10000000:00010000:2.0:1789136275.416054:0:23321:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.131@tcp lock: ffff90a7e1c9fe00/0x559c8745c6de44db lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x559c8745c6de44e2 expref: -99 pid: 23329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136275.416071:0:23321:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.131@tcp lock: ffff90a7e1c9fe00/0x559c8745c6de44db lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x559c8745c6de44e2 expref: -99 pid: 23329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789136275.416077:0:23321:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.131@tcp lock: ffff90a7e1c9fe00/0x559c8745c6de44db lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x559c8745c6de44e2 expref: -99 pid: 23329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789136275.416081:0:23321:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1789136275.416092:0:23321:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.131@tcp lock: ffff90a7e1c9fe00/0x559c8745c6de44db lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x559c8745c6de44e2 expref: -99 pid: 23329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136275.416097:0:23321:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789136275.416111:0:23321:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.131@tcp lock: ffff90a7e1c9fe00/0x559c8745c6de44db lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x559c8745c6de44e2 expref: -99 pid: 23329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136275.416119:0:23321:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.131@tcp lock: ffff90a7e1c9fe00/0x559c8745c6de44db lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x559c8745c6de44e2 expref: -99 pid: 23329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136275.416133:0:23321:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789136275.416134:0:23321:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789136275.416136:0:23321:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789136275.416143:0:23320:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789136275.416154:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7c14b7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b11da215-324d-4c8d-90a5-0b7f26186c4c:3639:1876044666907392:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789136275.416185:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789136275.416232:0:23327:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7dd561850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b11da215-324d-4c8d-90a5-0b7f26186c4c+18:24068:x1876044666907008:12345-0@lo:253:mount.lustre.0 Request processed in 10273us (10774us total) trans 0 rc 0/0 00000100:00100000:2.0:1789136275.416235:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7c14b43c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b11da215-324d-4c8d-90a5-0b7f26186c4c:3640:1876044666907520:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789136275.416248:0:23327:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1789136275.416266:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789136275.416310:0:24068:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7c14b5e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b11da215-324d-4c8d-90a5-0b7f26186c4c:24068:1876044666907008:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1789136275.416320:0:24068:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0001 got index = 1 00000020:01000004:2.0:1789136275.416328:0:24068:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1789136275.416330:0:24068:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:2.0:1789136275.416331:0:24068:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789136275.416332:0:24068:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789136275.416333:0:24068:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789136275.416335:0:24068:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789136275.416336:0:24068:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1789136275.416337:0:24068:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789136275.416339:0:24068:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000100:00100000:1.0:1789136275.416911:0:23317:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666907392 00000100:00100000:1.0:1789136275.416917:0:23317:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666907392 00010000:00010000:1.0:1789136275.417021:0:23317:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90a7e1c9fa00/0x559c8745c6de45a6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x559c8745c6de459f expref: 18 pid: 23324 timeout: 823 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789136275.417112:0:23317:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666907520 00000100:00100000:1.0:1789136275.417116:0:23317:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666907520 00010000:00010000:1.0:1789136275.417129:0:23317:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90a6c3caf600/0x559c8745c6de44e2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x559c8745c6de44db expref: 19 pid: 23327 timeout: 823 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789136275.417153:0:23317:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1789136275.417160:0:23317:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7c14b52c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b11da215-324d-4c8d-90a5-0b7f26186c4c+19:3639:x1876044666907392:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789136275.417172:0:23317:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789136275.417177:0:23317:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90a7e1c9fa00/0x559c8745c6de45a6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x559c8745c6de459f expref: 19 pid: 23324 timeout: 823 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136275.417187:0:23317:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90a7e1c9fa00/0x559c8745c6de45a6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x559c8745c6de459f expref: 19 pid: 23324 timeout: 823 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136275.417201:0:23317:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90a7e1c9fa00/0x559c8745c6de45a6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x559c8745c6de459f expref: 19 pid: 23324 timeout: 823 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136275.417213:0:23317:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789136275.417251:0:23317:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7c14b52c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b11da215-324d-4c8d-90a5-0b7f26186c4c+18:3639:x1876044666907392:12345-0@lo:103:ldlm_bl.0 Request processed in 92us (1067us total) trans 0 rc 0/0 00000100:00100000:1.0:1789136275.417257:0:23317:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1789136275.417272:0:23317:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1789136275.417277:0:23317:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7c14b6580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b11da215-324d-4c8d-90a5-0b7f26186c4c+17:3640:x1876044666907520:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789136275.417284:0:23317:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789136275.417288:0:23317:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90a6c3caf600/0x559c8745c6de44e2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x559c8745c6de44db expref: 17 pid: 23327 timeout: 823 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136275.417296:0:23317:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90a6c3caf600/0x559c8745c6de44e2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x559c8745c6de44db expref: 17 pid: 23327 timeout: 823 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136275.417306:0:23317:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90a6c3caf600/0x559c8745c6de44e2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x559c8745c6de44db expref: 17 pid: 23327 timeout: 823 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136275.417326:0:23317:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff90a7d1878a00/0x559c8745c6de45de lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 23349 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136275.417334:0:23317:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90a7d1878a00/0x559c8745c6de45de lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 23349 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:02000000:2.0:1789136275.417568:0:24068:0:(tgt_mount.c:2692:server_calc_timeout()) lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 20000000:01000000:1.0:1789136275.417852:0:23317:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.006523026s 00010000:00010000:1.0:1789136275.417882:0:23317:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff90a7d1878a00/0x559c8745c6de45de lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 23349 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136275.417891:0:23317:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff90a7d1878a00/0x559c8745c6de45de lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 23349 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136275.417899:0:23317:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff90a7d1878a00/0x559c8745c6de45de lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 23349 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136275.417907:0:23317:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff90a7d1878a00/0x559c8745c6de45de lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 23349 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136275.417915:0:23317:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a7d1878a00 already unused, calling callback (ffffffffc0dbf540) 00010000:00010000:1.0:1789136275.417919:0:23317:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff90a7d1878a00/0x559c8745c6de45de lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 23349 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136275.417939:0:23317:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff90a7d1878a00/0x559c8745c6de45de lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 23349 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136275.417957:0:23317:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff90a7d1878a00/0x559c8745c6de45de lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 23349 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136275.417969:0:23317:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789136275.418014:0:23317:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7c14b6580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b11da215-324d-4c8d-90a5-0b7f26186c4c+16:3640:x1876044666907520:12345-0@lo:103:ldlm_bl.0 Request processed in 735us (1747us total) trans 0 rc 0/0 00000100:00100000:1.0:1789136275.418024:0:23317:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1789136275.418187:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7c14b7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b11da215-324d-4c8d-90a5-0b7f26186c4c:3639:1876044666907392:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789136275.418234:0:23349:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff90a7d1878a00/0x559c8745c6de45de lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 23349 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136275.418243:0:23349:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff90a7d1878a00/0x559c8745c6de45de lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 23349 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136275.418249:0:23349:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90a7d1878a00/0x559c8745c6de45de lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 23349 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789136275.418274:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7c14b43c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b11da215-324d-4c8d-90a5-0b7f26186c4c:3640:1876044666907520:0@lo:103:ldlm_bl.0 00000040:01000000:2.0:1789136275.428438:0:24068:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osd ctxt 16 is initialized 00000020:00080000:1.0:1789136275.428540:0:24096:0:(update_trans.c:1539:distribute_txn_commit_thread()) lustre-MDT0001: start commit thread committed batchid 0 00000020:00080000:1.0:1789136275.428543:0:24096:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 0 00000040:01000000:1.0:1789136275.433353:0:24097:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:00080000:1.0:1789136275.433804:0:24097:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1789136275.436478:0:24097:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x240000400:0x1:0x0] index 261376 count 1 00000004:00080000:1.0:1789136275.436569:0:24097:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osd retrieved update log, duration 0, retries 0 00000040:01000000:3.0:1789136275.438188:0:24068:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osp-MDT0001 ctxt 16 is initialized 00000100:00100000:0.0:1789136275.438662:0:24098:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7fa3bda40 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:24098:1876044666907648:0@lo:1000:lod0001_rec0000.0 00000100:00100000:0.0:1789136275.438733:0:24098:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789136275.438838:0:24098:0:(client.c:2715:ptlrpc_set_wait()) set ffff90a7c1526780 going to sleep for 11 seconds 00000100:00100000:2.0:1789136275.439106:0:23338:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666907648 00000100:00100000:2.0:1789136275.439113:0:23338:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666907648 00000100:00100000:2.0:1789136275.439175:0:23338:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1789136275.439184:0:23338:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7fa3bc780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:24098:x1876044666907648:12345-0@lo:1000:lod0001_rec0000.0 00000100:00100000:2.0:1789136275.439305:0:23338:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7fa3bc780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:24098:x1876044666907648:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 122us (572us total) trans 0 rc 0/0 00000100:00100000:2.0:1789136275.439313:0:23338:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000040:01000000:3.0:1789136275.440593:0:24068:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 12 is initialized 00000040:00080000:3.0:1789136275.440652:0:24068:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:3.0:1789136275.441219:0:24068:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:3.0:1789136275.441227:0:24068:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 14 is initialized 00000040:00080000:3.0:1789136275.441269:0:24068:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1789136275.442024:0:24098:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7fa3bda40 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:24098:1876044666907648:0@lo:1000:lod0001_rec0000.0 00000040:01000000:1.0:1789136275.442070:0:24098:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000100:00100000:1.0:1789136275.442118:0:24098:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7f662f0c0 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:24098:1876044666907776:0@lo:1000:lod0001_rec0000.0 00000100:00100000:1.0:1789136275.442187:0:24098:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789136275.442275:0:24098:0:(client.c:2715:ptlrpc_set_wait()) set ffff90a7c7323240 going to sleep for 11 seconds 00000040:00080000:3.0:1789136275.443065:0:24068:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:3.0:1789136275.443625:0:24068:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:3.0:1789136275.443661:0:24068:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 15 is initialized 00000040:00080000:3.0:1789136275.443780:0:24068:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00080000:10000000:3.0:1789136275.444420:0:24068:0:(osd_handler.c:5551:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x30:0x0] (8/32) registered 00000100:00100000:2.0:1789136275.446597:0:23339:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666907776 00000100:00100000:2.0:1789136275.446610:0:23339:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666907776 00000100:00100000:2.0:1789136275.446734:0:23339:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1789136275.446754:0:23339:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7f662c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:24098:x1876044666907776:12345-0@lo:1000:lod0001_rec0000.0 00000100:00100000:2.0:1789136275.447166:0:23339:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7f662c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:24098:x1876044666907776:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 422us (4977us total) trans 0 rc 0/0 00000100:00100000:2.0:1789136275.447176:0:23339:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000001:00000004:3.0:1789136275.448816:0:24068:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 3, last_transno is 12884901888 00000100:00100000:0.0:1789136275.449795:0:24098:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7f662f0c0 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:24098:1876044666907776:0@lo:1000:lod0001_rec0000.0 00000100:00100000:0.0:1789136275.449915:0:24098:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7fa3be1c0 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0000-lwp-MDT0001_UUID:24098:1876044666907904:0@lo:900:lod0001_rec0000.0 00000100:00100000:0.0:1789136275.449978:0:24098:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789136275.450009:0:24098:0:(client.c:2715:ptlrpc_set_wait()) set ffff90a7efa566c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789136275.450707:0:23344:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666907904 00000100:00100000:3.0:1789136275.450715:0:23344:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666907904 00000100:00100000:3.0:1789136275.450773:0:23344:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1789136275.450783:0:23344:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7fa3bda40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:24098:x1876044666907904:12345-0@lo:900:lod0001_rec0000.0 00000100:00100000:3.0:1789136275.450850:0:23344:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7fa3bda40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:24098:x1876044666907904:12345-0@lo:900:lod0001_rec0000.0 Request processed in 68us (871us total) trans 0 rc 0/0 00000100:00100000:3.0:1789136275.450877:0:23344:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:3.0:1789136275.450913:0:24098:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff90a7fa3be1c0 x1876044666907904/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1789136291 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'lod0001_rec0000.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789136275.450927:0:24098:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7fa3be1c0 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0000-lwp-MDT0001_UUID:24098:1876044666907904:0@lo:900:lod0001_rec0000.0 00000100:00100000:3.0:1789136275.450982:0:24098:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7ff64a1c0 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:24098:1876044666908032:0@lo:1000:lod0001_rec0000.0 00000100:00100000:3.0:1789136275.451018:0:24098:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789136275.451045:0:24077:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666908032 00000100:00100000:3.0:1789136275.451050:0:24077:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666908032 00000100:00100000:3.0:1789136275.451077:0:24077:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1789136275.451084:0:24077:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7ff64bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:24098:x1876044666908032:12345-0@lo:1000:lod0001_rec0000.0 00000100:00100000:3.0:1789136275.451160:0:24077:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7ff64bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:24098:x1876044666908032:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 77us (141us total) trans 0 rc 0/0 00000100:00100000:3.0:1789136275.451166:0:24077:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1789136275.451186:0:24098:0:(client.c:2715:ptlrpc_set_wait()) set ffff90a7e6ea1240 going to sleep for 11 seconds 00000100:00100000:3.0:1789136275.451198:0:24098:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7ff64a1c0 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:24098:1876044666908032:0@lo:1000:lod0001_rec0000.0 00000040:00080000:3.0:1789136275.451246:0:24098:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1789136275.453258:0:24098:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000401:0x1:0x0] index 261376 count 1 00000004:00080000:3.0:1789136275.453350:0:24098:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osp-MDT0001 retrieved update log, duration 0, retries 0 00000004:00080000:3.0:1789136275.453367:0:24098:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0001 got update logs from all MDTs. 00000001:00080000:0.0:1789136275.453800:0:24068:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0001: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:0.0:1789136275.453825:0:24068:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0001: cmd=c00866e6 len=0 karg=ffffbb1d4555b988 00100000:10000000:0.0:1789136275.453840:0:24068:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0001-osd: start master thread 00000020:01000004:1.0:1789136275.454651:0:24068:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:1.0:1789136275.454686:0:24068:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.201.131@tcp: cl_mgc_mutex unlock 00000020:01000004:1.0:1789136275.454706:0:24068:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=48 00000080:00000004:1.0:1789136275.454731:0:24068:0:(super25.c:182:lustre_fill_super()) /dev/mapper/mds2_flakey: Mount complete 00000020:00000004:1.0:1789136275.478041:0:24068:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1789136275.478298:0:24068:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:0.0:1789136275.817028:0:23377:0:(client.c:2715:ptlrpc_set_wait()) set ffff90a7e6eb83c0 going to sleep for 0 seconds 00010000:00010000:3.0:1789136276.201126:0:23321:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1789136276.458556:0:24094:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1789136276.840970:0:23377:0:(client.c:2715:ptlrpc_set_wait()) set ffff90a7e6eb83c0 going to sleep for 0 seconds 10000000:01000000:1.0:1789136277.224886:0:23329:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1789136277.224896:0:23329:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff90a6c3ba1800 from 12 10000000:01000000:1.0:1789136277.224902:0:23329:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1789136277.224953:0:23329:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.131@tcp lock: ffff90a7c167c800/0x559c8745c6de45e5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 23329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136277.224964:0:23329:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.131@tcp lock: ffff90a7c167c800/0x559c8745c6de45e5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 23329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136277.224976:0:23329:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.131@tcp lock: ffff90a7c167c800/0x559c8745c6de45e5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 23329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789136277.225015:0:23329:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7f662f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b11da215-324d-4c8d-90a5-0b7f26186c4c:23329:1876044666908160:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1789136277.225090:0:23329:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789136277.225136:0:23329:0:(client.c:2715:ptlrpc_set_wait()) set ffff90a7c7323c00 going to sleep for 11 seconds 00000100:00100000:3.0:1789136277.225515:0:23325:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666908160 00000100:00100000:3.0:1789136277.225523:0:23325:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666908160 00000100:00100000:3.0:1789136277.225575:0:23325:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1789136277.225585:0:23325:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7dd560050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b11da215-324d-4c8d-90a5-0b7f26186c4c+16:23329:x1876044666908160:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789136277.225599:0:23325:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789136277.225613:0:23325:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90a7e1c9e800/0x559c8745c6de45ec lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x559c8745c6de45e5 expref: -99 pid: 23325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136277.225637:0:23325:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90a7e1c9e800/0x559c8745c6de45ec lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x559c8745c6de45e5 expref: 17 pid: 23325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136277.225648:0:23325:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90a7e1c9e800/0x559c8745c6de45ec lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x559c8745c6de45e5 expref: 17 pid: 23325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136277.225658:0:23325:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a7e1c9e800, rc 0) 00000100:00100000:3.0:1789136277.225703:0:23325:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7dd560050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b11da215-324d-4c8d-90a5-0b7f26186c4c+17:23329:x1876044666908160:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 120us (614us total) trans 0 rc 0/0 00000100:00100000:3.0:1789136277.225710:0:23325:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00010000:00010000:3.0:1789136277.225786:0:23320:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789136277.225810:0:23329:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7f662f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b11da215-324d-4c8d-90a5-0b7f26186c4c:23329:1876044666908160:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789136277.225825:0:23329:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.131@tcp lock: ffff90a7c167c800/0x559c8745c6de45e5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x559c8745c6de45ec expref: -99 pid: 23329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136277.225833:0:23329:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.131@tcp lock: ffff90a7c167c800/0x559c8745c6de45e5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x559c8745c6de45ec expref: -99 pid: 23329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789136277.225912:0:23329:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7ff64a1c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b11da215-324d-4c8d-90a5-0b7f26186c4c:23329:1876044666908288:0@lo:256:ll_cfg_requeue.0 00000100:00100000:3.0:1789136277.225949:0:23329:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789136277.225963:0:23329:0:(client.c:2715:ptlrpc_set_wait()) set ffff90a7e6ea1240 going to sleep for 11 seconds 00000100:00100000:1.0:1789136277.226127:0:23327:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666908288 00000100:00100000:1.0:1789136277.226132:0:23327:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666908288 00000100:00100000:1.0:1789136277.226157:0:23327:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1789136277.226162:0:23327:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7dd561c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b11da215-324d-4c8d-90a5-0b7f26186c4c+17:23329:x1876044666908288:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:1.0:1789136277.226177:0:23327:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1789136277.226194:0:23327:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1789136277.226197:0:23327:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 12 00000100:00100000:1.0:1789136277.226281:0:23327:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7dd561c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b11da215-324d-4c8d-90a5-0b7f26186c4c+17:23329:x1876044666908288:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 117us (331us total) trans 0 rc 0/0 00000100:00100000:1.0:1789136277.226289:0:23327:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1789136277.227407:0:23329:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7ff64a1c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b11da215-324d-4c8d-90a5-0b7f26186c4c:23329:1876044666908288:0@lo:256:ll_cfg_requeue.0 10000000:01000000:3.0:1789136277.227462:0:23329:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.131@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1789136277.227470:0:23329:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.131@tcp lock: ffff90a7c167c800/0x559c8745c6de45e5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x559c8745c6de45ec expref: -99 pid: 23329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136277.227490:0:23329:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.131@tcp lock: ffff90a7c167c800/0x559c8745c6de45e5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x559c8745c6de45ec expref: -99 pid: 23329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789136277.227501:0:23329:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1789136277.227504:0:23329:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff90a7fa55b800 from 12 10000000:01000000:3.0:1789136277.227507:0:23329:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1789136277.227535:0:23329:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.131@tcp lock: ffff90a7e1c9e600/0x559c8745c6de45f3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 23329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136277.227543:0:23329:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.131@tcp lock: ffff90a7e1c9e600/0x559c8745c6de45f3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 23329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136277.227552:0:23329:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.131@tcp lock: ffff90a7e1c9e600/0x559c8745c6de45f3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 23329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789136277.227569:0:23329:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7ff64a1c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b11da215-324d-4c8d-90a5-0b7f26186c4c:23329:1876044666908416:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1789136277.227614:0:23329:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789136277.227659:0:23329:0:(client.c:2715:ptlrpc_set_wait()) set ffff90a7e6ea1240 going to sleep for 11 seconds 00000100:00100000:1.0:1789136277.227914:0:23324:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666908416 00000100:00100000:1.0:1789136277.227920:0:23324:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666908416 00000100:00100000:1.0:1789136277.227959:0:23324:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1789136277.227967:0:23324:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7dd562450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b11da215-324d-4c8d-90a5-0b7f26186c4c+17:23329:x1876044666908416:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789136277.227978:0:23324:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789136277.227991:0:23324:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90a7c167ca00/0x559c8745c6de45fa lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x559c8745c6de45f3 expref: -99 pid: 23324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136277.228011:0:23324:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90a7c167ca00/0x559c8745c6de45fa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x559c8745c6de45f3 expref: 18 pid: 23324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136277.228020:0:23324:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90a7c167ca00/0x559c8745c6de45fa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x559c8745c6de45f3 expref: 18 pid: 23324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136277.228041:0:23324:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a7c167ca00, rc 0) 00000100:00100000:1.0:1789136277.228076:0:23324:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7dd562450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b11da215-324d-4c8d-90a5-0b7f26186c4c+18:23329:x1876044666908416:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 109us (461us total) trans 0 rc 0/0 00000100:00100000:1.0:1789136277.228083:0:23324:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1789136277.228204:0:23329:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7ff64a1c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b11da215-324d-4c8d-90a5-0b7f26186c4c:23329:1876044666908416:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789136277.228217:0:23329:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.131@tcp lock: ffff90a7e1c9e600/0x559c8745c6de45f3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x559c8745c6de45fa expref: -99 pid: 23329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136277.228235:0:23329:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.131@tcp lock: ffff90a7e1c9e600/0x559c8745c6de45f3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x559c8745c6de45fa expref: -99 pid: 23329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789136277.228292:0:23329:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7ff64a1c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b11da215-324d-4c8d-90a5-0b7f26186c4c:23329:1876044666908544:0@lo:256:ll_cfg_requeue.0 00000100:00100000:3.0:1789136277.228322:0:23329:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789136277.228362:0:23329:0:(client.c:2715:ptlrpc_set_wait()) set ffff90a7e6ea1240 going to sleep for 11 seconds 00000100:00100000:1.0:1789136277.231066:0:23325:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666908544 00000100:00100000:1.0:1789136277.231082:0:23325:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666908544 00000100:00100000:1.0:1789136277.231142:0:23325:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1789136277.231153:0:23325:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7dd563c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b11da215-324d-4c8d-90a5-0b7f26186c4c+18:23329:x1876044666908544:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:1.0:1789136277.231176:0:23325:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1789136277.231200:0:23325:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1789136277.231203:0:23325:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 12 00000100:00100000:1.0:1789136277.231339:0:23325:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7dd563c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b11da215-324d-4c8d-90a5-0b7f26186c4c+18:23329:x1876044666908544:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 188us (3016us total) trans 0 rc 0/0 00000100:00100000:1.0:1789136277.231347:0:23325:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1789136277.231976:0:23329:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7ff64a1c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b11da215-324d-4c8d-90a5-0b7f26186c4c:23329:1876044666908544:0@lo:256:ll_cfg_requeue.0 10000000:01000000:3.0:1789136277.232034:0:23329:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.131@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1789136277.232045:0:23329:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.131@tcp lock: ffff90a7e1c9e600/0x559c8745c6de45f3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x559c8745c6de45fa expref: -99 pid: 23329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136277.232056:0:23329:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.131@tcp lock: ffff90a7e1c9e600/0x559c8745c6de45f3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x559c8745c6de45fa expref: -99 pid: 23329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1789136277.481748:0:24094:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1789136277.866298:0:23377:0:(client.c:2715:ptlrpc_set_wait()) set ffff90a7e6eb83c0 going to sleep for 0 seconds 00010000:00010000:3.0:1789136278.249075:0:23321:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789136278.896515:0:23377:0:(client.c:2715:ptlrpc_set_wait()) set ffff90a7e6eb83c0 going to sleep for 0 seconds 00010000:00010000:3.0:1789136279.272079:0:23320:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789136279.912288:0:23377:0:(client.c:2715:ptlrpc_set_wait()) set ffff90a7e6eb83c0 going to sleep for 0 seconds 00010000:00010000:2.0:1789136280.296877:0:23321:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1789136280.418577:0:24340:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg131-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00080000:3.0:1789136280.424094:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:3.0:1789136280.424102:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:3.0:1789136280.424106:0:487:0:(import.c:65:import_set_state_nolock()) ffff90a7fa659000 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1789136280.424119:0:487:0:(import.c:624:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff90a7fa659000 using connection 192.168.201.131@tcp/0@lo 00000100:00100000:3.0:1789136280.424148:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff90a7ff64ad00 x1876044666908800/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1789136280.424167:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789136280.424171:0:487:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1789136280.424188:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789136280.424192:0:487:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1789136280.424222:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789136280.424226:0:487:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1789136280.424228:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789136280.424231:0:487:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1789136280.424279:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7ff649a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3640:1876044666909184:0@lo:400:kworker.0 00000100:00100000:3.0:1789136280.424353:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789136280.424392:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789136280.424398:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7ff64a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b11da215-324d-4c8d-90a5-0b7f26186c4c:3640:1876044666908672:0@lo:400:kworker.0 00000100:00100000:3.0:1789136280.424440:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789136280.424486:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7ff64ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3637:1876044666908800:0@lo:38:kworker.0 00000100:00100000:3.0:1789136280.424517:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789136280.424546:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7ff64a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3638:1876044666908928:0@lo:400:kworker.0 00000100:00100000:3.0:1789136280.424571:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789136280.424587:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789136280.424593:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7ff648b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1876044666909056:0@lo:400:kworker.0 00000100:00100000:3.0:1789136280.424613:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789136280.424643:0:23333:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666909184 00000100:00100000:3.0:1789136280.424649:0:23333:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666909184 00000100:00100000:3.0:1789136280.424890:0:23333:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666908928 00000100:00100000:3.0:1789136280.424895:0:23333:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666908928 00000100:00100000:3.0:1789136280.424914:0:23333:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1789136280.424922:0:23333:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7ff6492c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3640:x1876044666909184:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789136280.424988:0:23333:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7ff6492c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3640:x1876044666909184:12345-0@lo:400:kworker.0 Request processed in 66us (635us total) trans 0 rc 0/0 00000100:00100000:3.0:1789136280.424995:0:23333:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1789136280.425011:0:23333:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1789136280.425017:0:23333:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7ff64a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1876044666908928:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789136280.425050:0:23333:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7ff64a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1876044666908928:12345-0@lo:400:kworker.0 Request processed in 32us (478us total) trans 0 rc 0/0 00000100:00100000:3.0:1789136280.425056:0:23333:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1789136280.425076:0:23327:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666908672 00000100:00100000:3.0:1789136280.425080:0:23327:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666908672 00000100:00100000:3.0:1789136280.425104:0:23327:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1789136280.425110:0:23327:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7dd561050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b11da215-324d-4c8d-90a5-0b7f26186c4c+18:3640:x1876044666908672:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789136280.425139:0:23327:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7dd561050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b11da215-324d-4c8d-90a5-0b7f26186c4c+18:3640:x1876044666908672:12345-0@lo:400:kworker.0 Request processed in 29us (698us total) trans 0 rc 0/0 00000100:00100000:3.0:1789136280.425146:0:23327:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1789136280.425173:0:24077:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666908800 00000100:00100000:3.0:1789136280.425177:0:24077:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666908800 00000100:00100000:3.0:1789136280.425193:0:24077:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666909056 00000100:00100000:3.0:1789136280.425196:0:24077:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666909056 00000100:00100000:3.0:1789136280.425210:0:24077:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1789136280.425215:0:24077:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7ff648780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3637:x1876044666908800:12345-0@lo:38:kworker.0 00010000:00080000:3.0:1789136280.425238:0:24077:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 728 last 0 00000020:00000080:3.0:1789136280.425276:0:24077:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x559c8745c6de4601 00000004:00100000:3.0:1789136280.425291:0:24077:0:(mdt_handler.c:7306:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000001:00000004:3.0:1789136280.425297:0:24077:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 3, last_transno is 12884901888 00000100:00100000:3.0:1789136280.425366:0:23338:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1789136280.425380:0:23338:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7ff6483c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3638:x1876044666909056:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789136280.425412:0:23338:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7ff6483c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3638:x1876044666909056:12345-0@lo:400:kworker.0 Request processed in 34us (798us total) trans 0 rc 0/0 00000100:00100000:3.0:1789136280.425418:0:23338:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1789136280.425473:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7ff648b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1876044666909056:0@lo:400:kworker.0 00010000:00080000:3.0:1789136280.425486:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff90a7ff64a580 x1876044666908928/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789136296 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789136280.425495:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7ff64a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3638:1876044666908928:0@lo:400:kworker.0 00000100:00100000:3.0:1789136280.425524:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7ff64a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b11da215-324d-4c8d-90a5-0b7f26186c4c:3640:1876044666908672:0@lo:400:kworker.0 00010000:00080000:3.0:1789136280.425534:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff90a7ff649a40 x1876044666909184/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789136296 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789136280.425543:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7ff649a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3640:1876044666909184:0@lo:400:kworker.0 00000100:00100000:3.0:1789136280.425787:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789136280.425797:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7ff649a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1876044666909312:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1789136280.425825:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789136280.425849:0:23338:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666909312 00000100:00100000:3.0:1789136280.425878:0:23338:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666909312 00000100:00100000:3.0:1789136280.425903:0:23338:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1789136280.425909:0:23338:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7ff64a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3640:x1876044666909312:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1789136280.425951:0:23338:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446309888 avail 1300070400 00000100:00100000:3.0:1789136280.425987:0:23338:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7ff64a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3640:x1876044666909312:12345-0@lo:41:osp-pre-0-1.0 Request processed in 78us (160us total) trans 0 rc 0/0 00000100:00100000:3.0:1789136280.425993:0:23338:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1789136280.426025:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7ff649a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1876044666909312:0@lo:41:osp-pre-0-1.0 00000100:00080000:1.0:1789136280.443119:0:24077:0:(import.c:65:import_set_state_nolock()) ffff90a7ff506000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789136280.443229:0:24077:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7ff648780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:3637:x1876044666908800:12345-0@lo:38:kworker.0 Request processed in 18011us (18709us total) trans 0 rc 0/0 00000100:00100000:1.0:1789136280.443243:0:24077:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00080000:1.0:1789136280.443299:0:3637:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0001-osp-MDT0000: connect to target with instance 3 00000100:00080000:1.0:1789136280.443309:0:3637:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0001-osp-MDT0000: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:1.0:1789136280.443315:0:3637:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:1.0:1789136280.443317:0:3637:0:(import.c:65:import_set_state_nolock()) ffff90a7fa659000 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00080000:1.0:1789136280.443341:0:3637:0:(recover.c:191:ptlrpc_wake_delayed()) @@@ waking (set 000000009c4545ab): req@ffff90a7ff64b840 x1876044666901888/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'lod0000_rec0001.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789136280.443367:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7ff64ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3637:1876044666908800:0@lo:38:kworker.0 00000100:00100000:1.0:1789136280.443447:0:23377:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789136280.443471:0:23377:0:(client.c:2715:ptlrpc_set_wait()) set ffff90a7e6eb83c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789136280.443488:0:23338:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666901888 00000100:00100000:1.0:1789136280.443495:0:23338:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666901888 00000100:00100000:1.0:1789136280.443531:0:23338:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1789136280.443541:0:23338:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7f662de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:23377:x1876044666901888:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:1.0:1789136280.443611:0:23338:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7f662de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:23377:x1876044666901888:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 72us (164us total) trans 0 rc 0/0 00000100:00100000:1.0:1789136280.443619:0:23338:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1789136280.443651:0:23377:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7ff64b840 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:23377:1876044666901888:0@lo:1000:lod0000_rec0001.0 00000040:01000000:1.0:1789136280.443697:0:23377:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000100:00100000:1.0:1789136280.443739:0:23377:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7f662da40 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:23377:1876044666909440:0@lo:1000:lod0000_rec0001.0 00000100:00100000:1.0:1789136280.443769:0:23377:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789136280.443783:0:23377:0:(client.c:2715:ptlrpc_set_wait()) set ffff90a6c2c8c240 going to sleep for 11 seconds 00000100:00100000:1.0:1789136280.443795:0:23338:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666909440 00000100:00100000:1.0:1789136280.443798:0:23338:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666909440 00000100:00100000:1.0:1789136280.443820:0:23338:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1789136280.443826:0:23338:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7f662fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:23377:x1876044666909440:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:1.0:1789136280.443939:0:23338:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7f662fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:23377:x1876044666909440:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 113us (169us total) trans 0 rc 0/0 00000100:00100000:1.0:1789136280.443948:0:23338:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1789136280.443975:0:23377:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7f662da40 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:23377:1876044666909440:0@lo:1000:lod0000_rec0001.0 00000100:00100000:1.0:1789136280.444036:0:23377:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7f662da40 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:23377:1876044666909568:0@lo:1000:lod0000_rec0001.0 00000100:00100000:1.0:1789136280.444066:0:23377:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789136280.444080:0:23377:0:(client.c:2715:ptlrpc_set_wait()) set ffff90a6c2c8c240 going to sleep for 11 seconds 00000100:00100000:1.0:1789136280.444092:0:23338:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666909568 00000100:00100000:1.0:1789136280.444095:0:23338:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666909568 00000100:00100000:1.0:1789136280.444117:0:23338:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1789136280.444122:0:23338:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7f662c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:23377:x1876044666909568:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:1.0:1789136280.444168:0:23338:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7f662c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:23377:x1876044666909568:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 45us (101us total) trans 0 rc 0/0 00000100:00100000:1.0:1789136280.444191:0:23338:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1789136280.444218:0:23377:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7f662da40 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:23377:1876044666909568:0@lo:1000:lod0000_rec0001.0 00000040:00080000:1.0:1789136280.444254:0:23377:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1789136280.446334:0:23377:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x240000401:0x1:0x0] index 261376 count 1 00000100:00100000:2.0:1789136280.448898:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7c14b43c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1876044666909696:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1789136280.448969:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789136280.449025:0:23338:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666909696 00000100:00100000:2.0:1789136280.449032:0:23338:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666909696 00000100:00100000:2.0:1789136280.449080:0:23338:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1789136280.449089:0:23338:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7c14b7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3638:x1876044666909696:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1789136280.449121:0:23338:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:2.0:1789136280.449169:0:23338:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7c14b7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3638:x1876044666909696:12345-0@lo:41:osp-pre-1-0.0 Request processed in 80us (199us total) trans 0 rc 0/0 00000100:00100000:2.0:1789136280.449176:0:23338:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1789136280.449224:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7c14b43c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1876044666909696:0@lo:41:osp-pre-1-0.0 00000004:00080000:1.0:1789136280.450815:0:23377:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osp-MDT0000 retrieved update log, duration 20, retries 0 00000004:00080000:1.0:1789136280.450826:0:23377:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00010000:00010000:2.0:1789136281.327975:0:23320:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:1.0:1789136281.483591:0:24393:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1789136281.483827:0:24393:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1789136282.345816:0:23321:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:2.0:1789136282.512750:0:24444:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1789136282.513545:0:24444:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00000040:00080000:2.0:1789136282.986005:0:23370:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1789136283.368121:0:23320:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1789136284.216365:0:24492:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffd0a01a920 20000000:00000080:3.0:1789136284.216394:0:24492:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff90a7f02d0800 uarg=0000000000000000 20000000:01000000:3.0:1789136284.216453:0:24492:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:3.0:1789136284.216464:0:24492:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:3.0:1789136284.216471:0:24492:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:3.0:1789136284.217736:0:24493:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 2 count 19 20000000:00000400:2.0:1789136284.217916:0:24492:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/debug_raw_pointers=Y (mode = 0) failed: rc = -17 10000000:01000000:2.0:1789136284.228672:0:24492:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:3.0:1789136284.228828:0:24492:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff90a7e1c9fe00/0x559c8745c6de4608 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136284.228884:0:24492:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90a7d1879200/0x559c8745c6de44b1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x559c8745c6de44aa expref: 17 pid: 23325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136284.228893:0:24492:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90a7e1c9e200/0x559c8745c6de45b4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x559c8745c6de45ad expref: 17 pid: 23325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136284.228901:0:24492:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff90a7e1c9fe00/0x559c8745c6de4608 lrc: 5/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 24492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136284.228966:0:24492:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90a7e1c9e200/0x559c8745c6de45b4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x559c8745c6de45ad expref: 17 pid: 23325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136284.228986:0:24492:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff90a7e1c9e200/0x559c8745c6de45b4 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x559c8745c6de45ad expref: 17 pid: 23325 timeout: 832 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789136284.229003:0:24492:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7ff648b40 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:24492:1876044666909824:0@lo:104: 00000100:00100000:3.0:1789136284.229097:0:24492:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1789136284.229172:0:24492:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90a7d1879200/0x559c8745c6de44b1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x559c8745c6de44aa expref: 17 pid: 23325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136284.229180:0:24492:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff90a7d1879200/0x559c8745c6de44b1 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x559c8745c6de44aa expref: 17 pid: 23325 timeout: 832 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789136284.229310:0:24492:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7ff648000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:24492:1876044666909952:0@lo:104: 00000100:00100000:3.0:1789136284.229336:0:24492:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789136284.229373:0:24492:0:(client.c:2715:ptlrpc_set_wait()) set ffff90a7fa6aa0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789136284.229443:0:23316:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666909824 00000100:00100000:1.0:1789136284.229452:0:23316:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666909824 00000100:00100000:1.0:1789136284.229502:0:23316:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666909952 00000100:00100000:1.0:1789136284.229505:0:23316:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666909952 00000100:00100000:1.0:1789136284.229521:0:23316:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1789136284.229530:0:23316:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7ff649e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:b11da215-324d-4c8d-90a5-0b7f26186c4c+4:24492:x1876044666909824:12345-0@lo:104: 00010000:00010000:1.0:1789136284.229545:0:23316:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.131@tcp lock: ffff90a7c167d200/0x559c8745c6de45ad lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x559c8745c6de45b4 expref: -99 pid: 24068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136284.229619:0:23316:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1789136284.229627:0:23316:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7ff649e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:b11da215-324d-4c8d-90a5-0b7f26186c4c+4:24492:x1876044666909824:12345-0@lo:104: Request processed in 97us (530us total) trans 0 rc 0/0 00000100:00100000:1.0:1789136284.229644:0:23316:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1789136284.229667:0:23316:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1789136284.229674:0:23316:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7ff649a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:b11da215-324d-4c8d-90a5-0b7f26186c4c+3:24492:x1876044666909952:12345-0@lo:104: 00010000:00010000:1.0:1789136284.229682:0:23316:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.131@tcp lock: ffff90a7e1c9f600/0x559c8745c6de44aa lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x559c8745c6de44b1 expref: -99 pid: 23311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136284.229723:0:23316:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1789136284.229728:0:23316:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7ff649a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:b11da215-324d-4c8d-90a5-0b7f26186c4c+3:24492:x1876044666909952:12345-0@lo:104: Request processed in 56us (392us total) trans 0 rc 0/0 00000100:00100000:1.0:1789136284.229734:0:23316:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00010000:1.0:1789136284.229762:0:23321:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1789136284.229768:0:23321:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.131@tcp lock: ffff90a7c167d200/0x559c8745c6de45ad lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x559c8745c6de45b4 expref: -99 pid: 24068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136284.229776:0:23321:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a7c167d200 already unused, calling callback (ffffffffc13bbc20) 10000000:00010000:1.0:1789136284.229781:0:23321:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.131@tcp lock: ffff90a7c167d200/0x559c8745c6de45ad lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x559c8745c6de45b4 expref: -99 pid: 24068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136284.229791:0:23321:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.131@tcp lock: ffff90a7c167d200/0x559c8745c6de45ad lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x559c8745c6de45b4 expref: -99 pid: 24068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789136284.229798:0:23321:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.131@tcp lock: ffff90a7c167d200/0x559c8745c6de45ad lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x559c8745c6de45b4 expref: -99 pid: 24068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789136284.229804:0:23321:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1789136284.229836:0:23321:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.131@tcp lock: ffff90a7c167d200/0x559c8745c6de45ad lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x559c8745c6de45b4 expref: -99 pid: 24068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136284.229842:0:23321:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789136284.229897:0:23321:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.131@tcp lock: ffff90a7c167d200/0x559c8745c6de45ad lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x559c8745c6de45b4 expref: -99 pid: 24068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136284.229904:0:23321:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.131@tcp lock: ffff90a7c167d200/0x559c8745c6de45ad lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x559c8745c6de45b4 expref: -99 pid: 24068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136284.229922:0:23321:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789136284.229926:0:23321:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.131@tcp lock: ffff90a7e1c9f600/0x559c8745c6de44aa lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x559c8745c6de44b1 expref: -99 pid: 23311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136284.229932:0:23321:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a7e1c9f600 already unused, calling callback (ffffffffc13bbc20) 10000000:00010000:1.0:1789136284.229936:0:23321:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.131@tcp lock: ffff90a7e1c9f600/0x559c8745c6de44aa lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x559c8745c6de44b1 expref: -99 pid: 23311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136284.229942:0:23321:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.131@tcp lock: ffff90a7e1c9f600/0x559c8745c6de44aa lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x559c8745c6de44b1 expref: -99 pid: 23311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789136284.229948:0:23321:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.131@tcp lock: ffff90a7e1c9f600/0x559c8745c6de44aa lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x559c8745c6de44b1 expref: -99 pid: 23311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789136284.229954:0:23321:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1789136284.229968:0:23321:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.131@tcp lock: ffff90a7e1c9f600/0x559c8745c6de44aa lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x559c8745c6de44b1 expref: -99 pid: 23311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136284.229974:0:23321:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789136284.229991:0:23321:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.131@tcp lock: ffff90a7e1c9f600/0x559c8745c6de44aa lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x559c8745c6de44b1 expref: -99 pid: 23311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136284.229998:0:23321:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.131@tcp lock: ffff90a7e1c9f600/0x559c8745c6de44aa lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x559c8745c6de44b1 expref: -99 pid: 23311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136284.230024:0:23321:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789136284.230025:0:23321:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789136284.230027:0:23321:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789136284.230049:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7f662e1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b11da215-324d-4c8d-90a5-0b7f26186c4c:3639:1876044666910080:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789136284.230082:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789136284.230114:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7f662cf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b11da215-324d-4c8d-90a5-0b7f26186c4c:3640:1876044666910208:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789136284.230136:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789136284.230167:0:23317:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666910080 00000100:00100000:1.0:1789136284.230170:0:23317:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666910080 00010000:00010000:1.0:1789136284.230189:0:23317:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90a7e1c9e200/0x559c8745c6de45b4 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x559c8745c6de45ad expref: 18 pid: 23325 timeout: 832 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789136284.230221:0:23317:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666910208 00000100:00100000:1.0:1789136284.230224:0:23317:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666910208 00010000:00010000:1.0:1789136284.230234:0:23317:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90a7d1879200/0x559c8745c6de44b1 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x559c8745c6de44aa expref: 19 pid: 23325 timeout: 832 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789136284.230246:0:23317:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1789136284.230251:0:23317:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7f662da40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b11da215-324d-4c8d-90a5-0b7f26186c4c+19:3639:x1876044666910080:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789136284.230260:0:23317:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789136284.230265:0:23317:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90a7e1c9e200/0x559c8745c6de45b4 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x559c8745c6de45ad expref: 19 pid: 23325 timeout: 832 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136284.230276:0:23317:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90a7e1c9e200/0x559c8745c6de45b4 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x559c8745c6de45ad expref: 19 pid: 23325 timeout: 832 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136284.230294:0:23317:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789136284.230319:0:23317:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7f662da40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b11da215-324d-4c8d-90a5-0b7f26186c4c+19:3639:x1876044666910080:12345-0@lo:103:ldlm_bl.0 Request processed in 68us (236us total) trans 0 rc 0/0 00000100:00100000:1.0:1789136284.230333:0:23317:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1789136284.230348:0:23317:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1789136284.230364:0:23317:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7f662f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b11da215-324d-4c8d-90a5-0b7f26186c4c+18:3640:x1876044666910208:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789136284.230373:0:23317:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789136284.230378:0:23317:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90a7d1879200/0x559c8745c6de44b1 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x559c8745c6de44aa expref: 18 pid: 23325 timeout: 832 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136284.230387:0:23317:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90a7d1879200/0x559c8745c6de44b1 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x559c8745c6de44aa expref: 18 pid: 23325 timeout: 832 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136284.230400:0:23317:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff90a7e1c9fe00/0x559c8745c6de4608 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 24492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136284.230409:0:23317:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90a7e1c9fe00/0x559c8745c6de4608 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 24492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136284.230418:0:23320:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789136284.230424:0:23317:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff90a7e1c9fe00/0x559c8745c6de4608 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 24492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136284.230432:0:23317:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff90a7e1c9fe00/0x559c8745c6de4608 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 24492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136284.230439:0:23317:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff90a7e1c9fe00/0x559c8745c6de4608 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 24492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136284.230446:0:23317:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff90a7e1c9fe00/0x559c8745c6de4608 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 24492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136284.230451:0:23317:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a7e1c9fe00 already unused, calling callback (ffffffffc0dbf540) 00010000:00010000:1.0:1789136284.230455:0:23317:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff90a7e1c9fe00/0x559c8745c6de4608 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 24492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136284.230471:0:23317:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff90a7e1c9fe00/0x559c8745c6de4608 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 24492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136284.230480:0:23317:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff90a7e1c9fe00/0x559c8745c6de4608 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 24492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136284.230498:0:23317:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789136284.230536:0:23317:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7f662f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b11da215-324d-4c8d-90a5-0b7f26186c4c+18:3640:x1876044666910208:12345-0@lo:103:ldlm_bl.0 Request processed in 182us (398us total) trans 0 rc 0/0 00000100:00100000:1.0:1789136284.230542:0:23317:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1789136284.230591:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7f662e1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b11da215-324d-4c8d-90a5-0b7f26186c4c:3639:1876044666910080:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789136284.230660:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7f662cf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b11da215-324d-4c8d-90a5-0b7f26186c4c:3640:1876044666910208:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789136284.231150:0:24492:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90a7e1c9e200/0x559c8745c6de45b4 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x559c8745c6de45ad expref: 17 pid: 23325 timeout: 832 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789136284.231164:0:24492:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7ff648b40 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:24492:1876044666909824:0@lo:104: 00010000:00010000:3.0:1789136284.231174:0:24492:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90a7d1879200/0x559c8745c6de44b1 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x559c8745c6de44aa expref: 16 pid: 23325 timeout: 832 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789136284.231181:0:24492:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7ff648000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:24492:1876044666909952:0@lo:104: 00010000:00010000:3.0:1789136284.231201:0:24492:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff90a7e1c9fe00/0x559c8745c6de4608 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 24492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136284.231221:0:24492:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff90a7e1c9fe00/0x559c8745c6de4608 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 24492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136284.231226:0:24492:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff90a7e1c9fe00/0x559c8745c6de4608 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 24492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136284.231233:0:24492:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90a7e1c9fe00/0x559c8745c6de4608 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 24492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136284.400871:0:23321:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789136285.416287:0:23320:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1789136285.416912:0:23329:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1789136285.416918:0:23329:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff90a6c3ba1800 from 19 10000000:01000000:1.0:1789136285.416924:0:23329:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1789136285.416982:0:23329:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.131@tcp lock: ffff90a7c167d600/0x559c8745c6de460f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 23329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136285.416995:0:23329:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.131@tcp lock: ffff90a7c167d600/0x559c8745c6de460f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 23329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136285.417008:0:23329:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.131@tcp lock: ffff90a7c167d600/0x559c8745c6de460f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 23329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789136285.417038:0:23329:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7f662f0c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b11da215-324d-4c8d-90a5-0b7f26186c4c:23329:1876044666910336:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1789136285.417130:0:23329:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789136285.417195:0:23329:0:(client.c:2715:ptlrpc_set_wait()) set ffff90a7e6e910c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789136285.417261:0:23324:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666910336 00000100:00100000:3.0:1789136285.417271:0:23324:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666910336 00000100:00100000:3.0:1789136285.417355:0:23324:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1789136285.417368:0:23324:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7dd562c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b11da215-324d-4c8d-90a5-0b7f26186c4c+16:23329:x1876044666910336:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789136285.417385:0:23324:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789136285.417421:0:23324:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90a7e1c9fe00/0x559c8745c6de4616 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x559c8745c6de460f expref: -99 pid: 23324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136285.417452:0:23324:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90a7e1c9fe00/0x559c8745c6de4616 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x559c8745c6de460f expref: 17 pid: 23324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136285.417465:0:23324:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90a7e1c9fe00/0x559c8745c6de4616 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x559c8745c6de460f expref: 17 pid: 23324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136285.417477:0:23324:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a7e1c9fe00, rc 0) 00000100:00100000:3.0:1789136285.417530:0:23324:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7dd562c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b11da215-324d-4c8d-90a5-0b7f26186c4c+17:23329:x1876044666910336:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 164us (400us total) trans 0 rc 0/0 00000100:00100000:3.0:1789136285.417538:0:23324:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1789136285.417719:0:23329:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7f662f0c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b11da215-324d-4c8d-90a5-0b7f26186c4c:23329:1876044666910336:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789136285.417736:0:23329:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.131@tcp lock: ffff90a7c167d600/0x559c8745c6de460f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x559c8745c6de4616 expref: -99 pid: 23329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136285.417754:0:23329:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.131@tcp lock: ffff90a7c167d600/0x559c8745c6de460f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x559c8745c6de4616 expref: -99 pid: 23329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789136285.417833:0:23329:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7f662f0c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b11da215-324d-4c8d-90a5-0b7f26186c4c:23329:1876044666910464:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789136285.417936:0:23329:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789136285.418015:0:23329:0:(client.c:2715:ptlrpc_set_wait()) set ffff90a7e6e910c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789136285.422387:0:23325:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666910464 00000100:00100000:3.0:1789136285.422405:0:23325:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666910464 00000100:00100000:2.0:1789136285.422708:0:23325:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1789136285.422721:0:23325:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7dd560850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b11da215-324d-4c8d-90a5-0b7f26186c4c+17:23329:x1876044666910464:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789136285.423256:0:23325:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7dd560850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b11da215-324d-4c8d-90a5-0b7f26186c4c+17:23329:x1876044666910464:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 535us (5317us total) trans 0 rc 0/0 00000100:00100000:2.0:1789136285.423265:0:23325:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1789136285.424508:0:23329:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7f662f0c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b11da215-324d-4c8d-90a5-0b7f26186c4c:23329:1876044666910464:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789136285.424586:0:23329:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7f662f0c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b11da215-324d-4c8d-90a5-0b7f26186c4c:23329:1876044666910592:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789136285.424667:0:23329:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789136285.424712:0:23329:0:(client.c:2715:ptlrpc_set_wait()) set ffff90a7e6e910c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789136285.425055:0:23325:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666910592 00000100:00100000:3.0:1789136285.425063:0:23325:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666910592 00000100:00100000:3.0:1789136285.425125:0:23325:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1789136285.425135:0:23325:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7dd563450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b11da215-324d-4c8d-90a5-0b7f26186c4c+17:23329:x1876044666910592:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789136285.425275:0:23325:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7dd563450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b11da215-324d-4c8d-90a5-0b7f26186c4c+17:23329:x1876044666910592:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 140us (607us total) trans 0 rc 0/0 00000100:00100000:3.0:1789136285.425283:0:23325:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1789136285.427619:0:23329:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7f662f0c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b11da215-324d-4c8d-90a5-0b7f26186c4c:23329:1876044666910592:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1789136285.438357:0:24530:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 19 00000020:01000000:2.0:1789136285.439390:0:23329:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 19-18 (rc=0) 10000000:01000000:2.0:1789136285.439432:0:23329:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.131@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1789136285.439448:0:23329:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.131@tcp lock: ffff90a7c167d600/0x559c8745c6de460f lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x559c8745c6de4616 expref: -99 pid: 23329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136285.439464:0:23329:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.131@tcp lock: ffff90a7c167d600/0x559c8745c6de460f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x559c8745c6de4616 expref: -99 pid: 23329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789136285.439477:0:23329:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1789136285.439481:0:23329:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff90a7fa55b800 from 19 10000000:01000000:2.0:1789136285.439484:0:23329:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1789136285.439549:0:23329:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.131@tcp lock: ffff90a7d1878e00/0x559c8745c6de461d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 23329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136285.439557:0:23329:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.131@tcp lock: ffff90a7d1878e00/0x559c8745c6de461d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 23329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136285.439569:0:23329:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.131@tcp lock: ffff90a7d1878e00/0x559c8745c6de461d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 23329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789136285.439602:0:23329:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7c14b43c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b11da215-324d-4c8d-90a5-0b7f26186c4c:23329:1876044666910720:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789136285.439696:0:23329:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789136285.439777:0:23329:0:(client.c:2715:ptlrpc_set_wait()) set ffff90a7ceab3d80 going to sleep for 11 seconds 00000100:00100000:0.0:1789136285.439846:0:23327:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666910720 00000100:00100000:0.0:1789136285.440024:0:23327:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666910720 00000100:00100000:0.0:1789136285.440128:0:23327:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1789136285.440141:0:23327:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7dd560450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b11da215-324d-4c8d-90a5-0b7f26186c4c+17:23329:x1876044666910720:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789136285.440157:0:23327:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789136285.440174:0:23327:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90a6c3cafa00/0x559c8745c6de4624 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x559c8745c6de461d expref: -99 pid: 23327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136285.440214:0:23327:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90a6c3cafa00/0x559c8745c6de4624 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x559c8745c6de461d expref: 18 pid: 23327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136285.440226:0:23327:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90a6c3cafa00/0x559c8745c6de4624 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x559c8745c6de461d expref: 18 pid: 23327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136285.440235:0:23327:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a6c3cafa00, rc 0) 00000100:00100000:0.0:1789136285.440296:0:23327:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7dd560450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b11da215-324d-4c8d-90a5-0b7f26186c4c+18:23329:x1876044666910720:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 159us (601us total) trans 0 rc 0/0 00000100:00100000:0.0:1789136285.440304:0:23327:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1789136285.440471:0:23329:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7c14b43c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b11da215-324d-4c8d-90a5-0b7f26186c4c:23329:1876044666910720:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789136285.440489:0:23329:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.131@tcp lock: ffff90a7d1878e00/0x559c8745c6de461d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x559c8745c6de4624 expref: -99 pid: 23329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136285.440498:0:23329:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.131@tcp lock: ffff90a7d1878e00/0x559c8745c6de461d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x559c8745c6de4624 expref: -99 pid: 23329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789136285.440581:0:23329:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7f662f0c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b11da215-324d-4c8d-90a5-0b7f26186c4c:23329:1876044666910848:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789136285.440615:0:23329:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789136285.446907:0:23329:0:(client.c:2715:ptlrpc_set_wait()) set ffff90a7e6e910c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789136285.451838:0:23325:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666910848 00000100:00100000:2.0:1789136285.451887:0:23325:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666910848 00000100:00100000:2.0:1789136285.451961:0:23325:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1789136285.451972:0:23325:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7dd560c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b11da215-324d-4c8d-90a5-0b7f26186c4c+18:23329:x1876044666910848:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789136285.452216:0:23325:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7dd560c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b11da215-324d-4c8d-90a5-0b7f26186c4c+18:23329:x1876044666910848:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 246us (11599us total) trans 0 rc 0/0 00000100:00100000:2.0:1789136285.452225:0:23325:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1789136285.453119:0:23329:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7f662f0c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b11da215-324d-4c8d-90a5-0b7f26186c4c:23329:1876044666910848:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789136285.453213:0:23329:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7c14b5e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b11da215-324d-4c8d-90a5-0b7f26186c4c:23329:1876044666910976:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789136285.453294:0:23329:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789136285.453357:0:23329:0:(client.c:2715:ptlrpc_set_wait()) set ffff90a7ceab3480 going to sleep for 11 seconds 00000100:00100000:2.0:1789136285.453379:0:23325:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666910976 00000100:00100000:2.0:1789136285.453384:0:23325:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666910976 00000100:00100000:2.0:1789136285.453418:0:23325:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1789136285.453426:0:23325:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7dd563850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b11da215-324d-4c8d-90a5-0b7f26186c4c+18:23329:x1876044666910976:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789136285.453542:0:23325:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7dd563850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b11da215-324d-4c8d-90a5-0b7f26186c4c+18:23329:x1876044666910976:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 116us (248us total) trans 0 rc 0/0 00000100:00100000:2.0:1789136285.453550:0:23325:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1789136285.453598:0:23329:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7c14b5e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b11da215-324d-4c8d-90a5-0b7f26186c4c:23329:1876044666910976:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1789136285.460798:0:24532:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 19 00000020:01000000:2.0:1789136285.463843:0:23329:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 19-18 (rc=0) 10000000:01000000:2.0:1789136285.463927:0:23329:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.131@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1789136285.463943:0:23329:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.131@tcp lock: ffff90a7d1878e00/0x559c8745c6de461d lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x559c8745c6de4624 expref: -99 pid: 23329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136285.463957:0:23329:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.131@tcp lock: ffff90a7d1878e00/0x559c8745c6de461d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x559c8745c6de4624 expref: -99 pid: 23329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789136285.546219:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7c14b5e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1876044666911104:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1789136285.546343:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789136285.546420:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7c14b4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1876044666911232:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1789136285.546448:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789136285.546499:0:23338:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666911104 00000100:00100000:2.0:1789136285.546509:0:23338:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666911104 00000100:00100000:2.0:1789136285.546565:0:23338:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666911232 00000100:00100000:2.0:1789136285.546568:0:23338:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666911232 00000100:00100000:2.0:1789136285.546586:0:23338:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1789136285.546595:0:23338:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7c14b43c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3641:x1876044666911104:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1789136285.546642:0:23338:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446309888 avail 1300070400 00000100:00100000:2.0:1789136285.546700:0:23338:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7c14b43c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3641:x1876044666911104:12345-0@lo:41:osp-pre-0-1.0 Request processed in 105us (357us total) trans 0 rc 0/0 00000100:00100000:2.0:1789136285.546708:0:23338:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1789136285.546729:0:23338:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1789136285.546735:0:23338:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7c14b4780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3638:x1876044666911232:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1789136285.546752:0:23338:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:2.0:1789136285.546782:0:23338:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7c14b4780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3638:x1876044666911232:12345-0@lo:41:osp-pre-1-0.0 Request processed in 47us (333us total) trans 0 rc 0/0 00000100:00100000:2.0:1789136285.546788:0:23338:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1789136285.546841:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7c14b4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1876044666911232:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1789136285.546902:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7c14b5e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1876044666911104:0@lo:41:osp-pre-0-1.0 00000100:00080000:0.0:1789136285.547822:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789136285.547828:0:487:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1789136285.547832:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789136285.547882:0:487:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1789136285.547925:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789136285.547929:0:487:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1789136285.547932:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789136285.547934:0:487:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1789136285.548063:0:3637:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789136275/real 1789136275] req@ffff90a7c14b6940 x1876044666905088/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789136285 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789136285.548100:0:3637:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff90a7c14b6940 x1876044666905088/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789136285 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789136285.548110:0:3637:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789136275/real 1789136275] req@ffff90a7fa3be580 x1876044666904960/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789136285 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789136285.548120:0:3637:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff90a7fa3be580 x1876044666904960/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789136285 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789136285.548129:0:3637:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789136270/real 1789136270] req@ffff90a7ff648f00 x1876044666902912/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789136285 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789136285.548139:0:3637:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff90a7ff648f00 x1876044666902912/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789136285 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789136285.548147:0:3637:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789136270/real 1789136270] req@ffff90a7ff64b0c0 x1876044666903040/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789136285 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789136285.548155:0:3637:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff90a7ff64b0c0 x1876044666903040/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789136285 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1789136285.548173:0:3637:0:(import.c:65:import_set_state_nolock()) ffff90a7d8b2a800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1789136285.548185:0:3637:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:1.0:1789136285.548188:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7c14b6940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3637:1876044666905088:0@lo:8:llog_process_th.0 00000100:00080000:1.0:1789136285.548193:0:3637:0:(import.c:65:import_set_state_nolock()) ffff90a7ff507800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1789136285.548197:0:3637:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:1.0:1789136285.548199:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7fa3be580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3637:1876044666904960:0@lo:8:llog_process_th.0 00000100:00080000:1.0:1789136285.548202:0:3637:0:(import.c:65:import_set_state_nolock()) ffff90a7ff553800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1789136285.548211:0:3637:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:1.0:1789136285.548214:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7ff648f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3637:1876044666902912:0@lo:8:kworker.0 00000100:00080000:1.0:1789136285.548218:0:3637:0:(import.c:65:import_set_state_nolock()) ffff90a6c228c000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1789136285.548222:0:3637:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:1.0:1789136285.548225:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7ff64b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3637:1876044666903040:0@lo:8:kworker.0 00000100:00080000:0.0:1789136285.550932:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789136285.550946:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:0.0:1789136285.550950:0:487:0:(import.c:65:import_set_state_nolock()) ffff90a7ff553800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1789136285.550960:0:487:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 718 00000100:00080000:0.0:1789136285.550968:0:487:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:0.0:1789136285.550976:0:487:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff90a7ff553800 using connection 192.168.201.131@tcp/0@lo 00000100:00100000:0.0:1789136285.551021:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff90a7fa3bcb40 x1876044666911616/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1789136285.551050:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789136285.551052:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1789136285.551054:0:487:0:(import.c:65:import_set_state_nolock()) ffff90a6c228c000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1789136285.551057:0:487:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 718 00000100:00080000:0.0:1789136285.551060:0:487:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:0.0:1789136285.551063:0:487:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff90a6c228c000 using connection 192.168.201.131@tcp/0@lo 00000100:00100000:0.0:1789136285.551072:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff90a7fa3bed00 x1876044666911744/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1789136285.551081:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789136285.551083:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:0.0:1789136285.551094:0:487:0:(import.c:65:import_set_state_nolock()) ffff90a7ff507800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1789136285.551098:0:487:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 723 00000100:00080000:0.0:1789136285.551100:0:487:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1789136285.551104:0:487:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff90a7ff507800 using connection 192.168.201.131@tcp/0@lo 00000100:00100000:0.0:1789136285.551115:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff90a7fa3bd2c0 x1876044666911872/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1789136285.551123:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789136285.551125:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1789136285.551127:0:487:0:(import.c:65:import_set_state_nolock()) ffff90a7d8b2a800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1789136285.551129:0:487:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 723 00000100:00080000:0.0:1789136285.551131:0:487:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1789136285.551134:0:487:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff90a7d8b2a800 using connection 192.168.201.131@tcp/0@lo 00000100:00100000:0.0:1789136285.551143:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff90a7fa3be580 x1876044666912000/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1789136285.554714:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7fa3be940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3639:1876044666911360:0@lo:400:kworker.0 00000100:00100000:2.0:1789136285.554834:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789136285.554969:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7fa3bde00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3640:1876044666911488:0@lo:400:kworker.0 00000100:00100000:2.0:1789136285.555007:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789136285.555050:0:23334:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666911360 00000100:00100000:2.0:1789136285.555059:0:23334:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666911360 00000100:00100000:2.0:1789136285.555117:0:23334:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666911488 00000100:00100000:2.0:1789136285.555120:0:23334:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666911488 00000100:00100000:2.0:1789136285.555138:0:23334:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1789136285.555148:0:23334:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7c14b5e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3639:x1876044666911360:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789136285.555216:0:23334:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7c14b5e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3639:x1876044666911360:12345-0@lo:400:kworker.0 Request processed in 68us (383us total) trans 0 rc 0/0 00000100:00100000:2.0:1789136285.555224:0:23334:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1789136285.555244:0:23334:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1789136285.555251:0:23334:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7c14b4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3640:x1876044666911488:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789136285.555298:0:23334:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7c14b4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3640:x1876044666911488:12345-0@lo:400:kworker.0 Request processed in 47us (289us total) trans 0 rc 0/0 00000100:00100000:2.0:1789136285.555304:0:23334:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:2.0:1789136285.555358:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff90a7fa3bde00 x1876044666911488/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789136301 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789136285.555376:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7fa3bde00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3640:1876044666911488:0@lo:400:kworker.0 00010000:00080000:2.0:1789136285.555419:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff90a7fa3be940 x1876044666911360/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789136301 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789136285.555428:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7fa3be940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3639:1876044666911360:0@lo:400:kworker.0 00000100:00100000:1.0:1789136285.557628:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7fa3bcb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3637:1876044666911616:0@lo:8:kworker.0 00000400:00000100:1.0:1789136285.558994:0:3637:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1876044666911616 offset 0 length 520: 4 00000100:00100000:1.0:1789136285.559068:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7fa3bed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3637:1876044666911744:0@lo:8:kworker.0 00000400:00000100:1.0:1789136285.559117:0:3637:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1876044666911744 offset 0 length 520: 4 00000100:00100000:1.0:1789136285.559132:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7fa3bd2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3637:1876044666911872:0@lo:8:kworker.0 00000400:00000100:1.0:1789136285.559156:0:3637:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1876044666911872 offset 0 length 520: 4 00000100:00100000:1.0:1789136285.559167:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7fa3be580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3637:1876044666912000:0@lo:8:kworker.0 00000400:00000100:1.0:1789136285.559187:0:3637:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1876044666912000 offset 0 length 520: 4 00000001:00100000:1.0:1789136286.068939:0:24069:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00010000:00010000:2.0:1789136286.446750:0:23321:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789136287.466497:0:23320:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1789136287.742791:0:24094:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1789136288.491720:0:23321:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789136289.512980:0:23320:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789136290.536711:0:23321:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789136290.664737:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789136290.664755:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7ff64ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1876044666912128:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1789136290.664821:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789136290.664911:0:23338:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666912128 00000100:00100000:3.0:1789136290.664919:0:23338:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666912128 00000100:00100000:3.0:1789136290.664961:0:23338:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1789136290.664978:0:23338:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7ff648b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3640:x1876044666912128:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1789136290.665023:0:23338:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446309888 avail 1300070400 00000100:00100000:3.0:1789136290.665067:0:23338:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7ff648b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3640:x1876044666912128:12345-0@lo:41:osp-pre-0-1.0 Request processed in 89us (244us total) trans 0 rc 0/0 00000100:00100000:3.0:1789136290.665074:0:23338:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1789136290.665119:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7ff64ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1876044666912128:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1789136290.669320:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789136290.669341:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7f662ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1876044666912256:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1789136290.669420:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789136290.672592:0:24077:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666912256 00000100:00100000:1.0:1789136290.672606:0:24077:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666912256 00000100:00100000:1.0:1789136290.672668:0:24077:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1789136290.672678:0:24077:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7c14b4b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3639:x1876044666912256:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1789136290.672717:0:24077:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1789136290.672802:0:24077:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7c14b4b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3639:x1876044666912256:12345-0@lo:41:osp-pre-1-0.0 Request processed in 125us (3382us total) trans 0 rc 0/0 00000100:00100000:1.0:1789136290.672809:0:24077:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1789136290.672879:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7f662ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1876044666912256:0@lo:41:osp-pre-1-0.0 00000100:00080000:0.0:1789136290.673040:0:16093:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789136290.673044:0:16093:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1789136290.673047:0:16093:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789136290.673050:0:16093:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1789136290.673069:0:16093:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789136290.673073:0:16093:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1789136290.673075:0:16093:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789136290.673078:0:16093:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1789136290.673412:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7fa3bfc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b11da215-324d-4c8d-90a5-0b7f26186c4c:3639:1876044666912384:0@lo:400:kworker.0 00000100:00100000:0.0:1789136290.673462:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789136290.673523:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7fa3be1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3640:1876044666912512:0@lo:400:kworker.0 00000100:00100000:0.0:1789136290.673552:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789136290.673575:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789136290.673580:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7fa3bf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3640:1876044666912640:0@lo:400:kworker.0 00000100:00100000:0.0:1789136290.673603:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789136290.673631:0:23325:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666912384 00000100:00100000:0.0:1789136290.673636:0:23325:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666912384 00000100:00100000:0.0:1789136290.673671:0:23325:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1789136290.673679:0:23325:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7f6658450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b11da215-324d-4c8d-90a5-0b7f26186c4c+18:3639:x1876044666912384:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789136290.673719:0:23325:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7f6658450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b11da215-324d-4c8d-90a5-0b7f26186c4c+18:3639:x1876044666912384:12345-0@lo:400:kworker.0 Request processed in 40us (255us total) trans 0 rc 0/0 00000100:00100000:0.0:1789136290.673724:0:23325:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1789136290.673756:0:23334:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666912512 00000100:00100000:0.0:1789136290.673759:0:23334:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666912512 00000100:00100000:0.0:1789136290.673783:0:23334:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666912640 00000100:00100000:0.0:1789136290.673785:0:23334:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666912640 00000100:00100000:0.0:1789136290.673797:0:23334:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1789136290.673802:0:23334:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7fa3bf0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1876044666912512:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789136290.673837:0:23334:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7fa3bf0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1876044666912512:12345-0@lo:400:kworker.0 Request processed in 35us (284us total) trans 0 rc 0/0 00000100:00100000:0.0:1789136290.673843:0:23334:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1789136290.673895:0:23334:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1789136290.673902:0:23334:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7fa3be940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3640:x1876044666912640:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789136290.673930:0:23334:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7fa3be940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3640:x1876044666912640:12345-0@lo:400:kworker.0 Request processed in 29us (326us total) trans 0 rc 0/0 00000100:00100000:0.0:1789136290.673943:0:23334:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1789136290.673980:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7fa3bfc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b11da215-324d-4c8d-90a5-0b7f26186c4c:3639:1876044666912384:0@lo:400:kworker.0 00010000:00080000:0.0:1789136290.674014:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff90a7fa3bf480 x1876044666912640/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789136306 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789136290.674025:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7fa3bf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3640:1876044666912640:0@lo:400:kworker.0 00010000:00080000:0.0:1789136290.674035:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff90a7fa3be1c0 x1876044666912512/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789136306 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789136290.674043:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7fa3be1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3640:1876044666912512:0@lo:400:kworker.0 00010000:00010000:3.0:1789136291.561882:0:23320:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1789136292.203141:0:23370:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000020:01000004:3.0:1789136292.333275:0:24840:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:3.0:1789136292.333280:0:24840:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/ost1_flakey 00000020:01000004:3.0:1789136292.333281:0:24840:0:(obd_mount.c:929:lmd_print()) options: errors=remount-ro 00000080:01200004:3.0:1789136292.333394:0:24840:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff90a7ff56c800 00000020:01000004:3.0:1789136292.333410:0:24840:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-OST0000, type=osd-ldiskfs, lsifl=200002, mountfl=0 00000020:01000004:3.0:1789136292.333423:0:24840:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-ldiskfs) 00000020:00000080:3.0:1789136292.333437:0:24840:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff90a6c2b94ed8) 00000020:00000080:3.0:1789136292.333469:0:24840:0:(obd_config.c:720:class_attach_name()) OBD: dev 20 attached type osd-ldiskfs with refcount 2 00100000:10000000:0.0:1789136292.470558:0:24840:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:0.0:1789136292.479496:0:24840:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/32) registered 00100000:10000000:0.0:1789136292.481634:0:24840:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:1.0:1789136292.487572:0:24840:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:1.0:1789136292.488002:0:24840:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/32) registered 00100000:10000000:1.0:1789136292.488270:0:24840:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000003:0x7:0x0] (8/32) registered 00100000:10000000:1.0:1789136292.488549:0:24840:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8) registered 00080000:01000000:1.0:1789136292.496058:0:24840:0:(osd_lproc.c:911:osd_procfs_init()) lustre-OST0000: register osd-ldiskfs tunable parameters 00000020:00000080:1.0:1789136292.496291:0:24840:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:1.0:1789136292.496306:0:24840:0:(osd_handler.c:8895:osd_obd_connect()) connect #0 00000020:00000080:1.0:1789136292.496318:0:24840:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x559c8745c6de4632 00000020:01000004:1.0:1789136292.496325:0:24840:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-OST0000 on device /dev/mapper/ost1_flakey 00000020:01000004:1.0:1789136292.496348:0:24840:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.201.131@tcp:Set MGC reconnect 1 10000000:01000000:1.0:1789136292.496352:0:24840:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.201.131@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:1.0:1789136292.496358:0:24840:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-OST0000 00000020:01000004:1.0:1789136292.496364:0:24840:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:1.0:1789136292.496376:0:24840:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffff90a6c3a40000) 00000020:00000080:1.0:1789136292.496387:0:24840:0:(obd_config.c:720:class_attach_name()) OBD: dev 21 attached type ost with refcount 2 00000100:00100000:1.0:1789136292.497536:0:24840:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1789136292.497689:0:24840:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:1.0:1789136292.497696:0:24840:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:2.0:1789136292.510358:0:24840:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:2.0:1789136292.510372:0:24840:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:2.0:1789136292.516467:0:24840:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:2.0:1789136292.516480:0:24840:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:2.0:1789136292.519968:0:24840:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1789136292.520158:0:24840:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:2.0:1789136292.520164:0:24840:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:3.0:1789136292.521308:0:24840:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:3.0:1789136292.521316:0:24840:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:3.0:1789136292.548669:0:24840:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1789136292.552774:0:24840:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:3.0:1789136292.552783:0:24840:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:2.0:1789136292.559681:0:24840:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:2.0:1789136292.559700:0:24840:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:3.0:1789136292.565123:0:24840:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:3.0:1789136292.565143:0:24840:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:2.0:1789136292.569488:0:24840:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1789136292.569702:0:24840:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:2.0:1789136292.569709:0:24840:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:3.0:1789136292.571179:0:24840:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:3.0:1789136292.571191:0:24840:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00010000:00010000:1.0:1789136292.584077:0:23321:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789136292.622276:0:24840:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1789136292.622480:0:24840:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:0.0:1789136292.622487:0:24840:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:0.0:1789136292.637694:0:24840:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:0.0:1789136292.637729:0:24840:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:3.0:1789136292.638290:0:24840:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:3.0:1789136292.638321:0:24840:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/ost1_flakey 10000000:01000000:3.0:1789136292.638327:0:24840:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.201.131@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:3.0:1789136292.652360:0:24840:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.201.131@tcp ctxt 0 is initialized 00000020:01000004:3.0:1789136292.652403:0:24840:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.201.131@tcp, index=0000, flags=0x20002 00000020:01000004:3.0:1789136292.652407:0:24840:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1789136292.652414:0:24840:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1789136292.652415:0:24840:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789136292.652416:0:24840:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789136292.652417:0:24840:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789136292.652418:0:24840:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789136292.652420:0:24840:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1789136292.652422:0:24840:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789136292.652423:0:24840:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1789136292.652426:0:24840:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020002 00000020:01000004:3.0:1789136292.652428:0:24840:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1789136292.652429:0:24840:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1789136292.652430:0:24840:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789136292.652431:0:24840:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789136292.652432:0:24840:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789136292.652433:0:24840:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789136292.652434:0:24840:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1789136292.653112:0:24840:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789136292.653114:0:24840:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1789136292.653145:0:24840:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:3.0:1789136292.653251:0:24840:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7ff648f00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b11da215-324d-4c8d-90a5-0b7f26186c4c:24840:1876044666912768:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1789136292.653338:0:24840:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789136292.653382:0:24840:0:(client.c:2715:ptlrpc_set_wait()) set ffff90a7fa54ad80 going to sleep for 11 seconds 00000100:00100000:0.0:1789136292.653774:0:23324:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666912768 00000100:00100000:0.0:1789136292.653781:0:23324:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666912768 00000100:00100000:0.0:1789136292.653838:0:23324:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1789136292.653848:0:23324:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7f6659050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b11da215-324d-4c8d-90a5-0b7f26186c4c+18:24840:x1876044666912768:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1789136292.653909:0:23324:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:0.0:1789136292.653913:0:23324:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0000 is running on 0@lo 20000000:01000000:0.0:1789136292.653917:0:23324:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:0.0:1789136292.654263:0:23324:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7f6659050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b11da215-324d-4c8d-90a5-0b7f26186c4c+18:24840:x1876044666912768:12345-0@lo:253:mount.lustre.0 Request processed in 416us (924us total) trans 0 rc 0/0 00000100:00100000:0.0:1789136292.654279:0:23324:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1789136292.654280:0:24840:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7ff648f00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b11da215-324d-4c8d-90a5-0b7f26186c4c:24840:1876044666912768:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1789136292.654290:0:24840:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:3.0:1789136292.654292:0:24840:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1789136292.654294:0:24840:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1789136292.654295:0:24840:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789136292.654296:0:24840:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789136292.654297:0:24840:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789136292.654298:0:24840:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789136292.654300:0:24840:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1789136292.654302:0:24840:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789136292.654303:0:24840:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1789136292.654321:0:24840:0:(tgt_mount.c:101:server_register_mount()) register mount ffff90a7ff56c800 from lustre-OST0000 10000000:01000000:3.0:1789136292.654350:0:24840:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:3.0:1789136292.654353:0:24840:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:3.0:1789136292.654360:0:24840:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff90a6c4709a48 local copy 00010000:00010000:3.0:1789136292.654377:0:24840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.131@tcp lock: ffff90a7e1c9f400/0x559c8745c6de43ed lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x559c8745c6de43f4 expref: -99 pid: 23311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789136292.655489:0:24840:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7ff648f00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b11da215-324d-4c8d-90a5-0b7f26186c4c:24840:1876044666912896:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789136292.655537:0:24840:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789136292.655566:0:23327:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666912896 00000100:00100000:3.0:1789136292.655571:0:24840:0:(client.c:2715:ptlrpc_set_wait()) set ffff90a7fa54ad80 going to sleep for 11 seconds 00000100:00100000:0.0:1789136292.655572:0:23327:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666912896 00000100:00100000:0.0:1789136292.655618:0:23327:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1789136292.655627:0:23327:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7fb157450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b11da215-324d-4c8d-90a5-0b7f26186c4c+18:24840:x1876044666912896:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789136292.655719:0:23327:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7fb157450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b11da215-324d-4c8d-90a5-0b7f26186c4c+18:24840:x1876044666912896:12345-0@lo:501:mount.lustre.0 Request processed in 92us (181us total) trans 0 rc -2/-2 00000100:00100000:0.0:1789136292.655725:0:23327:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1789136292.655788:0:24840:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7ff648f00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b11da215-324d-4c8d-90a5-0b7f26186c4c:24840:1876044666912896:0@lo:501:mount.lustre.0 10000000:01000000:3.0:1789136292.655803:0:24840:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.201.131@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:3.0:1789136292.655823:0:24840:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.201.131@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:3.0:1789136292.655830:0:24840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.131@tcp lock: ffff90a7e1c9f400/0x559c8745c6de43ed lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x559c8745c6de43f4 expref: -99 pid: 23311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136292.655840:0:24840:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.131@tcp lock: ffff90a7e1c9f400/0x559c8745c6de43ed lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x559c8745c6de43f4 expref: -99 pid: 23311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789136292.655886:0:24840:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff90a7ff56c800 10000000:01000000:3.0:1789136292.655892:0:24840:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1789136292.655896:0:24840:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:3.0:1789136292.655899:0:24840:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1789136292.655904:0:24840:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:3.0:1789136292.655907:0:24840:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:3.0:1789136292.655928:0:24840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.131@tcp lock: ffff90a7e1c9fa00/0x559c8745c6de4640 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 24840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136292.655935:0:24840:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.131@tcp lock: ffff90a7e1c9fa00/0x559c8745c6de4640 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 24840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136292.655944:0:24840:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.131@tcp lock: ffff90a7e1c9fa00/0x559c8745c6de4640 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 24840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789136292.655969:0:24840:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7ff648f00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b11da215-324d-4c8d-90a5-0b7f26186c4c:24840:1876044666913024:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1789136292.656262:0:24840:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789136292.656293:0:24840:0:(client.c:2715:ptlrpc_set_wait()) set ffff90a7fa54ad80 going to sleep for 11 seconds 00000100:00100000:0.0:1789136292.656353:0:23324:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666913024 00000100:00100000:0.0:1789136292.656358:0:23324:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666913024 00000100:00100000:0.0:1789136292.656394:0:23324:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1789136292.656401:0:23324:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7fb154850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b11da215-324d-4c8d-90a5-0b7f26186c4c+18:24840:x1876044666913024:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1789136292.656410:0:23324:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789136292.656421:0:23324:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90a6c3cae800/0x559c8745c6de4647 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x559c8745c6de4640 expref: -99 pid: 23324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136292.656442:0:23324:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90a6c3cae800/0x559c8745c6de4647 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x559c8745c6de4640 expref: 19 pid: 23324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136292.656453:0:23324:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90a6c3cae800/0x559c8745c6de4647 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x559c8745c6de4640 expref: 19 pid: 23324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136292.656461:0:23324:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a6c3cae800, rc 0) 00000100:00100000:0.0:1789136292.656496:0:23324:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7fb154850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b11da215-324d-4c8d-90a5-0b7f26186c4c+19:24840:x1876044666913024:12345-0@lo:101:mount.lustre.0 Request processed in 96us (233us total) trans 0 rc 0/0 00000100:00100000:0.0:1789136292.656503:0:23324:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1789136292.656526:0:24840:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7ff648f00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b11da215-324d-4c8d-90a5-0b7f26186c4c:24840:1876044666913024:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789136292.656539:0:24840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.131@tcp lock: ffff90a7e1c9fa00/0x559c8745c6de4640 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x559c8745c6de4647 expref: -99 pid: 24840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136292.656547:0:24840:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.131@tcp lock: ffff90a7e1c9fa00/0x559c8745c6de4640 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x559c8745c6de4647 expref: -99 pid: 24840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1789136292.658500:0:24840:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 14 count 14 00000040:00080000:3.0:1789136292.660460:0:24840:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1789136292.663443:0:24840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].1, 224 off8416 00000040:00080000:2.0:1789136292.663502:0:24840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].2, 128 off8544 00000040:00080000:2.0:1789136292.663520:0:24840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].3, 112 off8656 00000040:00080000:2.0:1789136292.663531:0:24840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].4, 224 off8880 00000040:00080000:2.0:1789136292.663544:0:24840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].5, 224 off9104 00000040:00080000:2.0:1789136292.663557:0:24840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].6, 80 off9184 00000040:00080000:2.0:1789136292.663568:0:24840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].7, 224 off9408 00000040:00080000:2.0:1789136292.663577:0:24840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].8, 224 off9632 00000040:00080000:2.0:1789136292.663588:0:24840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].9, 80 off9712 00000040:00080000:2.0:1789136292.663599:0:24840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].10, 224 off9936 00000040:00080000:2.0:1789136292.663612:0:24840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].11, 224 off10160 00000040:00080000:2.0:1789136292.663624:0:24840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].12, 120 off10280 00000040:00080000:2.0:1789136292.663664:0:24840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].13, 224 off10504 00000040:00080000:2.0:1789136292.663671:0:24840:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 13 count 14 00000100:00100000:2.0:1789136292.663782:0:24840:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7c14b7c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b11da215-324d-4c8d-90a5-0b7f26186c4c:24840:1876044666913152:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789136292.663903:0:24840:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789136292.663947:0:24840:0:(client.c:2715:ptlrpc_set_wait()) set ffff90a7ceab3a80 going to sleep for 11 seconds 00000100:00100000:0.0:1789136292.664847:0:23325:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666913152 00000100:00100000:0.0:1789136292.664900:0:23325:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666913152 00000100:00100000:0.0:1789136292.664958:0:23325:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1789136292.664968:0:23325:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7fb156c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b11da215-324d-4c8d-90a5-0b7f26186c4c+19:24840:x1876044666913152:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789136292.665140:0:23325:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7fb156c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b11da215-324d-4c8d-90a5-0b7f26186c4c+19:24840:x1876044666913152:12345-0@lo:501:mount.lustre.0 Request processed in 174us (1236us total) trans 0 rc 0/0 00000100:00100000:0.0:1789136292.665148:0:23325:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1789136292.665308:0:24840:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7c14b7c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b11da215-324d-4c8d-90a5-0b7f26186c4c:24840:1876044666913152:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789136292.665350:0:24840:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7c14b7c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b11da215-324d-4c8d-90a5-0b7f26186c4c:24840:1876044666913280:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1789136292.665392:0:24840:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789136292.665429:0:24840:0:(client.c:2715:ptlrpc_set_wait()) set ffff90a7ceab3a80 going to sleep for 11 seconds 00000100:00100000:0.0:1789136292.665487:0:23327:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666913280 00000100:00100000:0.0:1789136292.665492:0:23327:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666913280 00000100:00100000:0.0:1789136292.665562:0:23327:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1789136292.665570:0:23327:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7fb155050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b11da215-324d-4c8d-90a5-0b7f26186c4c+19:24840:x1876044666913280:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1789136292.672116:0:23327:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7fb155050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b11da215-324d-4c8d-90a5-0b7f26186c4c+19:24840:x1876044666913280:12345-0@lo:503:mount.lustre.0 Request processed in 6537us (6713us total) trans 0 rc 0/0 00000100:00100000:0.0:1789136292.672131:0:23327:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1789136292.673116:0:24840:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7c14b7c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b11da215-324d-4c8d-90a5-0b7f26186c4c:24840:1876044666913280:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1789136292.673954:0:24840:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1789136292.675389:0:24840:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7f662ed00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b11da215-324d-4c8d-90a5-0b7f26186c4c:24840:1876044666913408:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789136292.675542:0:24840:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789136292.675592:0:24840:0:(client.c:2715:ptlrpc_set_wait()) set ffff90a7f6886300 going to sleep for 11 seconds 00000100:00100000:2.0:1789136292.676337:0:23325:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666913408 00000100:00100000:2.0:1789136292.676345:0:23325:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666913408 00000100:00100000:2.0:1789136292.676405:0:23325:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1789136292.676416:0:23325:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7fb157c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b11da215-324d-4c8d-90a5-0b7f26186c4c+19:24840:x1876044666913408:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789136292.677330:0:23325:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7fb157c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b11da215-324d-4c8d-90a5-0b7f26186c4c+19:24840:x1876044666913408:12345-0@lo:502:mount.lustre.0 Request processed in 913us (1786us total) trans 0 rc 0/0 00000100:00100000:2.0:1789136292.677340:0:23325:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1789136292.677456:0:24840:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7f662ed00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b11da215-324d-4c8d-90a5-0b7f26186c4c:24840:1876044666913408:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1789136292.677705:0:24840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].1, 224 off8416 00000040:00080000:1.0:1789136292.677736:0:24840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].2, 128 off8544 00000040:00080000:1.0:1789136292.677751:0:24840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].3, 112 off8656 00000040:00080000:1.0:1789136292.677773:0:24840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].4, 224 off8880 00000040:00080000:1.0:1789136292.677785:0:24840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].5, 224 off9104 00000040:00080000:1.0:1789136292.677796:0:24840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].6, 80 off9184 00000040:00080000:1.0:1789136292.677808:0:24840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].7, 224 off9408 00000040:00080000:1.0:1789136292.677820:0:24840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].8, 224 off9632 00000040:00080000:1.0:1789136292.677833:0:24840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].9, 80 off9712 00000040:00080000:1.0:1789136292.677845:0:24840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].10, 224 off9936 00000040:00080000:1.0:1789136292.677895:0:24840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].11, 224 off10160 00000040:00080000:1.0:1789136292.677911:0:24840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].12, 120 off10280 00000100:00100000:1.0:1789136292.677942:0:24840:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7f662ed00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b11da215-324d-4c8d-90a5-0b7f26186c4c:24840:1876044666913536:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789136292.678238:0:24840:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789136292.678288:0:24840:0:(client.c:2715:ptlrpc_set_wait()) set ffff90a7f6886300 going to sleep for 11 seconds 00000100:00100000:3.0:1789136292.678336:0:23324:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666913536 00000100:00100000:3.0:1789136292.678343:0:23324:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666913536 00000100:00100000:3.0:1789136292.678381:0:23324:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1789136292.678390:0:23324:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7fb156450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b11da215-324d-4c8d-90a5-0b7f26186c4c+19:24840:x1876044666913536:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789136292.678503:0:23324:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7fb156450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b11da215-324d-4c8d-90a5-0b7f26186c4c+19:24840:x1876044666913536:12345-0@lo:502:mount.lustre.0 Request processed in 114us (342us total) trans 0 rc 0/0 00000100:00100000:3.0:1789136292.678511:0:23324:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1789136292.678630:0:24840:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7f662ed00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b11da215-324d-4c8d-90a5-0b7f26186c4c:24840:1876044666913536:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1789136292.678669:0:24840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].13, 224 off10504 00000040:00080000:1.0:1789136292.678677:0:24840:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 13 count 14 00000020:01000000:2.0:1789136292.679950:0:24857:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1789136292.679959:0:24857:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/ost1_flakey 00000020:00000080:2.0:1789136292.679966:0:24857:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789136292.679968:0:24857:0:(obd_config.c:1563:class_process_config()) marker 21 (0x1) lustre-OST0000 add ost 00000020:00000080:2.0:1789136292.679974:0:24857:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1789136292.679988:0:24857:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff90a6c470b490) 00000020:00000080:2.0:1789136292.680012:0:24857:0:(obd_config.c:720:class_attach_name()) OBD: dev 22 attached type obdfilter with refcount 2 00000020:00000080:2.0:1789136292.680018:0:24857:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:2.0:1789136292.680093:0:24857:0:(tgt_mount.c:153:server_get_mount()) get mount ffff90a7ff56c800 from lustre-OST0000, refs=2 00080000:01000000:2.0:1789136292.680103:0:24857:0:(osd_handler.c:8895:osd_obd_connect()) connect #1 00000020:00000080:2.0:1789136292.680111:0:24857:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x559c8745c6de4655 00010000:00010000:2.0:1789136292.683158:0:24857:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-3 is initialized 00000001:00000004:2.0:1789136292.690902:0:24857:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 3, last_transno is 8589934600 00080000:10000000:2.0:1789136292.696096:0:24857:0:(osd_handler.c:5551:osd_index_try()) lustre-OST0000: index object [0x200000003:0xc:0x0] (8/32) registered 00000020:00000080:0.0:1789136292.730833:0:24857:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:0.0:1789136292.730849:0:24857:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789136292.730885:0:24857:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789136292.730887:0:24857:0:(obd_config.c:1563:class_process_config()) marker 21 (0x2) lustre-OST0000 add ost 00000020:01000000:0.0:1789136292.730891:0:24857:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:0.0:1789136292.730894:0:24857:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #26 00000020:01000000:0.0:1789136292.730895:0:24857:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1789136292.730897:0:24857:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1789136292.730898:0:24857:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:0.0:1789136292.730901:0:24857:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789136292.730902:0:24857:0:(obd_config.c:1563:class_process_config()) marker 26 (0x6) lustre sys.timeout 00000020:01000000:0.0:1789136292.730905:0:24857:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789136292.730907:0:24857:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789136292.730908:0:24857:0:(obd_config.c:1563:class_process_config()) marker 34 (0x1) lustre sys.timeout 00000020:00000080:0.0:1789136292.730911:0:24857:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1789136292.730913:0:24857:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:0.0:1789136292.730915:0:24857:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789136292.730930:0:24857:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789136292.730931:0:24857:0:(obd_config.c:1563:class_process_config()) marker 34 (0x2) lustre sys.timeout 00000020:01000000:0.0:1789136292.730934:0:24857:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789136292.730937:0:24857:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789136292.730938:0:24857:0:(obd_config.c:1563:class_process_config()) marker 39 (0x1) lustre sys.jobid_var 00000020:00000080:0.0:1789136292.730941:0:24857:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:0.0:1789136292.730982:0:24857:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789136292.730985:0:24857:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789136292.730987:0:24857:0:(obd_config.c:1563:class_process_config()) marker 39 (0x2) lustre sys.jobid_var 00000040:00080000:0.0:1789136292.730990:0:24857:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xc:0x0] index 14 count 14 00000020:01000000:1.0:1789136292.731340:0:24840:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-13 (rc=0) 10000000:01000000:1.0:1789136292.731372:0:24840:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.131@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:1.0:1789136292.731390:0:24840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.131@tcp lock: ffff90a7e1c9fa00/0x559c8745c6de4640 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x559c8745c6de4647 expref: -99 pid: 24840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136292.731402:0:24840:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.131@tcp lock: ffff90a7e1c9fa00/0x559c8745c6de4640 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x559c8745c6de4647 expref: -99 pid: 24840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789136292.731411:0:24840:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff90a7ff56c800 from 1 10000000:01000000:1.0:1789136292.731414:0:24840:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1789136292.731451:0:24840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.131@tcp lock: ffff90a7c167ce00/0x559c8745c6de465c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 24840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136292.731459:0:24840:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.131@tcp lock: ffff90a7c167ce00/0x559c8745c6de465c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 24840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136292.731482:0:24840:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.131@tcp lock: ffff90a7c167ce00/0x559c8745c6de465c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 24840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789136292.731508:0:24840:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7f662ed00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b11da215-324d-4c8d-90a5-0b7f26186c4c:24840:1876044666913664:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1789136292.731574:0:24840:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789136292.731625:0:24840:0:(client.c:2715:ptlrpc_set_wait()) set ffff90a7f6886840 going to sleep for 11 seconds 00000100:00100000:0.0:1789136292.734649:0:23325:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666913664 00000100:00100000:0.0:1789136292.734665:0:23325:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666913664 00000100:00100000:0.0:1789136292.734744:0:23325:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1789136292.734755:0:23325:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7fb155c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b11da215-324d-4c8d-90a5-0b7f26186c4c+19:24840:x1876044666913664:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1789136292.734772:0:23325:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789136292.734793:0:23325:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90a6c3caf400/0x559c8745c6de4663 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x559c8745c6de465c expref: -99 pid: 23325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136292.734823:0:23325:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90a6c3caf400/0x559c8745c6de4663 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x559c8745c6de465c expref: 20 pid: 23325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136292.734834:0:23325:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90a6c3caf400/0x559c8745c6de4663 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x559c8745c6de465c expref: 20 pid: 23325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136292.734842:0:23325:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a6c3caf400, rc 0) 00000100:00100000:0.0:1789136292.734957:0:23325:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7fb155c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b11da215-324d-4c8d-90a5-0b7f26186c4c+20:24840:x1876044666913664:12345-0@lo:101:mount.lustre.0 Request processed in 204us (3382us total) trans 0 rc 0/0 00000100:00100000:0.0:1789136292.734964:0:23325:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1789136292.735063:0:24840:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7f662ed00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b11da215-324d-4c8d-90a5-0b7f26186c4c:24840:1876044666913664:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789136292.735081:0:24840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.131@tcp lock: ffff90a7c167ce00/0x559c8745c6de465c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x559c8745c6de4663 expref: -99 pid: 24840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136292.735091:0:24840:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.131@tcp lock: ffff90a7c167ce00/0x559c8745c6de465c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x559c8745c6de4663 expref: -99 pid: 24840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1789136292.736048:0:24840:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 19 count 19 00000040:00080000:1.0:1789136292.736309:0:24840:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1789136292.737520:0:24840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].1, 224 off8416 00000040:00080000:1.0:1789136292.737557:0:24840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].2, 112 off8528 00000040:00080000:1.0:1789136292.737571:0:24840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].3, 224 off8752 00000040:00080000:1.0:1789136292.737584:0:24840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].4, 224 off8976 00000040:00080000:1.0:1789136292.737595:0:24840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].5, 112 off9088 00000040:00080000:1.0:1789136292.737608:0:24840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].6, 224 off9312 00000040:00080000:1.0:1789136292.737620:0:24840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].7, 224 off9536 00000040:00080000:1.0:1789136292.737633:0:24840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].8, 144 off9680 00000040:00080000:1.0:1789136292.737645:0:24840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].9, 224 off9904 00000040:00080000:1.0:1789136292.737656:0:24840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].10, 224 off10128 00000040:00080000:1.0:1789136292.737669:0:24840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].11, 144 off10272 00000040:00080000:1.0:1789136292.737697:0:24840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].12, 224 off10496 00000040:00080000:1.0:1789136292.737713:0:24840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].13, 224 off10720 00000040:00080000:1.0:1789136292.737727:0:24840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].14, 128 off10848 00000040:00080000:1.0:1789136292.737750:0:24840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].15, 224 off11072 00000040:00080000:1.0:1789136292.737762:0:24840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].16, 224 off11296 00000040:00080000:1.0:1789136292.737775:0:24840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].17, 128 off11424 00000040:00080000:1.0:1789136292.737795:0:24840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].18, 224 off11648 00000040:00080000:1.0:1789136292.737801:0:24840:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 18 count 19 00000100:00100000:1.0:1789136292.737902:0:24840:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7f662ed00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b11da215-324d-4c8d-90a5-0b7f26186c4c:24840:1876044666913792:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789136292.737965:0:24840:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789136292.738010:0:24840:0:(client.c:2715:ptlrpc_set_wait()) set ffff90a7f6886900 going to sleep for 11 seconds 00000100:00100000:0.0:1789136292.739093:0:23327:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666913792 00000100:00100000:0.0:1789136292.739102:0:23327:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666913792 00000100:00100000:0.0:1789136292.739148:0:23327:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1789136292.739167:0:23327:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7fb154050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b11da215-324d-4c8d-90a5-0b7f26186c4c+20:24840:x1876044666913792:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789136292.739310:0:23327:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7fb154050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b11da215-324d-4c8d-90a5-0b7f26186c4c+20:24840:x1876044666913792:12345-0@lo:501:mount.lustre.0 Request processed in 144us (1345us total) trans 0 rc 0/0 00000100:00100000:0.0:1789136292.739319:0:23327:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1789136292.739591:0:24840:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7f662ed00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b11da215-324d-4c8d-90a5-0b7f26186c4c:24840:1876044666913792:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789136292.739636:0:24840:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7f662ed00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b11da215-324d-4c8d-90a5-0b7f26186c4c:24840:1876044666913920:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1789136292.739680:0:24840:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789136292.739728:0:24840:0:(client.c:2715:ptlrpc_set_wait()) set ffff90a7f6886900 going to sleep for 11 seconds 00000100:00100000:2.0:1789136292.741313:0:23324:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666913920 00000100:00100000:2.0:1789136292.741337:0:23324:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666913920 00000100:00100000:2.0:1789136292.741395:0:23324:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1789136292.741404:0:23324:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7fb155850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b11da215-324d-4c8d-90a5-0b7f26186c4c+20:24840:x1876044666913920:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1789136292.741541:0:23324:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7fb155850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b11da215-324d-4c8d-90a5-0b7f26186c4c+20:24840:x1876044666913920:12345-0@lo:503:mount.lustre.0 Request processed in 137us (1860us total) trans 0 rc 0/0 00000100:00100000:2.0:1789136292.741548:0:23324:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1789136292.742588:0:24840:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7f662ed00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b11da215-324d-4c8d-90a5-0b7f26186c4c:24840:1876044666913920:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1789136292.744215:0:24840:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1789136292.744298:0:24840:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7f662ed00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b11da215-324d-4c8d-90a5-0b7f26186c4c:24840:1876044666914048:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789136292.744384:0:24840:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789136292.744453:0:24840:0:(client.c:2715:ptlrpc_set_wait()) set ffff90a7f6886840 going to sleep for 11 seconds 00000100:00100000:2.0:1789136292.744537:0:23325:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666914048 00000100:00100000:2.0:1789136292.744543:0:23325:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666914048 00000100:00100000:2.0:1789136292.744582:0:23325:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1789136292.744590:0:23325:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7fb155450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b11da215-324d-4c8d-90a5-0b7f26186c4c+20:24840:x1876044666914048:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789136292.744684:0:23325:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7fb155450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b11da215-324d-4c8d-90a5-0b7f26186c4c+20:24840:x1876044666914048:12345-0@lo:502:mount.lustre.0 Request processed in 94us (300us total) trans 0 rc 0/0 00000100:00100000:2.0:1789136292.744692:0:23325:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1789136292.745703:0:24840:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7f662ed00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b11da215-324d-4c8d-90a5-0b7f26186c4c:24840:1876044666914048:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1789136292.745937:0:24840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].1, 224 off8416 00000040:00080000:1.0:1789136292.745963:0:24840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].2, 112 off8528 00000040:00080000:1.0:1789136292.745974:0:24840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].3, 224 off8752 00000040:00080000:1.0:1789136292.745985:0:24840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].4, 224 off8976 00000040:00080000:1.0:1789136292.745997:0:24840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].5, 112 off9088 00000040:00080000:1.0:1789136292.746008:0:24840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].6, 224 off9312 00000040:00080000:1.0:1789136292.746019:0:24840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].7, 224 off9536 00000040:00080000:1.0:1789136292.746044:0:24840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].8, 144 off9680 00000040:00080000:1.0:1789136292.746057:0:24840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].9, 224 off9904 00000040:00080000:1.0:1789136292.746076:0:24840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].10, 224 off10128 00000040:00080000:1.0:1789136292.746087:0:24840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].11, 144 off10272 00000040:00080000:1.0:1789136292.746099:0:24840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].12, 224 off10496 00000040:00080000:1.0:1789136292.746110:0:24840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].13, 224 off10720 00000040:00080000:1.0:1789136292.746120:0:24840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].14, 128 off10848 00000040:00080000:1.0:1789136292.746131:0:24840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].15, 224 off11072 00000040:00080000:1.0:1789136292.746142:0:24840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].16, 224 off11296 00000040:00080000:1.0:1789136292.746153:0:24840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].17, 128 off11424 00000100:00100000:1.0:1789136292.746179:0:24840:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7f662ed00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b11da215-324d-4c8d-90a5-0b7f26186c4c:24840:1876044666914176:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789136292.746237:0:24840:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789136292.746276:0:24840:0:(client.c:2715:ptlrpc_set_wait()) set ffff90a7f6886840 going to sleep for 11 seconds 00000100:00100000:0.0:1789136292.746386:0:23327:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666914176 00000100:00100000:0.0:1789136292.746392:0:23327:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666914176 00000100:00100000:0.0:1789136292.746445:0:23327:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1789136292.746453:0:23327:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7fb156850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b11da215-324d-4c8d-90a5-0b7f26186c4c+20:24840:x1876044666914176:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789136292.746555:0:23327:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7fb156850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b11da215-324d-4c8d-90a5-0b7f26186c4c+20:24840:x1876044666914176:12345-0@lo:502:mount.lustre.0 Request processed in 103us (317us total) trans 0 rc 0/0 00000100:00100000:0.0:1789136292.746562:0:23327:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1789136292.746691:0:24840:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7f662ed00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b11da215-324d-4c8d-90a5-0b7f26186c4c:24840:1876044666914176:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1789136292.746730:0:24840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].18, 224 off11648 00000040:00080000:1.0:1789136292.746738:0:24840:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 18 count 19 00000020:01000000:1.0:1789136292.747903:0:24861:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789136292.747913:0:24861:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789136292.747915:0:24861:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:1.0:1789136292.747921:0:24861:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff90a7ff56c800 00000020:00000080:1.0:1789136292.747924:0:24861:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1789136292.747931:0:24861:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789136292.747933:0:24861:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789136292.747935:0:24861:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:1.0:1789136292.747937:0:24861:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789136292.747939:0:24861:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789136292.747941:0:24861:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:1.0:1789136292.747944:0:24861:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff90a7ff56c800 00000020:00000080:1.0:1789136292.747946:0:24861:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1789136292.747997:0:24861:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789136292.748000:0:24861:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789136292.748001:0:24861:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:1.0:1789136292.748004:0:24861:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789136292.748015:0:24861:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789136292.748016:0:24861:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre lod.lustre-MDT0000-mdtlov.enable_compr_rotational 00000020:01000000:1.0:1789136292.748020:0:24861:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff90a7ff56c800 00000020:00000080:1.0:1789136292.748022:0:24861:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1789136292.748037:0:24861:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789136292.748040:0:24861:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789136292.748041:0:24861:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre lod.lustre-MDT0000-mdtlov.enable_compr_rotational 00000020:01000000:1.0:1789136292.748043:0:24861:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789136292.748045:0:24861:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789136292.748046:0:24861:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre lod.lustre-MDT0001-mdtlov.enable_compr_rotational 00000020:01000000:1.0:1789136292.748049:0:24861:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff90a7ff56c800 00000020:00000080:1.0:1789136292.748051:0:24861:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1789136292.748062:0:24861:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789136292.748064:0:24861:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789136292.748066:0:24861:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre lod.lustre-MDT0001-mdtlov.enable_compr_rotational 00000020:01000000:1.0:1789136292.748068:0:24861:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789136292.748070:0:24861:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789136292.748071:0:24861:0:(obd_config.c:1563:class_process_config()) marker 6 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1789136292.748074:0:24861:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff90a7ff56c800 00000020:00000080:1.0:1789136292.748076:0:24861:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1789136292.748088:0:24861:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789136292.748090:0:24861:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789136292.748091:0:24861:0:(obd_config.c:1563:class_process_config()) marker 6 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1789136292.748094:0:24861:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789136292.748096:0:24861:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789136292.748097:0:24861:0:(obd_config.c:1563:class_process_config()) marker 7 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:1.0:1789136292.748102:0:24861:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff90a7ff56c800 00000020:00000080:1.0:1789136292.748104:0:24861:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1789136292.748121:0:24861:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789136292.748124:0:24861:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789136292.748125:0:24861:0:(obd_config.c:1563:class_process_config()) marker 7 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:1.0:1789136292.748128:0:24861:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xe:0x0] index 19 count 19 00000020:01000000:2.0:1789136292.748267:0:24840:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-18 (rc=0) 10000000:01000000:2.0:1789136292.748292:0:24840:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.131@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1789136292.748321:0:24840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.131@tcp lock: ffff90a7c167ce00/0x559c8745c6de465c lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x559c8745c6de4663 expref: -99 pid: 24840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136292.748332:0:24840:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.131@tcp lock: ffff90a7c167ce00/0x559c8745c6de465c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x559c8745c6de4663 expref: -99 pid: 24840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789136292.748389:0:24840:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1789136292.748392:0:24840:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff90a7ff56c800 10000000:01000000:2.0:1789136292.748394:0:24840:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff90a7ff56c800 10000000:01000000:2.0:1789136292.748399:0:24840:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1789136292.748405:0:24840:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff90a7ff56c800 from 1 10000000:01000000:2.0:1789136292.748407:0:24840:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1789136292.748457:0:24840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.131@tcp lock: ffff90a7d1878c00/0x559c8745c6de466a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 24840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136292.748470:0:24840:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.131@tcp lock: ffff90a7d1878c00/0x559c8745c6de466a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 24840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136292.748482:0:24840:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.131@tcp lock: ffff90a7d1878c00/0x559c8745c6de466a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 24840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789136292.748500:0:24840:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7c14b6940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b11da215-324d-4c8d-90a5-0b7f26186c4c:24840:1876044666914304:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1789136292.748553:0:24840:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789136292.748600:0:24840:0:(client.c:2715:ptlrpc_set_wait()) set ffff90a7c166ae40 going to sleep for 11 seconds 00000100:00100000:2.0:1789136292.749565:0:23324:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666914304 00000100:00100000:2.0:1789136292.749573:0:23324:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666914304 00000100:00100000:2.0:1789136292.749641:0:23324:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1789136292.749649:0:23324:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7fb156050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b11da215-324d-4c8d-90a5-0b7f26186c4c+20:24840:x1876044666914304:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789136292.749663:0:23324:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789136292.749676:0:23324:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90a7d1879200/0x559c8745c6de4671 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x559c8745c6de466a expref: -99 pid: 23324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136292.749699:0:23324:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90a7d1879200/0x559c8745c6de4671 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x559c8745c6de466a expref: 21 pid: 23324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136292.749710:0:23324:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90a7d1879200/0x559c8745c6de4671 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x559c8745c6de466a expref: 21 pid: 23324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136292.749719:0:23324:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a7d1879200, rc 0) 00000100:00100000:2.0:1789136292.749769:0:23324:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7fb156050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b11da215-324d-4c8d-90a5-0b7f26186c4c+21:24840:x1876044666914304:12345-0@lo:101:mount.lustre.0 Request processed in 120us (1215us total) trans 0 rc 0/0 00000100:00100000:2.0:1789136292.749776:0:23324:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1789136292.749842:0:24840:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7c14b6940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b11da215-324d-4c8d-90a5-0b7f26186c4c:24840:1876044666914304:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789136292.749874:0:24840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.131@tcp lock: ffff90a7d1878c00/0x559c8745c6de466a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x559c8745c6de4671 expref: -99 pid: 24840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136292.749884:0:24840:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.131@tcp lock: ffff90a7d1878c00/0x559c8745c6de466a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x559c8745c6de4671 expref: -99 pid: 24840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1789136292.765476:0:24840:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 52 count 51 00000040:00080000:3.0:1789136292.765777:0:24840:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1789136292.765997:0:24840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].1, 224 off8416 00000040:00080000:3.0:1789136292.766037:0:24840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].2, 120 off8536 00000040:00080000:3.0:1789136292.766055:0:24840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].3, 168 off8704 00000040:00080000:3.0:1789136292.766071:0:24840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].4, 224 off8928 00000040:00080000:3.0:1789136292.766085:0:24840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].5, 224 off9152 00000040:00080000:3.0:1789136292.766100:0:24840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].6, 120 off9272 00000040:00080000:3.0:1789136292.766123:0:24840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].7, 168 off9440 00000040:00080000:3.0:1789136292.766135:0:24840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].8, 224 off9664 00000040:00080000:3.0:1789136292.766148:0:24840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].9, 224 off9888 00000040:00080000:3.0:1789136292.766161:0:24840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].10, 120 off10008 00000040:00080000:3.0:1789136292.766176:0:24840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].11, 224 off10232 00000040:00080000:3.0:1789136292.766190:0:24840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].12, 224 off10456 00000040:00080000:3.0:1789136292.766217:0:24840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].13, 88 off10544 00000040:00080000:3.0:1789136292.766232:0:24840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].14, 128 off10672 00000040:00080000:3.0:1789136292.766244:0:24840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].15, 144 off10816 00000040:00080000:3.0:1789136292.766256:0:24840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].16, 160 off10976 00000040:00080000:3.0:1789136292.766269:0:24840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].17, 224 off11200 00000040:00080000:3.0:1789136292.766303:0:24840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].18, 224 off11424 00000040:00080000:3.0:1789136292.766316:0:24840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].19, 80 off11504 00000040:00080000:3.0:1789136292.766329:0:24840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].20, 224 off11728 00000040:00080000:3.0:1789136292.766340:0:24840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].21, 224 off11952 00000040:00080000:3.0:1789136292.766352:0:24840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].22, 88 off12040 00000040:00080000:3.0:1789136292.766364:0:24840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].23, 128 off12168 00000040:00080000:3.0:1789136292.766376:0:24840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].24, 144 off12312 00000040:00080000:3.0:1789136292.766387:0:24840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].25, 160 off12472 00000040:00080000:3.0:1789136292.766398:0:24840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].26, 224 off12696 00000040:00080000:3.0:1789136292.766408:0:24840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].27, 224 off12920 00000040:00080000:3.0:1789136292.766419:0:24840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].28, 80 off13000 00000040:00080000:3.0:1789136292.766430:0:24840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].29, 224 off13224 00000040:00080000:3.0:1789136292.766440:0:24840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].30, 224 off13448 00000040:00080000:3.0:1789136292.766451:0:24840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].31, 88 off13536 00000040:00080000:3.0:1789136292.766462:0:24840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].32, 128 off13664 00000040:00080000:3.0:1789136292.766473:0:24840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].33, 144 off13808 00000040:00080000:3.0:1789136292.766495:0:24840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].34, 128 off13936 00000040:00080000:3.0:1789136292.766507:0:24840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].35, 224 off14160 00000040:00080000:3.0:1789136292.766518:0:24840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].36, 224 off14384 00000040:00080000:3.0:1789136292.766529:0:24840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].37, 80 off14464 00000040:00080000:3.0:1789136292.766540:0:24840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].38, 224 off14688 00000040:00080000:3.0:1789136292.766551:0:24840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].39, 224 off14912 00000040:00080000:3.0:1789136292.766569:0:24840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].40, 88 off15000 00000040:00080000:3.0:1789136292.766580:0:24840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].41, 128 off15128 00000040:00080000:3.0:1789136292.766591:0:24840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].42, 144 off15272 00000040:00080000:3.0:1789136292.766602:0:24840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].43, 128 off15400 00000040:00080000:3.0:1789136292.766612:0:24840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].44, 224 off15624 00000040:00080000:3.0:1789136292.766623:0:24840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].45, 224 off15848 00000040:00080000:3.0:1789136292.766634:0:24840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].46, 80 off15928 00000040:00080000:3.0:1789136292.766644:0:24840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].47, 224 off16152 00000040:00080000:3.0:1789136292.766656:0:24840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].48, 232 off16384 00000040:00080000:3.0:1789136292.766763:0:24840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].49, 224 off16608 00000040:00080000:3.0:1789136292.766781:0:24840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].50, 120 off16728 00000040:00080000:3.0:1789136292.766796:0:24840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].51, 224 off16952 00000040:00080000:3.0:1789136292.766800:0:24840:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 51 count 51 00000100:00100000:3.0:1789136292.766908:0:24840:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7ff648f00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b11da215-324d-4c8d-90a5-0b7f26186c4c:24840:1876044666914432:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789136292.766972:0:24840:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789136292.767020:0:24840:0:(client.c:2715:ptlrpc_set_wait()) set ffff90a7fa54a780 going to sleep for 11 seconds 00000100:00100000:1.0:1789136292.767264:0:23325:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666914432 00000100:00100000:1.0:1789136292.767278:0:23325:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666914432 00000100:00100000:1.0:1789136292.767332:0:23325:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1789136292.767340:0:23325:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7fb157050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b11da215-324d-4c8d-90a5-0b7f26186c4c+21:24840:x1876044666914432:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789136292.767455:0:23325:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7fb157050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b11da215-324d-4c8d-90a5-0b7f26186c4c+21:24840:x1876044666914432:12345-0@lo:501:mount.lustre.0 Request processed in 115us (483us total) trans 0 rc 0/0 00000100:00100000:1.0:1789136292.767462:0:23325:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1789136292.772591:0:24840:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7ff648f00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b11da215-324d-4c8d-90a5-0b7f26186c4c:24840:1876044666914432:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789136292.772649:0:24840:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7ff648f00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b11da215-324d-4c8d-90a5-0b7f26186c4c:24840:1876044666914560:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1789136292.772718:0:24840:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789136292.772757:0:24840:0:(client.c:2715:ptlrpc_set_wait()) set ffff90a7fa54a780 going to sleep for 11 seconds 00000100:00100000:1.0:1789136292.772995:0:23327:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666914560 00000100:00100000:1.0:1789136292.773002:0:23327:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666914560 00000100:00100000:1.0:1789136292.773055:0:23327:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1789136292.773064:0:23327:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7fb157850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b11da215-324d-4c8d-90a5-0b7f26186c4c+21:24840:x1876044666914560:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1789136292.773292:0:23327:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7fb157850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b11da215-324d-4c8d-90a5-0b7f26186c4c+21:24840:x1876044666914560:12345-0@lo:503:mount.lustre.0 Request processed in 227us (573us total) trans 0 rc 0/0 00000100:00100000:1.0:1789136292.773300:0:23327:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:3.0:1789136292.774475:0:24840:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7ff648f00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b11da215-324d-4c8d-90a5-0b7f26186c4c:24840:1876044666914560:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1789136292.774972:0:24840:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1789136292.775050:0:24840:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7ff648f00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b11da215-324d-4c8d-90a5-0b7f26186c4c:24840:1876044666914688:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789136292.775107:0:24840:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789136292.775154:0:24840:0:(client.c:2715:ptlrpc_set_wait()) set ffff90a7fa54aa80 going to sleep for 11 seconds 00000100:00100000:0.0:1789136292.775276:0:23324:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666914688 00000100:00100000:0.0:1789136292.775292:0:23324:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666914688 00000100:00100000:0.0:1789136292.775650:0:23324:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:0.0:1789136292.775661:0:23324:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7fb158c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b11da215-324d-4c8d-90a5-0b7f26186c4c+21:24840:x1876044666914688:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789136292.775784:0:23324:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7fb158c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b11da215-324d-4c8d-90a5-0b7f26186c4c+21:24840:x1876044666914688:12345-0@lo:502:mount.lustre.0 Request processed in 124us (676us total) trans 0 rc 0/0 00000100:00100000:0.0:1789136292.775792:0:23324:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:2.0:1789136292.777640:0:24840:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7ff648f00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b11da215-324d-4c8d-90a5-0b7f26186c4c:24840:1876044666914688:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1789136292.777885:0:24840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].1, 224 off8416 00000040:00080000:2.0:1789136292.777914:0:24840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].2, 120 off8536 00000040:00080000:2.0:1789136292.777929:0:24840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].3, 168 off8704 00000040:00080000:2.0:1789136292.777942:0:24840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].4, 224 off8928 00000040:00080000:2.0:1789136292.777954:0:24840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].5, 224 off9152 00000040:00080000:2.0:1789136292.777966:0:24840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].6, 120 off9272 00000040:00080000:2.0:1789136292.777978:0:24840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].7, 168 off9440 00000040:00080000:2.0:1789136292.777990:0:24840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].8, 224 off9664 00000040:00080000:2.0:1789136292.778003:0:24840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].9, 224 off9888 00000040:00080000:2.0:1789136292.778015:0:24840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].10, 120 off10008 00000040:00080000:2.0:1789136292.778028:0:24840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].11, 224 off10232 00000040:00080000:2.0:1789136292.778041:0:24840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].12, 224 off10456 00000040:00080000:2.0:1789136292.778053:0:24840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].13, 88 off10544 00000040:00080000:2.0:1789136292.778066:0:24840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].14, 128 off10672 00000040:00080000:2.0:1789136292.778077:0:24840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].15, 144 off10816 00000040:00080000:2.0:1789136292.778088:0:24840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].16, 160 off10976 00000040:00080000:2.0:1789136292.778115:0:24840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].17, 224 off11200 00000040:00080000:2.0:1789136292.778130:0:24840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].18, 224 off11424 00000040:00080000:2.0:1789136292.778144:0:24840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].19, 80 off11504 00000040:00080000:2.0:1789136292.778158:0:24840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].20, 224 off11728 00000040:00080000:2.0:1789136292.778171:0:24840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].21, 224 off11952 00000040:00080000:2.0:1789136292.778185:0:24840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].22, 88 off12040 00000040:00080000:2.0:1789136292.778220:0:24840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].23, 128 off12168 00000040:00080000:2.0:1789136292.778235:0:24840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].24, 144 off12312 00000040:00080000:2.0:1789136292.778247:0:24840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].25, 160 off12472 00000040:00080000:2.0:1789136292.778259:0:24840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].26, 224 off12696 00000040:00080000:2.0:1789136292.778273:0:24840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].27, 224 off12920 00000040:00080000:2.0:1789136292.778288:0:24840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].28, 80 off13000 00000040:00080000:2.0:1789136292.778302:0:24840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].29, 224 off13224 00000040:00080000:2.0:1789136292.778314:0:24840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].30, 224 off13448 00000040:00080000:2.0:1789136292.778327:0:24840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].31, 88 off13536 00000040:00080000:2.0:1789136292.778341:0:24840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].32, 128 off13664 00000040:00080000:2.0:1789136292.778368:0:24840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].33, 144 off13808 00000040:00080000:2.0:1789136292.778383:0:24840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].34, 128 off13936 00000040:00080000:2.0:1789136292.778396:0:24840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].35, 224 off14160 00000040:00080000:2.0:1789136292.778409:0:24840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].36, 224 off14384 00000040:00080000:2.0:1789136292.778421:0:24840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].37, 80 off14464 00000040:00080000:2.0:1789136292.778519:0:24840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].38, 224 off14688 00000040:00080000:2.0:1789136292.778539:0:24840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].39, 224 off14912 00000040:00080000:2.0:1789136292.778552:0:24840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].40, 88 off15000 00000040:00080000:2.0:1789136292.778566:0:24840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].41, 128 off15128 00000040:00080000:2.0:1789136292.778580:0:24840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].42, 144 off15272 00000040:00080000:2.0:1789136292.778592:0:24840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].43, 128 off15400 00000040:00080000:2.0:1789136292.778604:0:24840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].44, 224 off15624 00000040:00080000:2.0:1789136292.778617:0:24840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].45, 224 off15848 00000040:00080000:2.0:1789136292.778631:0:24840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].46, 80 off15928 00000040:00080000:2.0:1789136292.778645:0:24840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].47, 224 off16152 00000040:00080000:2.0:1789136292.778658:0:24840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].48, 232 off16384 00000100:00100000:2.0:1789136292.778722:0:24840:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7c14b6940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b11da215-324d-4c8d-90a5-0b7f26186c4c:24840:1876044666914816:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789136292.778792:0:24840:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789136292.778838:0:24840:0:(client.c:2715:ptlrpc_set_wait()) set ffff90a7c511e840 going to sleep for 11 seconds 00000100:00100000:2.0:1789136292.778910:0:23325:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666914816 00000100:00100000:2.0:1789136292.778916:0:23325:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666914816 00000100:00100000:2.0:1789136292.778964:0:23325:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:2.0:1789136292.778979:0:23325:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7fb158450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b11da215-324d-4c8d-90a5-0b7f26186c4c+21:24840:x1876044666914816:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789136292.779086:0:23325:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7fb158450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b11da215-324d-4c8d-90a5-0b7f26186c4c+21:24840:x1876044666914816:12345-0@lo:502:mount.lustre.0 Request processed in 107us (293us total) trans 0 rc 0/0 00000100:00100000:2.0:1789136292.779093:0:23325:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:2.0:1789136292.779158:0:24840:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7c14b6940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b11da215-324d-4c8d-90a5-0b7f26186c4c:24840:1876044666914816:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1789136292.779299:0:24840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].49, 224 off16608 00000040:00080000:2.0:1789136292.779319:0:24840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].50, 120 off16728 00000100:00100000:2.0:1789136292.779340:0:24840:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7c14b6940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b11da215-324d-4c8d-90a5-0b7f26186c4c:24840:1876044666914944:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789136292.779376:0:24840:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789136292.779391:0:24840:0:(client.c:2715:ptlrpc_set_wait()) set ffff90a7c511e840 going to sleep for 11 seconds 00000100:00100000:0.0:1789136292.782669:0:23324:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666914944 00000100:00100000:0.0:1789136292.782683:0:23324:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666914944 00000100:00100000:0.0:1789136292.782751:0:23324:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:0.0:1789136292.782762:0:23324:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7fb15b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b11da215-324d-4c8d-90a5-0b7f26186c4c+21:24840:x1876044666914944:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789136292.782962:0:23324:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7fb15b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b11da215-324d-4c8d-90a5-0b7f26186c4c+21:24840:x1876044666914944:12345-0@lo:502:mount.lustre.0 Request processed in 202us (3585us total) trans 0 rc 0/0 00000100:00100000:0.0:1789136292.782971:0:23324:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:3.0:1789136292.783032:0:24840:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7c14b6940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b11da215-324d-4c8d-90a5-0b7f26186c4c:24840:1876044666914944:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1789136292.783115:0:24840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].51, 224 off16952 00000040:00080000:3.0:1789136292.783135:0:24840:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 51 count 51 00000020:01000004:2.0:1789136292.784181:0:24866:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:2.0:1789136292.784196:0:24866:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff90a6c470ced8) 00000020:00000080:2.0:1789136292.784231:0:24866:0:(obd_config.c:720:class_attach_name()) OBD: dev 23 attached type lwp with refcount 2 00000020:01000004:2.0:1789136292.784418:0:24866:0:(tgt_mount.c:153:server_get_mount()) get mount ffff90a7ff56c800 from lustre-OST0000, refs=3 00000020:01000004:2.0:1789136292.784423:0:24866:0:(tgt_mount.c:187:server_put_mount()) put mount ffff90a7ff56c800 from lustre-OST0000, refs=3 00000020:01000004:2.0:1789136292.784425:0:24866:0:(obd_mount.c:710:lustre_put_lsi()) put ffff90a7ff56c800 3 00010000:00080000:2.0:1789136292.784528:0:24866:0:(ldlm_lib.c:102:import_set_conn()) imp ffff90a6c2d43800@lustre-MDT0000-lwp-OST0000: add connection 192.168.201.131@tcp at head 00010000:00010000:2.0:1789136292.790282:0:24866:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-9 is initialized 00000020:00000080:2.0:1789136292.792687:0:24866:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:2.0:1789136292.792735:0:24866:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1789136292.792748:0:24866:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0x559c8745c6de467f 00000100:00080000:2.0:1789136292.792759:0:24866:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1789136292.792765:0:24866:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff90a6c2d43800 using connection 192.168.201.131@tcp/0@lo 00000100:00100000:2.0:1789136292.792799:0:24866:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff90a7c14b6940 x1876044666915072/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1789136292.792823:0:24866:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00080000:1.0:1789136292.792903:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789136292.792908:0:487:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1789136292.792911:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789136292.792914:0:487:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1789136292.792936:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789136292.792940:0:487:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1789136292.792942:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789136292.792946:0:487:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1789136292.792978:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7f662ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1876044666915200:0@lo:400:kworker.0 00000100:00100000:1.0:1789136292.793044:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789136292.793088:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789136292.793094:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7f662d2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3638:1876044666915328:0@lo:400:kworker.0 00000100:00100000:1.0:1789136292.793120:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789136292.793155:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7f662cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1876044666915456:0@lo:400:kworker.0 00000100:00100000:1.0:1789136292.793178:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789136292.793908:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7f662d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3641:1876044666915584:0@lo:400:kworker.0 00000100:00100000:1.0:1789136292.793928:0:23334:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666915328 00000100:00100000:1.0:1789136292.793935:0:23334:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666915328 00000100:00100000:2.0:1789136292.793950:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789136292.794260:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7c14b6940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3637:1876044666915072:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1789136292.794419:0:23339:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666915200 00000100:00100000:3.0:1789136292.794424:0:23339:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666915200 00000100:00100000:3.0:1789136292.794461:0:23339:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666915456 00000100:00100000:3.0:1789136292.794464:0:23339:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666915456 00000100:00100000:3.0:1789136292.794479:0:23339:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1789136292.794486:0:23339:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7f662e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3638:x1876044666915200:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789136292.794539:0:23339:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7f662e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3638:x1876044666915200:12345-0@lo:400:kworker.0 Request processed in 53us (1494us total) trans 0 rc 0/0 00000100:00100000:3.0:1789136292.794546:0:23339:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1789136292.794560:0:23339:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1789136292.794566:0:23339:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7f662e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3640:x1876044666915456:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789136292.794593:0:23339:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7f662e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3640:x1876044666915456:12345-0@lo:400:kworker.0 Request processed in 28us (1414us total) trans 0 rc 0/0 00000100:00100000:3.0:1789136292.794599:0:23339:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1789136292.794639:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7f662cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1876044666915456:0@lo:400:kworker.0 00000100:00100000:3.0:1789136292.794663:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7f662ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1876044666915200:0@lo:400:kworker.0 00000100:00100000:1.0:1789136292.796913:0:23334:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666915584 00000100:00100000:1.0:1789136292.796924:0:23334:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666915584 00000100:00100000:1.0:1789136292.796959:0:23334:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1789136292.796968:0:23334:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7f662f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1876044666915328:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789136292.798345:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:01000004:2.0:1789136292.798799:0:24866:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-lwp-OST0000 (typ=lwp) 00000020:00000080:2.0:1789136292.798835:0:24866:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-lwp-OST0000 (ffff90a6c3dd8000) 00000100:00100000:1.0:1789136292.798868:0:23334:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7f662f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1876044666915328:12345-0@lo:400:kworker.0 Request processed in 1888us (5733us total) trans 0 rc 0/0 00000020:00000080:2.0:1789136292.798878:0:24866:0:(obd_config.c:720:class_attach_name()) OBD: dev 24 attached type lwp with refcount 2 00000100:00100000:1.0:1789136292.798879:0:23334:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1789136292.798913:0:23334:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666915072 00000100:00100000:1.0:1789136292.798919:0:23334:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666915072 00000100:00100000:1.0:1789136292.798934:0:23334:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1789136292.798943:0:23334:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7c14b7c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1876044666915584:12345-0@lo:400:kworker.0 00000020:01000004:2.0:1789136292.798958:0:24866:0:(tgt_mount.c:153:server_get_mount()) get mount ffff90a7ff56c800 from lustre-OST0000, refs=3 00000020:01000004:2.0:1789136292.798961:0:24866:0:(tgt_mount.c:187:server_put_mount()) put mount ffff90a7ff56c800 from lustre-OST0000, refs=3 00000020:01000004:2.0:1789136292.798964:0:24866:0:(obd_mount.c:710:lustre_put_lsi()) put ffff90a7ff56c800 3 00000100:00100000:1.0:1789136292.798986:0:23334:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7c14b7c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1876044666915584:12345-0@lo:400:kworker.0 Request processed in 47us (5036us total) trans 0 rc 0/0 00010000:00080000:2.0:1789136292.798990:0:24866:0:(ldlm_lib.c:102:import_set_conn()) imp ffff90a6c2d47000@lustre-MDT0001-lwp-OST0000: add connection 192.168.201.131@tcp at head 00000100:00100000:1.0:1789136292.798993:0:23334:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1789136292.799005:0:23334:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1789136292.799009:0:23334:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7ff64a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3637:x1876044666915072:12345-0@lo:38:llog_process_th.0 00010000:00080000:1.0:1789136292.799028:0:23334:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 740 last 0 00000020:00000080:1.0:1789136292.799054:0:23334:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0x559c8745c6de468d 00000004:00100000:1.0:1789136292.799069:0:23334:0:(mdt_handler.c:7306:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1789136292.799096:0:23334:0:(import.c:65:import_set_state_nolock()) ffff90a7ff596800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789136292.799139:0:23334:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7ff64a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3637:x1876044666915072:12345-0@lo:38:llog_process_th.0 Request processed in 128us (797us total) trans 0 rc 0/0 00000100:00100000:1.0:1789136292.799145:0:23334:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:1.0:1789136292.800464:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff90a7f662d2c0 x1876044666915328/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789136308 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789136292.800482:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7f662d2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3638:1876044666915328:0@lo:400:kworker.0 00010000:00080000:2.0:1789136292.800492:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff90a7f662d680 x1876044666915584/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789136308 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789136292.800502:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7f662d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3641:1876044666915584:0@lo:400:kworker.0 00010000:00080000:1.0:1789136292.800535:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff90a7c14b6940 x1876044666915072/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789136302 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789136292.800543:0:3637:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1789136292.800551:0:3637:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 3 00000100:00080000:1.0:1789136292.800558:0:3637:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:1.0:1789136292.800562:0:3637:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1789136292.800564:0:3637:0:(import.c:65:import_set_state_nolock()) ffff90a6c2d43800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1789136292.800570:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7c14b6940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3637:1876044666915072:0@lo:38:llog_process_th.0 00010000:00010000:2.0:1789136292.808980:0:24866:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-lwp-OST0000-10 is initialized 00000020:00000080:2.0:1789136292.809162:0:24866:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-lwp-OST0000 (uuid lustre-MDT0001-lwp-OST0000_UUID) 00000010:01000000:2.0:1789136292.809215:0:24866:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1789136292.809229:0:24866:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0000, cookie 0x559c8745c6de4694 00000100:00080000:2.0:1789136292.809238:0:24866:0:(import.c:510:import_select_connection()) lustre-MDT0001-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1789136292.809244:0:24866:0:(import.c:624:import_select_connection()) lustre-MDT0001-lwp-OST0000: import ffff90a6c2d47000 using connection 192.168.201.131@tcp/0@lo 00000100:00100000:2.0:1789136292.809277:0:24866:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff90a7c14b6940 x1876044666915712/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1789136292.809296:0:24866:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID 00000100:00080000:1.0:1789136292.809587:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789136292.809593:0:487:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1789136292.809596:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789136292.809599:0:487:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1789136292.809603:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789136292.809606:0:487:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1789136292.809609:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789136292.809612:0:487:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1789136292.809636:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7c14b6940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3637:1876044666915712:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1789136292.809719:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789136292.810050:0:23334:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666915712 00000100:00100000:1.0:1789136292.810058:0:23334:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666915712 00000100:00100000:1.0:1789136292.810093:0:23334:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1789136292.810100:0:23334:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7f662d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3637:x1876044666915712:12345-0@lo:38:llog_process_th.0 00010000:00080000:1.0:1789136292.810128:0:23334:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0001-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 740 last 0 00000020:00000080:1.0:1789136292.810167:0:23334:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0000_UUID, cookie 0x559c8745c6de469b 00000004:00100000:1.0:1789136292.810181:0:23334:0:(mdt_handler.c:7306:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1789136292.810225:0:23334:0:(import.c:65:import_set_state_nolock()) ffff90a7ff591800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789136292.810272:0:23334:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7f662d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3637:x1876044666915712:12345-0@lo:38:llog_process_th.0 Request processed in 171us (553us total) trans 0 rc 0/0 00000100:00100000:1.0:1789136292.810279:0:23334:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:1.0:1789136292.810316:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff90a7c14b6940 x1876044666915712/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789136302 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789136292.810326:0:3637:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1789136292.810334:0:3637:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0001-lwp-OST0000: connect to target with instance 3 00000100:00080000:1.0:1789136292.810342:0:3637:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0001-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:1.0:1789136292.810345:0:3637:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:1.0:1789136292.810348:0:3637:0:(import.c:65:import_set_state_nolock()) ffff90a6c2d47000 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1789136292.810354:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7c14b6940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3637:1876044666915712:0@lo:38:llog_process_th.0 00000040:00080000:3.0:1789136292.815125:0:24866:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x10:0x0] index 52 count 51 00000020:01000000:0.0:1789136292.816326:0:24840:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:0.0:1789136292.816380:0:24840:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.131@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1789136292.816407:0:24840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.131@tcp lock: ffff90a7d1878c00/0x559c8745c6de466a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x559c8745c6de4671 expref: -99 pid: 24840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136292.816419:0:24840:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.131@tcp lock: ffff90a7d1878c00/0x559c8745c6de466a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x559c8745c6de4671 expref: -99 pid: 24840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1789136292.816469:0:24840:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1789136292.816472:0:24840:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1789136292.816473:0:24840:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789136292.816474:0:24840:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789136292.816475:0:24840:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789136292.816476:0:24840:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789136292.816477:0:24840:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1789136292.816479:0:24840:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789136292.816480:0:24840:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1789136292.816484:0:24840:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020002 00000020:01000004:0.0:1789136292.816487:0:24840:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1789136292.816488:0:24840:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1789136292.816489:0:24840:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789136292.816490:0:24840:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789136292.816491:0:24840:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789136292.816492:0:24840:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789136292.816493:0:24840:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1789136292.816494:0:24840:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789136292.816495:0:24840:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1789136292.816522:0:24840:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:0.0:1789136292.816541:0:24840:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7fa3be1c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b11da215-324d-4c8d-90a5-0b7f26186c4c:24840:1876044666915840:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1789136292.816613:0:24840:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789136292.816667:0:24840:0:(client.c:2715:ptlrpc_set_wait()) set ffff90a7d884f540 going to sleep for 11 seconds 00000100:00100000:3.0:1789136292.817556:0:23325:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666915840 00000100:00100000:3.0:1789136292.817565:0:23325:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666915840 00000100:00100000:3.0:1789136292.817609:0:23325:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:3.0:1789136292.817618:0:23325:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7fb158850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b11da215-324d-4c8d-90a5-0b7f26186c4c+21:24840:x1876044666915840:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1789136292.817647:0:23325:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:3.0:1789136292.817660:0:23325:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:3.0:1789136292.827769:0:23325:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1789136292.827791:0:23325:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:2.0:1789136292.827919:0:23349:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1789136292.827924:0:23349:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1789136292.827946:0:23349:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff90a7d1879c00/0x559c8745c6de46a2 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 23349 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136292.827965:0:23349:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90a7e1c9e800/0x559c8745c6de45ec lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x559c8745c6de45e5 expref: 21 pid: 23325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136292.827985:0:23349:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90a7c167ca00/0x559c8745c6de45fa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x559c8745c6de45f3 expref: 21 pid: 23324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136292.827992:0:23349:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff90a7d1879c00/0x559c8745c6de46a2 lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 23349 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136292.828029:0:23349:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90a7c167ca00/0x559c8745c6de45fa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x559c8745c6de45f3 expref: 21 pid: 23324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136292.828043:0:23349:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff90a7c167ca00/0x559c8745c6de45fa lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x559c8745c6de45f3 expref: 21 pid: 23324 timeout: 840 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789136292.828057:0:23349:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7c14b6940 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:23349:1876044666915968:0@lo:104: 00000100:00100000:2.0:1789136292.828128:0:23349:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1789136292.828190:0:23349:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90a7e1c9e800/0x559c8745c6de45ec lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x559c8745c6de45e5 expref: 21 pid: 23325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136292.828208:0:23349:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff90a7e1c9e800/0x559c8745c6de45ec lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x559c8745c6de45e5 expref: 21 pid: 23325 timeout: 840 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789136292.828216:0:23349:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c4762940 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:23349:1876044666916096:0@lo:104: 00000100:00100000:2.0:1789136292.828244:0:23349:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789136292.828260:0:23349:0:(client.c:2715:ptlrpc_set_wait()) set ffff90a7c511ea80 going to sleep for 11 seconds 00000100:00100000:2.0:1789136292.828284:0:23315:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:2.0:1789136292.828299:0:23315:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666915968 00000100:00100000:2.0:1789136292.828305:0:23315:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666915968 00000100:00100000:2.0:1789136292.828336:0:23315:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666916096 00000100:00100000:2.0:1789136292.828339:0:23315:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666916096 00000100:00100000:2.0:1789136292.828353:0:23315:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1789136292.828367:0:23315:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c4763840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:b11da215-324d-4c8d-90a5-0b7f26186c4c+4:23349:x1876044666915968:12345-0@lo:104: 00010000:00010000:2.0:1789136292.828380:0:23315:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.131@tcp lock: ffff90a7e1c9e600/0x559c8745c6de45f3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x559c8745c6de45fa expref: -99 pid: 23329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136292.828438:0:23315:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1789136292.828444:0:23315:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c4763840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:b11da215-324d-4c8d-90a5-0b7f26186c4c+4:23349:x1876044666915968:12345-0@lo:104: Request processed in 79us (317us total) trans 0 rc 0/0 00000100:00100000:2.0:1789136292.828452:0:23315:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1789136292.828469:0:23315:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1789136292.828475:0:23315:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7f665a450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:b11da215-324d-4c8d-90a5-0b7f26186c4c+3:23349:x1876044666916096:12345-0@lo:104: 00010000:00010000:2.0:1789136292.828482:0:23315:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.131@tcp lock: ffff90a7c167c800/0x559c8745c6de45e5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x559c8745c6de45ec expref: -99 pid: 23329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136292.828513:0:23315:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1789136292.828519:0:23315:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7f665a450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:b11da215-324d-4c8d-90a5-0b7f26186c4c+3:23349:x1876044666916096:12345-0@lo:104: Request processed in 45us (274us total) trans 0 rc 0/0 00000100:00100000:2.0:1789136292.828525:0:23315:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00010000:2.0:1789136292.828558:0:23321:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1789136292.828564:0:23321:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.131@tcp lock: ffff90a7e1c9e600/0x559c8745c6de45f3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x559c8745c6de45fa expref: -99 pid: 23329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136292.828571:0:23321:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a7e1c9e600 already unused, calling callback (ffffffffc13bbc20) 10000000:00010000:2.0:1789136292.828575:0:23321:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.131@tcp lock: ffff90a7e1c9e600/0x559c8745c6de45f3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x559c8745c6de45fa expref: -99 pid: 23329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136292.828583:0:23321:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.131@tcp lock: ffff90a7e1c9e600/0x559c8745c6de45f3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x559c8745c6de45fa expref: -99 pid: 23329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789136292.828591:0:23321:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.131@tcp lock: ffff90a7e1c9e600/0x559c8745c6de45f3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x559c8745c6de45fa expref: -99 pid: 23329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789136292.828602:0:23321:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1789136292.828626:0:23321:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.131@tcp lock: ffff90a7e1c9e600/0x559c8745c6de45f3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x559c8745c6de45fa expref: -99 pid: 23329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136292.828633:0:23321:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789136292.828651:0:23321:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.131@tcp lock: ffff90a7e1c9e600/0x559c8745c6de45f3 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x559c8745c6de45fa expref: -99 pid: 23329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136292.828658:0:23321:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.131@tcp lock: ffff90a7e1c9e600/0x559c8745c6de45f3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x559c8745c6de45fa expref: -99 pid: 23329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136292.828669:0:23321:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789136292.828672:0:23321:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.131@tcp lock: ffff90a7c167c800/0x559c8745c6de45e5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x559c8745c6de45ec expref: -99 pid: 23329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136292.828678:0:23321:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a7c167c800 already unused, calling callback (ffffffffc13bbc20) 10000000:00010000:2.0:1789136292.828681:0:23321:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.131@tcp lock: ffff90a7c167c800/0x559c8745c6de45e5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x559c8745c6de45ec expref: -99 pid: 23329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136292.828687:0:23321:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.131@tcp lock: ffff90a7c167c800/0x559c8745c6de45e5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x559c8745c6de45ec expref: -99 pid: 23329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789136292.828693:0:23321:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.131@tcp lock: ffff90a7c167c800/0x559c8745c6de45e5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x559c8745c6de45ec expref: -99 pid: 23329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789136292.828698:0:23321:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1789136292.828710:0:23321:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.131@tcp lock: ffff90a7c167c800/0x559c8745c6de45e5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x559c8745c6de45ec expref: -99 pid: 23329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136292.828716:0:23321:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789136292.828727:0:23321:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.131@tcp lock: ffff90a7c167c800/0x559c8745c6de45e5 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x559c8745c6de45ec expref: -99 pid: 23329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136292.828733:0:23321:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.131@tcp lock: ffff90a7c167c800/0x559c8745c6de45e5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x559c8745c6de45ec expref: -99 pid: 23329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136292.828745:0:23321:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789136292.828747:0:23321:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789136292.828748:0:23321:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789136292.828761:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c4763840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b11da215-324d-4c8d-90a5-0b7f26186c4c:3638:1876044666916224:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789136292.828787:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789136292.828807:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789136292.828813:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c4760b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b11da215-324d-4c8d-90a5-0b7f26186c4c:3638:1876044666916352:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789136292.828830:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789136292.828880:0:23319:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666916224 00000100:00100000:2.0:1789136292.828884:0:23319:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666916224 00010000:00010000:2.0:1789136292.828900:0:23319:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90a7c167ca00/0x559c8745c6de45fa lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x559c8745c6de45f3 expref: 22 pid: 23324 timeout: 840 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789136292.828920:0:23319:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666916352 00000100:00100000:2.0:1789136292.828923:0:23319:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666916352 00010000:00010000:2.0:1789136292.828933:0:23319:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90a7e1c9e800/0x559c8745c6de45ec lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x559c8745c6de45e5 expref: 23 pid: 23325 timeout: 840 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789136292.828945:0:23319:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1789136292.828950:0:23319:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c4760780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b11da215-324d-4c8d-90a5-0b7f26186c4c+23:3638:x1876044666916224:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789136292.828959:0:23319:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789136292.828964:0:23319:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90a7c167ca00/0x559c8745c6de45fa lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x559c8745c6de45f3 expref: 23 pid: 23324 timeout: 840 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136292.828984:0:23319:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90a7c167ca00/0x559c8745c6de45fa lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x559c8745c6de45f3 expref: 23 pid: 23324 timeout: 840 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136292.828999:0:23319:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789136292.829026:0:23319:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c4760780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b11da215-324d-4c8d-90a5-0b7f26186c4c+23:3638:x1876044666916224:12345-0@lo:103:ldlm_bl.0 Request processed in 76us (238us total) trans 0 rc 0/0 00000100:00100000:2.0:1789136292.829033:0:23319:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1789136292.829047:0:23319:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1789136292.829052:0:23319:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7d18c1050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b11da215-324d-4c8d-90a5-0b7f26186c4c+22:3638:x1876044666916352:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789136292.829059:0:23319:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789136292.829063:0:23319:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90a7e1c9e800/0x559c8745c6de45ec lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x559c8745c6de45e5 expref: 22 pid: 23325 timeout: 840 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136292.829071:0:23319:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90a7e1c9e800/0x559c8745c6de45ec lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x559c8745c6de45e5 expref: 22 pid: 23325 timeout: 840 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136292.829082:0:23319:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff90a7d1879c00/0x559c8745c6de46a2 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 23349 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136292.829089:0:23319:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90a7d1879c00/0x559c8745c6de46a2 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 23349 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1789136292.829100:0:23319:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.006523026s 00010000:00010000:2.0:1789136292.829104:0:23319:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff90a7d1879c00/0x559c8745c6de46a2 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 23349 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136292.829111:0:23319:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff90a7d1879c00/0x559c8745c6de46a2 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 23349 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136292.829126:0:23319:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff90a7d1879c00/0x559c8745c6de46a2 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 23349 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136292.829132:0:23319:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff90a7d1879c00/0x559c8745c6de46a2 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 23349 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136292.829137:0:23319:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a7d1879c00 already unused, calling callback (ffffffffc0dbf540) 00010000:00010000:2.0:1789136292.829141:0:23319:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff90a7d1879c00/0x559c8745c6de46a2 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 23349 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136292.829150:0:23319:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff90a7d1879c00/0x559c8745c6de46a2 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 23349 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136292.829158:0:23319:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff90a7d1879c00/0x559c8745c6de46a2 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 23349 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136292.829167:0:23319:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789136292.829190:0:23319:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7d18c1050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b11da215-324d-4c8d-90a5-0b7f26186c4c+22:3638:x1876044666916352:12345-0@lo:103:ldlm_bl.0 Request processed in 137us (358us total) trans 0 rc 0/0 00000100:00100000:2.0:1789136292.829196:0:23319:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1789136292.829265:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c4760b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b11da215-324d-4c8d-90a5-0b7f26186c4c:3638:1876044666916352:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789136292.829275:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c4763840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b11da215-324d-4c8d-90a5-0b7f26186c4c:3638:1876044666916224:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789136292.829302:0:23349:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90a7c167ca00/0x559c8745c6de45fa lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x559c8745c6de45f3 expref: 21 pid: 23324 timeout: 840 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789136292.829311:0:23349:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7c14b6940 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:23349:1876044666915968:0@lo:104: 00010000:00010000:2.0:1789136292.829319:0:23349:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90a7e1c9e800/0x559c8745c6de45ec lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x559c8745c6de45e5 expref: 20 pid: 23325 timeout: 840 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789136292.829333:0:23349:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c4762940 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:23349:1876044666916096:0@lo:104: 00010000:00010000:2.0:1789136292.829345:0:23349:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff90a7d1879c00/0x559c8745c6de46a2 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 23349 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136292.829353:0:23349:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff90a7d1879c00/0x559c8745c6de46a2 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 23349 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136292.829358:0:23349:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff90a7d1879c00/0x559c8745c6de46a2 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 23349 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136292.829363:0:23349:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90a7d1879c00/0x559c8745c6de46a2 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 23349 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136292.829587:0:23320:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789136292.829935:0:23325:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7fb158850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b11da215-324d-4c8d-90a5-0b7f26186c4c+19:24840:x1876044666915840:12345-0@lo:253:mount.lustre.0 Request processed in 12317us (13321us total) trans 0 rc 0/0 00000100:00100000:2.0:1789136292.829945:0:23325:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:3.0:1789136292.840234:0:24840:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7fa3be1c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b11da215-324d-4c8d-90a5-0b7f26186c4c:24840:1876044666915840:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1789136292.840253:0:24840:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:3.0:1789136292.840256:0:24840:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1789136292.840258:0:24840:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1789136292.840259:0:24840:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789136292.840261:0:24840:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789136292.840262:0:24840:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789136292.840263:0:24840:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789136292.840265:0:24840:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1789136292.840267:0:24840:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789136292.840268:0:24840:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:3.0:1789136292.840281:0:24840:0:(tgt_mount.c:2692:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00000001:00000004:0.0:1789136292.851519:0:24840:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 3, last_transno is 12884901888 00002000:00080000:3.0:1789136292.859613:0:24840:0:(ofd_obd.c:543:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:3.0:1789136292.859623:0:24840:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:3.0:1789136292.859664:0:24840:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:3.0:1789136292.859715:0:24840:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.201.131@tcp: cl_mgc_mutex unlock 00000020:01000004:3.0:1789136292.859735:0:24840:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=49 00000080:00000004:3.0:1789136292.859757:0:24840:0:(super25.c:182:lustre_fill_super()) /dev/mapper/ost1_flakey: Mount complete 00000020:00000004:3.0:1789136292.860454:0:24840:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1789136292.860644:0:24840:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1789136293.609039:0:23321:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:0.0:1789136293.903846:0:24922:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1789136293.904190:0:24922:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 10000000:01000000:3.0:1789136294.185587:0:23329:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1789136294.185595:0:23329:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff90a6c3ba1800 from 13 10000000:01000000:3.0:1789136294.185600:0:23329:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1789136294.185642:0:23329:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.131@tcp lock: ffff90a7e1c9ee00/0x559c8745c6de46a9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 23329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136294.185654:0:23329:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.131@tcp lock: ffff90a7e1c9ee00/0x559c8745c6de46a9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 23329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136294.185665:0:23329:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.131@tcp lock: ffff90a7e1c9ee00/0x559c8745c6de46a9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 23329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789136294.185700:0:23329:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7ff64b0c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b11da215-324d-4c8d-90a5-0b7f26186c4c:23329:1876044666916480:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1789136294.185765:0:23329:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789136294.185812:0:23329:0:(client.c:2715:ptlrpc_set_wait()) set ffff90a6c2f68a80 going to sleep for 11 seconds 00000100:00100000:0.0:1789136294.186029:0:23327:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666916480 00000100:00100000:0.0:1789136294.186039:0:23327:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666916480 00000100:00100000:0.0:1789136294.186102:0:23327:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:0.0:1789136294.186113:0:23327:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7fb15ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b11da215-324d-4c8d-90a5-0b7f26186c4c+19:23329:x1876044666916480:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789136294.186129:0:23327:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789136294.186144:0:23327:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90a6c3cafe00/0x559c8745c6de46b0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x559c8745c6de46a9 expref: -99 pid: 23327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136294.186169:0:23327:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90a6c3cafe00/0x559c8745c6de46b0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x559c8745c6de46a9 expref: 20 pid: 23327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136294.186190:0:23327:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90a6c3cafe00/0x559c8745c6de46b0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x559c8745c6de46a9 expref: 20 pid: 23327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136294.186200:0:23327:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a6c3cafe00, rc 0) 00000100:00100000:0.0:1789136294.186245:0:23327:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7fb15ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b11da215-324d-4c8d-90a5-0b7f26186c4c+20:23329:x1876044666916480:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 134us (479us total) trans 0 rc 0/0 00000100:00100000:0.0:1789136294.186252:0:23327:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:0.0:1789136294.186303:0:23329:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7ff64b0c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b11da215-324d-4c8d-90a5-0b7f26186c4c:23329:1876044666916480:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789136294.186318:0:23329:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.131@tcp lock: ffff90a7e1c9ee00/0x559c8745c6de46a9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x559c8745c6de46b0 expref: -99 pid: 23329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136294.186329:0:23329:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.131@tcp lock: ffff90a7e1c9ee00/0x559c8745c6de46a9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x559c8745c6de46b0 expref: -99 pid: 23329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789136294.186379:0:23329:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7fa3bfc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b11da215-324d-4c8d-90a5-0b7f26186c4c:23329:1876044666916608:0@lo:256:ll_cfg_requeue.0 00000100:00100000:0.0:1789136294.186411:0:23329:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789136294.188840:0:23329:0:(client.c:2715:ptlrpc_set_wait()) set ffff90a7d884fe40 going to sleep for 11 seconds 00000100:00100000:0.0:1789136294.189042:0:23325:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666916608 00000100:00100000:0.0:1789136294.189051:0:23325:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666916608 00000100:00100000:0.0:1789136294.189161:0:23325:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:0.0:1789136294.189170:0:23325:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7fb159050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b11da215-324d-4c8d-90a5-0b7f26186c4c+20:23329:x1876044666916608:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:0.0:1789136294.189206:0:23325:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1789136294.189221:0:23325:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1789136294.189224:0:23325:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 13 00000100:00100000:0.0:1789136294.189354:0:23325:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7fb159050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b11da215-324d-4c8d-90a5-0b7f26186c4c+20:23329:x1876044666916608:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 185us (2941us total) trans 0 rc 0/0 00000100:00100000:0.0:1789136294.189362:0:23325:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:3.0:1789136294.190133:0:23329:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7fa3bfc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b11da215-324d-4c8d-90a5-0b7f26186c4c:23329:1876044666916608:0@lo:256:ll_cfg_requeue.0 10000000:01000000:3.0:1789136294.190221:0:23329:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.131@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1789136294.190231:0:23329:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.131@tcp lock: ffff90a7e1c9ee00/0x559c8745c6de46a9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x559c8745c6de46b0 expref: -99 pid: 23329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136294.190241:0:23329:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.131@tcp lock: ffff90a7e1c9ee00/0x559c8745c6de46a9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x559c8745c6de46b0 expref: -99 pid: 23329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789136294.190251:0:23329:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1789136294.190253:0:23329:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff90a7fa55b800 from 13 10000000:01000000:3.0:1789136294.190256:0:23329:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1789136294.190286:0:23329:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.131@tcp lock: ffff90a7e1c9e200/0x559c8745c6de46b7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 23329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136294.190293:0:23329:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.131@tcp lock: ffff90a7e1c9e200/0x559c8745c6de46b7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 23329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136294.190301:0:23329:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.131@tcp lock: ffff90a7e1c9e200/0x559c8745c6de46b7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 23329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789136294.190334:0:23329:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7ff649e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b11da215-324d-4c8d-90a5-0b7f26186c4c:23329:1876044666916736:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1789136294.193490:0:23329:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789136294.193547:0:23329:0:(client.c:2715:ptlrpc_set_wait()) set ffff90a6c2f68000 going to sleep for 11 seconds 00000100:00100000:0.0:1789136294.193909:0:23324:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666916736 00000100:00100000:0.0:1789136294.193917:0:23324:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666916736 00000100:00100000:0.0:1789136294.193974:0:23324:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:0.0:1789136294.193984:0:23324:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7fb15bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b11da215-324d-4c8d-90a5-0b7f26186c4c+20:23329:x1876044666916736:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789136294.194021:0:23324:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789136294.194041:0:23324:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90a6c3caf600/0x559c8745c6de46be lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x559c8745c6de46b7 expref: -99 pid: 23324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136294.194072:0:23324:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90a6c3caf600/0x559c8745c6de46be lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x559c8745c6de46b7 expref: 21 pid: 23324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136294.194084:0:23324:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90a6c3caf600/0x559c8745c6de46be lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x559c8745c6de46b7 expref: 21 pid: 23324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136294.194094:0:23324:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a6c3caf600, rc 0) 00000100:00100000:0.0:1789136294.194146:0:23324:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7fb15bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b11da215-324d-4c8d-90a5-0b7f26186c4c+21:23329:x1876044666916736:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 162us (658us total) trans 0 rc 0/0 00000100:00100000:0.0:1789136294.194153:0:23324:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:3.0:1789136294.195373:0:23329:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7ff649e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b11da215-324d-4c8d-90a5-0b7f26186c4c:23329:1876044666916736:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789136294.195427:0:23329:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.131@tcp lock: ffff90a7e1c9e200/0x559c8745c6de46b7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x559c8745c6de46be expref: -99 pid: 23329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136294.195439:0:23329:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.131@tcp lock: ffff90a7e1c9e200/0x559c8745c6de46b7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x559c8745c6de46be expref: -99 pid: 23329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789136294.195506:0:23329:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7ff649e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b11da215-324d-4c8d-90a5-0b7f26186c4c:23329:1876044666916864:0@lo:256:ll_cfg_requeue.0 00000100:00100000:3.0:1789136294.195553:0:23329:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789136294.195598:0:23327:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666916864 00000100:00100000:3.0:1789136294.195603:0:23329:0:(client.c:2715:ptlrpc_set_wait()) set ffff90a6c2f68000 going to sleep for 11 seconds 00000100:00100000:0.0:1789136294.195605:0:23327:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666916864 00000100:00100000:0.0:1789136294.195657:0:23327:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1789136294.195671:0:23327:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7fb15a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b11da215-324d-4c8d-90a5-0b7f26186c4c+21:23329:x1876044666916864:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:0.0:1789136294.195691:0:23327:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1789136294.195706:0:23327:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1789136294.195710:0:23327:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 13 00000100:00100000:0.0:1789136294.195785:0:23327:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7fb15a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b11da215-324d-4c8d-90a5-0b7f26186c4c+21:23329:x1876044666916864:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 115us (232us total) trans 0 rc 0/0 00000100:00100000:0.0:1789136294.195793:0:23327:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:3.0:1789136294.200800:0:23329:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7ff649e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b11da215-324d-4c8d-90a5-0b7f26186c4c:23329:1876044666916864:0@lo:256:ll_cfg_requeue.0 10000000:01000000:3.0:1789136294.200943:0:23329:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.131@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1789136294.200953:0:23329:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.131@tcp lock: ffff90a7e1c9e200/0x559c8745c6de46b7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x559c8745c6de46be expref: -99 pid: 23329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136294.200964:0:23329:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.131@tcp lock: ffff90a7e1c9e200/0x559c8745c6de46b7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x559c8745c6de46be expref: -99 pid: 23329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136294.632634:0:23320:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789136295.657482:0:23321:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789136295.784154:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7f662f0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1876044666916992:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1789136295.784233:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789136295.784325:0:23339:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666916992 00000100:00100000:3.0:1789136295.784332:0:23339:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666916992 00000100:00100000:3.0:1789136295.784377:0:23339:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1789136295.784387:0:23339:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7ff648000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3640:x1876044666916992:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1789136295.784422:0:23339:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:3.0:1789136295.784474:0:23339:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7ff648000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3640:x1876044666916992:12345-0@lo:41:osp-pre-1-0.0 Request processed in 88us (240us total) trans 0 rc 0/0 00000100:00100000:3.0:1789136295.784481:0:23339:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1789136295.785028:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7f662e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1876044666917120:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1789136295.785065:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789136295.785226:0:24077:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666917120 00000100:00100000:1.0:1789136295.785231:0:24077:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666917120 00000100:00100000:1.0:1789136295.785267:0:24077:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1789136295.785274:0:24077:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7fa3bf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3641:x1876044666917120:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1789136295.785295:0:24077:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446309888 avail 1300070400 00000100:00100000:1.0:1789136295.785345:0:24077:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7fa3bf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3641:x1876044666917120:12345-0@lo:41:osp-pre-0-1.0 Request processed in 71us (278us total) trans 0 rc 0/0 00000100:00100000:1.0:1789136295.785351:0:24077:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1789136295.785773:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7f662e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1876044666917120:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1789136295.795535:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7f662f0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1876044666916992:0@lo:41:osp-pre-1-0.0 00010000:00010000:0.0:1789136296.681041:0:23320:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789136297.715393:0:23321:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1789136297.835602:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789136297.835610:0:487:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1789136297.835613:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789136297.835617:0:487:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1789136297.835783:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789136297.842829:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7f662f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1876044666917632:0@lo:400:kworker.0 00000100:00100000:0.0:1789136297.842951:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789136297.843008:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7f662da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3641:1876044666917504:0@lo:400:kworker.0 00000100:00100000:0.0:1789136297.843041:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789136297.843103:0:23332:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666917504 00000100:00100000:0.0:1789136297.843122:0:23332:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666917504 00000100:00100000:0.0:1789136297.843184:0:23332:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1789136297.843195:0:23332:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7fa3be1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1876044666917504:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789136297.843263:0:23332:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7fa3be1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1876044666917504:12345-0@lo:400:kworker.0 Request processed in 69us (220us total) trans 0 rc 0/0 00000100:00100000:0.0:1789136297.843271:0:23332:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00080000:0.0:1789136297.843325:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90a7f662da40 x1876044666917504/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789136313 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789136297.843355:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7f662da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3641:1876044666917504:0@lo:400:kworker.0 00000100:00080000:1.0:1789136297.843468:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789136297.843474:0:487:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1789136297.843477:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789136297.843481:0:487:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1789136297.843553:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7f662cf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b11da215-324d-4c8d-90a5-0b7f26186c4c:3638:1876044666917248:0@lo:400:kworker.0 00000100:00100000:1.0:1789136297.843596:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789136297.843649:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7f662d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3638:1876044666917760:0@lo:400:kworker.0 00000100:00100000:1.0:1789136297.843679:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789136297.843701:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1789136297.843709:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7f662e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1876044666917376:0@lo:400:kworker.0 00000100:00100000:1.0:1789136297.843733:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789136297.843751:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7f662ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3638:1876044666917888:0@lo:400:kworker.0 00000100:00100000:1.0:1789136297.843771:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789136297.843797:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7f662cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3640:1876044666918016:0@lo:400:kworker.0 00000100:00100000:1.0:1789136297.843835:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789136297.843893:0:23325:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666917248 00000100:00100000:1.0:1789136297.843899:0:23325:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666917248 00000100:00100000:1.0:1789136297.843938:0:23325:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:1.0:1789136297.843945:0:23325:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7fb159c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b11da215-324d-4c8d-90a5-0b7f26186c4c+21:3638:x1876044666917248:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789136297.843985:0:23325:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7fb159c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b11da215-324d-4c8d-90a5-0b7f26186c4c+21:3638:x1876044666917248:12345-0@lo:400:kworker.0 Request processed in 41us (388us total) trans 0 rc 0/0 00000100:00100000:1.0:1789136297.843992:0:23325:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:1.0:1789136297.844029:0:23333:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666917760 00000100:00100000:1.0:1789136297.844032:0:23333:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666917760 00000100:00100000:1.0:1789136297.844048:0:23333:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666917888 00000100:00100000:1.0:1789136297.844050:0:23333:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666917888 00000100:00100000:1.0:1789136297.844073:0:23333:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666918016 00000100:00100000:1.0:1789136297.844075:0:23333:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666918016 00000100:00100000:1.0:1789136297.844089:0:23333:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1789136297.844095:0:23333:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7f662da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3638:x1876044666917760:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789136297.844139:0:23333:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7f662da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3638:x1876044666917760:12345-0@lo:400:kworker.0 Request processed in 43us (458us total) trans 0 rc 0/0 00000100:00100000:1.0:1789136297.844145:0:23333:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1789136297.844158:0:23333:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1789136297.844165:0:23333:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c10983c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3638:x1876044666917888:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789136297.844190:0:23333:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c10983c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3638:x1876044666917888:12345-0@lo:400:kworker.0 Request processed in 26us (419us total) trans 0 rc 0/0 00000100:00100000:1.0:1789136297.844197:0:23333:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1789136297.844207:0:23333:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1789136297.844213:0:23333:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c109a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3640:x1876044666918016:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789136297.844244:0:23333:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c109a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3640:x1876044666918016:12345-0@lo:400:kworker.0 Request processed in 32us (408us total) trans 0 rc 0/0 00000100:00100000:1.0:1789136297.844257:0:23333:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1789136297.844276:0:23339:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666917632 00000100:00100000:1.0:1789136297.844280:0:23339:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666917632 00000100:00100000:1.0:1789136297.844303:0:23339:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666917376 00000100:00100000:1.0:1789136297.844305:0:23339:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666917376 00000100:00100000:1.0:1789136297.844317:0:23339:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1789136297.844322:0:23339:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7fa3bfc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3641:x1876044666917632:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789136297.844358:0:23339:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7fa3bfc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3641:x1876044666917632:12345-0@lo:400:kworker.0 Request processed in 35us (1407us total) trans 0 rc 0/0 00000100:00100000:1.0:1789136297.844364:0:23339:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1789136297.844376:0:23339:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1789136297.844381:0:23339:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c1098000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3638:x1876044666917376:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789136297.844408:0:23339:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c1098000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3638:x1876044666917376:12345-0@lo:400:kworker.0 Request processed in 27us (673us total) trans 0 rc 0/0 00000100:00100000:1.0:1789136297.844413:0:23339:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1789136297.844447:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7f662e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1876044666917376:0@lo:400:kworker.0 00010000:00080000:1.0:1789136297.844459:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90a7f662ed00 x1876044666917888/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789136313 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789136297.844470:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7f662ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3638:1876044666917888:0@lo:400:kworker.0 00000100:00100000:1.0:1789136297.844478:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7f662cf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b11da215-324d-4c8d-90a5-0b7f26186c4c:3638:1876044666917248:0@lo:400:kworker.0 00010000:00080000:1.0:1789136297.844488:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90a7f662d680 x1876044666917760/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789136313 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789136297.844497:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7f662d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3638:1876044666917760:0@lo:400:kworker.0 00000100:00080000:1.0:1789136297.844545:0:23328:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1789136297.844555:0:23328:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1789136297.844573:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90a7f662cb40 x1876044666918016/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789136313 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789136297.844582:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7f662cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3640:1876044666918016:0@lo:400:kworker.0 00000100:00100000:0.0:1789136297.844908:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7f662f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1876044666917632:0@lo:400:kworker.0 00000040:00080000:1.0:1789136297.969889:0:24094:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1789136298.728112:0:23320:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789136299.752057:0:23321:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789136300.008144:0:3637:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789136285/real 1789136285] req@ffff90a7fa3bd2c0 x1876044666911872/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789136300 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789136300.008175:0:3637:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff90a7fa3bd2c0 x1876044666911872/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789136300 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789136300.008185:0:3637:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789136285/real 1789136285] req@ffff90a7fa3be580 x1876044666912000/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789136300 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789136300.008195:0:3637:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff90a7fa3be580 x1876044666912000/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789136300 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1789136300.008216:0:3637:0:(import.c:65:import_set_state_nolock()) ffff90a7ff507800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1789136300.008341:0:3637:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:3.0:1789136300.008346:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7fa3bd2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3637:1876044666911872:0@lo:8:kworker.0 00000100:00080000:3.0:1789136300.008353:0:3637:0:(import.c:65:import_set_state_nolock()) ffff90a7d8b2a800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1789136300.010391:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789136300.010398:0:487:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1789136300.010400:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789136300.010403:0:487:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1789136300.010421:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789136300.010424:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:0.0:1789136300.010427:0:487:0:(import.c:65:import_set_state_nolock()) ffff90a7ff507800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1789136300.010434:0:487:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 733 00000100:00080000:0.0:1789136300.010439:0:487:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0001: tried all connections, increasing latency to 10s 00000100:00080000:0.0:1789136300.010447:0:487:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff90a7ff507800 using connection 192.168.201.131@tcp/0@lo 00000100:00100000:0.0:1789136300.010469:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff90a6c3ce92c0 x1876044666918656/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1789136300.010480:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789136300.010483:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1789136300.010484:0:487:0:(import.c:65:import_set_state_nolock()) ffff90a7d8b2a800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1789136300.010487:0:487:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 733 00000100:00080000:0.0:1789136300.010490:0:487:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 10s 00000100:00080000:0.0:1789136300.010493:0:487:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff90a7d8b2a800 using connection 192.168.201.131@tcp/0@lo 00000100:00100000:0.0:1789136300.010503:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff90a6c3ceb0c0 x1876044666918784/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1789136300.010557:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7fa3bc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b11da215-324d-4c8d-90a5-0b7f26186c4c:3641:1876044666918144:0@lo:400:kworker.0 00000100:00100000:0.0:1789136300.010628:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789136300.010676:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c3ce83c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3641:1876044666918912:0@lo:400:kworker.0 00000100:00100000:0.0:1789136300.010703:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789136300.010728:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789136300.010734:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c3ce8b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1876044666918528:0@lo:400:kworker.0 00000100:00100000:0.0:1789136300.010760:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789136300.010790:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7fa3bde00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1876044666918272:0@lo:400:kworker.0 00000100:00100000:0.0:1789136300.010814:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789136300.010832:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c3cea1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3638:1876044666919040:0@lo:400:kworker.0 00000100:00100000:0.0:1789136300.010874:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789136300.010892:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00080000:3.0:1789136300.011054:0:3637:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:3.0:1789136300.011060:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7fa3be580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3637:1876044666912000:0@lo:8:kworker.0 00000100:00100000:3.0:1789136300.011095:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c3ce92c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3637:1876044666918656:0@lo:8:kworker.0 00000100:00100000:3.0:1789136300.011128:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789136300.011159:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c3ceb0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3637:1876044666918784:0@lo:8:kworker.0 00000100:00100000:3.0:1789136300.011178:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789136300.011214:0:24846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666918656 00000100:00100000:3.0:1789136300.011221:0:24846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666918656 00000100:00100000:3.0:1789136300.011247:0:24846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666918784 00000100:00100000:3.0:1789136300.011250:0:24846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666918784 00000100:00100000:3.0:1789136300.011263:0:24846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1789136300.011270:0:24846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7ff648f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3637:x1876044666918656:12345-0@lo:8:kworker.0 00010000:00080000:3.0:1789136300.011298:0:24846:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 748 last 0 00000020:00000080:3.0:1789136300.011334:0:24846:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x559c8745c6de46c5 00002000:00100000:3.0:1789136300.011348:0:24846:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0001-mdtlov_UUID/ffff90a7f08de800 ocd_connect_flags: 0xa044401443000026 ocd_version: 211397f ocd_grant: 0 ocd_index: 0 ocd_group 1 00002000:00080000:3.0:1789136300.011352:0:24846:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 1 00002000:00100000:3.0:1789136300.011355:0:24846:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:3.0:1789136300.011517:0:24846:0:(ofd_obd.c:389:ofd_obd_connect()) lustre-OST0000: get connection from MDS 1 00000100:00080000:3.0:1789136300.011539:0:24846:0:(import.c:65:import_set_state_nolock()) ffff90a7f08dd000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789136300.011586:0:24846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7ff648f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:3637:x1876044666918656:12345-0@lo:8:kworker.0 Request processed in 314us (456us total) trans 0 rc 0/0 00000100:00100000:3.0:1789136300.011594:0:24846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1789136300.011612:0:24846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1789136300.011616:0:24846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7ff64b840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3637:x1876044666918784:12345-0@lo:8:kworker.0 00010000:00020000:3.0:1789136300.011628:0:24846:0:(ldlm_lib.c:1228:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1789136300.012004:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c3cea940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3638:1876044666918400:0@lo:400:kworker.0 00000100:00100000:0.0:1789136300.012036:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789136300.012059:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c3ce9e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3638:1876044666919168:0@lo:400:kworker.0 00000100:00100000:0.0:1789136300.012095:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789136300.012124:0:23324:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666918144 00000100:00100000:0.0:1789136300.012128:0:23324:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666918144 00000100:00100000:0.0:1789136300.012163:0:23324:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:0.0:1789136300.012169:0:23324:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7fb158050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b11da215-324d-4c8d-90a5-0b7f26186c4c+21:3641:x1876044666918144:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789136300.012202:0:23324:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7fb158050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b11da215-324d-4c8d-90a5-0b7f26186c4c+21:3641:x1876044666918144:12345-0@lo:400:kworker.0 Request processed in 34us (1574us total) trans 0 rc 0/0 00000100:00100000:0.0:1789136300.012209:0:23324:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:0.0:1789136300.012236:0:23333:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666918912 00000100:00100000:0.0:1789136300.012246:0:23333:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666918912 00000100:00100000:0.0:1789136300.012264:0:23333:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666919040 00000100:00100000:0.0:1789136300.012267:0:23333:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666919040 00000100:00100000:0.0:1789136300.012287:0:23333:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666918400 00000100:00100000:0.0:1789136300.012290:0:23333:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666918400 00000100:00100000:0.0:1789136300.012299:0:23333:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666919168 00000100:00100000:0.0:1789136300.012301:0:23333:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666919168 00000100:00100000:0.0:1789136300.012313:0:23333:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1789136300.012319:0:23333:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c3ce9a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1876044666918912:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789136300.012351:0:23333:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c3ce9a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1876044666918912:12345-0@lo:400:kworker.0 Request processed in 32us (1648us total) trans 0 rc 0/0 00000100:00100000:0.0:1789136300.012358:0:23333:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1789136300.012370:0:23333:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1789136300.012375:0:23333:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c3ceb840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3638:x1876044666919040:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789136300.012404:0:23333:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c3ceb840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3638:x1876044666919040:12345-0@lo:400:kworker.0 Request processed in 29us (1530us total) trans 0 rc 0/0 00000100:00100000:0.0:1789136300.012410:0:23333:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1789136300.012420:0:23333:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1789136300.012425:0:23333:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c3ceb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1876044666918400:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789136300.012451:0:23333:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c3ceb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1876044666918400:12345-0@lo:400:kworker.0 Request processed in 26us (415us total) trans 0 rc 0/0 00000100:00100000:0.0:1789136300.012457:0:23333:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1789136300.012467:0:23333:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1789136300.012473:0:23333:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c3ce8f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3638:x1876044666919168:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789136300.012498:0:23333:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c3ce8f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3638:x1876044666919168:12345-0@lo:400:kworker.0 Request processed in 25us (402us total) trans 0 rc 0/0 00000100:00100000:0.0:1789136300.012503:0:23333:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1789136300.012528:0:23339:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666918528 00000100:00100000:0.0:1789136300.012532:0:23339:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666918528 00000100:00100000:0.0:1789136300.012558:0:23339:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666918272 00000100:00100000:0.0:1789136300.012560:0:23339:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666918272 00000100:00100000:0.0:1789136300.012571:0:23339:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1789136300.012576:0:23339:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c3ce8780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3641:x1876044666918528:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789136300.012609:0:23339:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c3ce8780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3641:x1876044666918528:12345-0@lo:400:kworker.0 Request processed in 32us (1848us total) trans 0 rc 0/0 00000100:00100000:0.0:1789136300.012615:0:23339:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1789136300.012627:0:23339:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1789136300.012632:0:23339:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c3cead00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3638:x1876044666918272:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789136300.012660:0:23339:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c3cead00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3638:x1876044666918272:12345-0@lo:400:kworker.0 Request processed in 28us (1845us total) trans 0 rc 0/0 00000100:00100000:0.0:1789136300.012666:0:23339:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00080000:0.0:1789136300.012693:0:23328:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1789136300.012697:0:23328:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789136300.012727:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c3ce8b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1876044666918528:0@lo:400:kworker.0 00000100:00100000:0.0:1789136300.012738:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7fa3bc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b11da215-324d-4c8d-90a5-0b7f26186c4c:3641:1876044666918144:0@lo:400:kworker.0 00010000:00080000:0.0:1789136300.012750:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90a6c3ce83c0 x1876044666918912/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789136316 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789136300.012760:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c3ce83c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3641:1876044666918912:0@lo:400:kworker.0 00010000:00080000:0.0:1789136300.012788:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90a6c3cea940 x1876044666918400/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789136316 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789136300.012796:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c3cea940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3638:1876044666918400:0@lo:400:kworker.0 00010000:00080000:0.0:1789136300.012806:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90a6c3ce9e00 x1876044666919168/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789136316 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789136300.012821:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c3ce9e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3638:1876044666919168:0@lo:400:kworker.0 00000100:00100000:0.0:1789136300.012833:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7fa3bde00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1876044666918272:0@lo:400:kworker.0 00010000:00080000:0.0:1789136300.012843:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90a6c3cea1c0 x1876044666919040/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789136316 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789136300.012851:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c3cea1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3638:1876044666919040:0@lo:400:kworker.0 00000100:00080000:2.0:1789136300.025415:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1789136300.025425:0:487:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1789136300.025429:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1789136300.025432:0:487:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00010000:00080000:3.0:1789136300.029227:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90a6c3ce92c0 x1876044666918656/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/416 e 0 to 0 dl 1789136320 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789136300.029243:0:3637:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:3.0:1789136300.029255:0:3637:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0001: connect to target with instance 3 00000100:00080000:3.0:1789136300.029263:0:3637:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0001: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:3.0:1789136300.029269:0:3637:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:3.0:1789136300.029273:0:3637:0:(import.c:65:import_set_state_nolock()) ffff90a7ff507800 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:3.0:1789136300.029293:0:3637:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:3.0:1789136300.029299:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c3ce92c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3637:1876044666918656:0@lo:8:kworker.0 00000100:00100000:3.0:1789136300.029452:0:24846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7ff64b840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3637:x1876044666918784:12345-0@lo:8:kworker.0 Request processed in 17834us (18272us total) trans 0 rc -19/-19 00000100:00100000:3.0:1789136300.029462:0:24846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:3.0:1789136300.029495:0:3637:0:(import.c:65:import_set_state_nolock()) ffff90a7d8b2a800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1789136300.029498:0:3637:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1789136300.029515:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c3ceb0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3637:1876044666918784:0@lo:8:kworker.0 00000004:00080000:2.0:1789136300.029633:0:24079:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0001: going to cleanup orphans since [0x280000400:0x1:0x0] 00000100:00100000:2.0:1789136300.029656:0:24079:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c4763840 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:24079:1876044666919424:0@lo:7:osp-pre-0-1.0 00000100:00100000:2.0:1789136300.029695:0:24079:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789136300.029713:0:24079:0:(client.c:2715:ptlrpc_set_wait()) set ffff90a7c2f4d180 going to sleep for 11 seconds 00000100:00100000:2.0:1789136300.029723:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789136300.029733:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c4762940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1876044666919296:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1789136300.029752:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:2.0:1789136300.029894:0:24078:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:2.0:1789136300.030119:0:24078:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 748149263276ns, next at 0ns, rc = 0 00080000:00080000:2.0:1789136300.030125:0:24078:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0001: async commit OSD 00000100:00100000:1.0:1789136300.030522:0:24845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666919424 00000100:00100000:1.0:1789136300.030528:0:24845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666919424 00000100:00100000:1.0:1789136300.030580:0:24845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1789136300.030589:0:24845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c4760b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:24079:x1876044666919424:12345-0@lo:7:osp-pre-0-1.0 00000100:00100000:3.0:1789136300.032616:0:24848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666919296 00000100:00100000:3.0:1789136300.032626:0:24848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666919296 00000100:00100000:3.0:1789136300.032667:0:24848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1789136300.032675:0:24848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c4760780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+7:3641:x1876044666919296:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1789136300.032703:0:24848:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3915853824 avail 3684331520 00000100:00100000:3.0:1789136300.032884:0:24848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c4760780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+7:3641:x1876044666919296:12345-0@lo:13:osp-pre-0-1.0 Request processed in 209us (3130us total) trans 0 rc 0/0 00000100:00100000:3.0:1789136300.032893:0:24848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:3.0:1789136300.033409:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90a6c4762940 x1876044666919296/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789136316 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789136300.033431:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c4762940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1876044666919296:0@lo:13:osp-pre-0-1.0 00000100:00080000:2.0:1789136300.033930:0:23328:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000004:00080000:2.0:1789136300.034989:0:24069:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 1 committed 00002000:00080000:1.0:1789136300.037272:0:24845:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x280000400 00002000:00080000:1.0:1789136300.037282:0:24845:0:(ofd_dev.c:1222:ofd_get_info_hdl()) lustre-OST0000: LAST FID is [0x280000400:0x41:0x0] 00000100:00100000:1.0:1789136300.037387:0:24845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c4760b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:24079:x1876044666919424:12345-0@lo:7:osp-pre-0-1.0 Request processed in 6795us (7686us total) trans 0 rc 0/0 00000100:00100000:1.0:1789136300.037397:0:24845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:2.0:1789136300.040269:0:24079:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90a6c4763840 x1876044666919424/t0(0) o7->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 264/240 e 0 to 0 dl 1789136316 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789136300.040290:0:24079:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c4763840 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:24079:1876044666919424:0@lo:7:osp-pre-0-1.0 00000004:00080000:2.0:1789136300.040305:0:24079:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0000-osc-MDT0001: Got last_fid [0x280000400:0x41:0x0] 00000100:00100000:2.0:1789136300.040350:0:24079:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c4763840 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:24079:1876044666919552:0@lo:5:osp-pre-0-1.0 00000100:00100000:2.0:1789136300.040409:0:24079:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789136300.040449:0:24079:0:(client.c:2715:ptlrpc_set_wait()) set ffff90a7c2f4d180 going to sleep for 11 seconds 00000100:00100000:2.0:1789136300.040476:0:24846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666919552 00000100:00100000:2.0:1789136300.040482:0:24846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666919552 00000100:00100000:2.0:1789136300.040540:0:24846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1789136300.040549:0:24846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c47621c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:24079:x1876044666919552:12345-0@lo:5:osp-pre-0-1.0 00002000:00080000:2.0:1789136300.040577:0:24846:0:(ofd_dev.c:1654:ofd_create_hdl()) ofd_last_id() = 65 -> diff = 0 00000100:00100000:2.0:1789136300.040619:0:24846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c47621c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:24079:x1876044666919552:12345-0@lo:5:osp-pre-0-1.0 Request processed in 71us (208us total) trans 0 rc 0/0 00000100:00100000:2.0:1789136300.040625:0:24846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:2.0:1789136300.040651:0:24079:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90a6c4763840 x1876044666919552/t0(0) o5->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1789136316 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789136300.040670:0:24079:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c4763840 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:24079:1876044666919552:0@lo:5:osp-pre-0-1.0 00000004:00080000:2.0:1789136300.040678:0:24079:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0001: Got last_id [0x280000400:0x41:0x0] from OST, last_created [0x280000400:0x41:0x0]last_used is [0x280000400:0x41:0x0] 00000100:00100000:2.0:1789136300.040700:0:24079:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c4763840 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:24079:1876044666919680:0@lo:5:osp-pre-0-1.0 00000100:00100000:2.0:1789136300.040721:0:24079:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789136300.040737:0:24079:0:(client.c:2715:ptlrpc_set_wait()) set ffff90a7c2f4d180 going to sleep for 11 seconds 00000100:00100000:2.0:1789136300.040749:0:24845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666919680 00000100:00100000:2.0:1789136300.040753:0:24845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666919680 00000100:00100000:2.0:1789136300.040770:0:24845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1789136300.040776:0:24845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c4760f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:24079:x1876044666919680:12345-0@lo:5:osp-pre-0-1.0 00002000:00080000:2.0:1789136300.040800:0:24845:0:(ofd_dev.c:1761:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000400 at 66 00000001:00080000:3.0:1789136300.053514:0:24841:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 12884901889 is committed 00000001:00100000:3.0:1789136300.053530:0:24841:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000100:00100000:2.0:1789136300.054890:0:24845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c4760f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:24079:x1876044666919680:12345-0@lo:5:osp-pre-0-1.0 Request processed in 14106us (14160us total) trans 12884901889 rc 0/0 00000100:00100000:2.0:1789136300.054903:0:24845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:3.0:1789136300.058296:0:24079:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90a6c4763840 x1876044666919680/t0(0) o5->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1789136316 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789136300.058371:0:24079:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 12884901889 gen 2 00000100:00100000:3.0:1789136300.058379:0:24079:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c4763840 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:24079:1876044666919680:0@lo:5:osp-pre-0-1.0 00000004:00080000:3.0:1789136300.058397:0:24079:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0001: current precreated pool: [0x280000400:0x41:0x0]-[0x280000400:0x61:0x0] 00000100:00100000:3.0:1789136300.058452:0:24079:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7ff64ad00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0000-lwp-MDT0001_UUID:24079:1876044666919808:0@lo:900:osp-pre-0-1.0 00000100:00100000:3.0:1789136300.058512:0:24079:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789136300.058592:0:24079:0:(client.c:2715:ptlrpc_set_wait()) set ffff90a6c2f68b40 going to sleep for 11 seconds 00000100:00100000:0.0:1789136300.060821:0:23345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666919808 00000100:00100000:0.0:1789136300.060833:0:23345:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666919808 00000100:00100000:0.0:1789136300.060910:0:23345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1789136300.060921:0:23345:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7ff649e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:24079:x1876044666919808:12345-0@lo:900:osp-pre-0-1.0 00000100:00100000:0.0:1789136300.061019:0:23345:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7ff649e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:24079:x1876044666919808:12345-0@lo:900:osp-pre-0-1.0 Request processed in 99us (2506us total) trans 0 rc 0/0 00000100:00100000:0.0:1789136300.061027:0:23345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1789136300.061171:0:24079:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90a7ff64ad00 x1876044666919808/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1789136316 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789136300.061187:0:24079:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7ff64ad00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0000-lwp-MDT0001_UUID:24079:1876044666919808:0@lo:900:osp-pre-0-1.0 00000001:02000400:2.0:1789136300.575560:0:25212:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg131-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:2.0:1789136300.778998:0:23320:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789136300.904201:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789136300.904226:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c109b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1876044666919936:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1789136300.904314:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789136300.904455:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789136300.904466:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c1098780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1876044666920064:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1789136300.904499:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789136300.904536:0:23338:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666919936 00000100:00100000:1.0:1789136300.904544:0:23338:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666919936 00000100:00100000:1.0:1789136300.904584:0:23338:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666920064 00000100:00100000:1.0:1789136300.904587:0:23338:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666920064 00000100:00100000:1.0:1789136300.904605:0:23338:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1789136300.904613:0:23338:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c3ce9e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3640:x1876044666919936:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1789136300.904646:0:23338:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1789136300.904692:0:23338:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c3ce9e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3640:x1876044666919936:12345-0@lo:41:osp-pre-1-0.0 Request processed in 80us (378us total) trans 0 rc 0/0 00000100:00100000:1.0:1789136300.904699:0:23338:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1789136300.904717:0:23338:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1789136300.904738:0:23338:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c109ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3639:x1876044666920064:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1789136300.904755:0:23338:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446309888 avail 1300070400 00000100:00100000:1.0:1789136300.904786:0:23338:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c109ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3639:x1876044666920064:12345-0@lo:41:osp-pre-0-1.0 Request processed in 50us (287us total) trans 0 rc 0/0 00000100:00100000:1.0:1789136300.904793:0:23338:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1789136300.904834:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c1098780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1876044666920064:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1789136300.904888:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c109b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1876044666919936:0@lo:41:osp-pre-1-0.0 00000020:00000004:0.0:1789136301.518651:0:25264:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1789136301.519420:0:25264:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1789136301.799955:0:23321:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1789136302.440730:0:23370:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000020:00000004:1.0:1789136302.575670:0:25315:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1789136302.576076:0:25315:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1789136302.824262:0:23320:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789136303.849294:0:23321:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789136304.872903:0:23320:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789136305.129208:0:3637:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789136285/real 1789136285] req@ffff90a7fa3bcb40 x1876044666911616/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789136305 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789136305.129338:0:3637:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff90a7fa3bcb40 x1876044666911616/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789136305 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789136305.129349:0:3637:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789136285/real 1789136285] req@ffff90a7fa3bed00 x1876044666911744/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789136305 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789136305.129361:0:3637:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff90a7fa3bed00 x1876044666911744/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789136305 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1789136305.129382:0:3637:0:(import.c:65:import_set_state_nolock()) ffff90a7ff553800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1789136305.129464:0:3637:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:3.0:1789136305.129469:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7fa3bcb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3637:1876044666911616:0@lo:8:kworker.0 00000100:00080000:3.0:1789136305.129475:0:3637:0:(import.c:65:import_set_state_nolock()) ffff90a6c228c000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00100000:0.0:1789136305.132355:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c1098b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b11da215-324d-4c8d-90a5-0b7f26186c4c:3639:1876044666920192:0@lo:400:kworker.0 00000100:00100000:0.0:1789136305.132442:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1789136305.132637:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789136305.132643:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:1.0:1789136305.132647:0:38:0:(import.c:65:import_set_state_nolock()) ffff90a7ff553800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1789136305.132652:0:38:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 733 00000100:00080000:1.0:1789136305.132657:0:38:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:1.0:1789136305.132663:0:38:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff90a7ff553800 using connection 192.168.201.131@tcp/0@lo 00000100:00100000:1.0:1789136305.132686:0:38:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff90a6c109bc00 x1876044666920448/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1789136305.132699:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789136305.132702:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1789136305.132704:0:38:0:(import.c:65:import_set_state_nolock()) ffff90a6c228c000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1789136305.132707:0:38:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 733 00000100:00080000:1.0:1789136305.132710:0:38:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:1.0:1789136305.132714:0:38:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff90a6c228c000 using connection 192.168.201.131@tcp/0@lo 00000100:00100000:1.0:1789136305.132727:0:38:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff90a6c1099680 x1876044666920576/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1789136305.132891:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789136305.132895:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1789136305.132896:0:38:0:(import.c:65:import_set_state_nolock()) ffff90a7d8b2a800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1789136305.132900:0:38:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 748 00000100:00080000:1.0:1789136305.132904:0:38:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 15s 00000100:00080000:1.0:1789136305.132907:0:38:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff90a7d8b2a800 using connection 192.168.201.131@tcp/0@lo 00000100:00100000:1.0:1789136305.132918:0:38:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff90a6c109a1c0 x1876044666921088/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1789136305.132963:0:23327:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666920192 00000100:00100000:1.0:1789136305.132968:0:23327:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666920192 00000100:00100000:1.0:1789136305.133027:0:23327:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:1.0:1789136305.133036:0:23327:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7fb159850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b11da215-324d-4c8d-90a5-0b7f26186c4c+21:3639:x1876044666920192:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789136305.133201:0:23327:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7fb159850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b11da215-324d-4c8d-90a5-0b7f26186c4c+21:3639:x1876044666920192:12345-0@lo:400:kworker.0 Request processed in 166us (759us total) trans 0 rc 0/0 00000100:00100000:1.0:1789136305.133286:0:23327:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:1.0:1789136305.133327:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c109b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1876044666920832:0@lo:400:kworker.0 00000100:00100000:1.0:1789136305.133359:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789136305.133383:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c10992c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3638:1876044666921472:0@lo:400:kworker.0 00000100:00100000:1.0:1789136305.133409:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1789136305.133539:0:3637:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:3.0:1789136305.133545:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7fa3bed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3637:1876044666911744:0@lo:8:kworker.0 00000100:00100000:3.0:1789136305.133576:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c109a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3641:1876044666920704:0@lo:400:kworker.0 00000100:00100000:3.0:1789136305.133605:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789136305.133623:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c1099a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3641:1876044666921344:0@lo:400:kworker.0 00000100:00100000:3.0:1789136305.133645:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789136305.133661:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:3.0:1789136305.133667:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c109b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1876044666920320:0@lo:400:kworker.0 00000100:00100000:3.0:1789136305.133691:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789136305.133709:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c1099e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3641:1876044666921216:0@lo:400:kworker.0 00000100:00100000:3.0:1789136305.133732:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789136305.133842:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789136305.133850:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c1098f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1876044666920960:0@lo:400:kworker.0 00000100:00100000:1.0:1789136305.133902:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789136305.133937:0:23338:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666920832 00000100:00100000:1.0:1789136305.133941:0:23338:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666920832 00000100:00100000:1.0:1789136305.133967:0:23338:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666920320 00000100:00100000:1.0:1789136305.133992:0:23338:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666920320 00000100:00100000:1.0:1789136305.134012:0:23338:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1789136305.134019:0:23338:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c1098780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3638:x1876044666920832:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789136305.134158:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c109bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3637:1876044666920448:0@lo:8:kworker.0 00000100:00100000:0.0:1789136305.134262:0:23334:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666921472 00000100:00100000:0.0:1789136305.134267:0:23334:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666921472 00000100:00100000:0.0:1789136305.134302:0:23334:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666920704 00000100:00100000:0.0:1789136305.134305:0:23334:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666920704 00000100:00100000:0.0:1789136305.134316:0:23334:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666921344 00000100:00100000:0.0:1789136305.134324:0:23334:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666921344 00000100:00100000:0.0:1789136305.134340:0:23334:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666921216 00000100:00100000:0.0:1789136305.134343:0:23334:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666921216 00000100:00100000:0.0:1789136305.134355:0:23334:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1789136305.134361:0:23334:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c109b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3638:x1876044666921472:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789136305.135099:0:24846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666920960 00000100:00100000:2.0:1789136305.135106:0:24846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666920960 00000100:00100000:2.0:1789136305.135142:0:24846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789136305.135150:0:24846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7f662f0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3638:x1876044666920960:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789136305.135460:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789136305.135502:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c1099680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3637:1876044666920576:0@lo:8:kworker.0 00000100:00100000:3.0:1789136305.135534:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789136305.135545:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c109a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3637:1876044666921088:0@lo:8:kworker.0 00000100:00100000:3.0:1789136305.135566:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789136305.135650:0:23334:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c109b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3638:x1876044666921472:12345-0@lo:400:kworker.0 Request processed in 1287us (2238us total) trans 0 rc 0/0 00000100:00100000:0.0:1789136305.135659:0:23334:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1789136305.135680:0:23334:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1789136305.135688:0:23334:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7ff64b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1876044666920704:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789136305.135727:0:23334:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7ff64b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1876044666920704:12345-0@lo:400:kworker.0 Request processed in 41us (2120us total) trans 0 rc 0/0 00000100:00100000:0.0:1789136305.135733:0:23334:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1789136305.135746:0:23334:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1789136305.135764:0:23334:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7ff649a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3641:x1876044666921344:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789136305.135794:0:23334:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7ff649a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3641:x1876044666921344:12345-0@lo:400:kworker.0 Request processed in 32us (2149us total) trans 0 rc 0/0 00000100:00100000:0.0:1789136305.135801:0:23334:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1789136305.135814:0:23334:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1789136305.135821:0:23334:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7fa3bed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1876044666921216:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789136305.135849:0:23334:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7fa3bed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1876044666921216:12345-0@lo:400:kworker.0 Request processed in 30us (2117us total) trans 0 rc 0/0 00000100:00100000:0.0:1789136305.135878:0:23334:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00080000:0.0:1789136305.135901:0:23328:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789136305.135906:0:23328:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789136305.135908:0:23328:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:0.0:1789136305.135937:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90a6c1099e00 x1876044666921216/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789136321 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789136305.135959:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c1099e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3641:1876044666921216:0@lo:400:kworker.0 00010000:00080000:0.0:1789136305.135984:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90a6c109a580 x1876044666920704/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789136321 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789136305.135993:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c109a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3641:1876044666920704:0@lo:400:kworker.0 00010000:00080000:0.0:1789136305.136003:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90a6c1099a40 x1876044666921344/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789136321 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789136305.136010:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c1099a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3641:1876044666921344:0@lo:400:kworker.0 00010000:00080000:3.0:1789136305.136190:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90a6c10992c0 x1876044666921472/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789136321 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789136305.136200:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c10992c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3638:1876044666921472:0@lo:400:kworker.0 00000100:00100000:1.0:1789136305.136387:0:23338:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c1098780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3638:x1876044666920832:12345-0@lo:400:kworker.0 Request processed in 2367us (3027us total) trans 0 rc 0/0 00000100:00100000:1.0:1789136305.136396:0:23338:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1789136305.136417:0:23338:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1789136305.136425:0:23338:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7ff64ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3641:x1876044666920320:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789136305.136471:0:23338:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7ff64ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3641:x1876044666920320:12345-0@lo:400:kworker.0 Request processed in 47us (2779us total) trans 0 rc 0/0 00000100:00100000:1.0:1789136305.136478:0:23338:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1789136305.136783:0:24847:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:1.0:1789136305.136791:0:24847:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00000100:00100000:1.0:1789136305.136910:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c1098b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b11da215-324d-4c8d-90a5-0b7f26186c4c:3639:1876044666920192:0@lo:400:kworker.0 00000100:00100000:1.0:1789136305.136954:0:24847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666920448 00000100:00100000:1.0:1789136305.136959:0:24847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666920448 00000100:00100000:1.0:1789136305.136985:0:24847:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:1.0:1789136305.136992:0:24847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666920576 00000100:00100000:1.0:1789136305.136994:0:24847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666920576 00000100:00100000:1.0:1789136305.137002:0:24847:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:1.0:1789136305.137006:0:24847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666921088 00000100:00100000:1.0:1789136305.137007:0:24847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666921088 00000100:00100000:1.0:1789136305.137014:0:24847:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:1.0:1789136305.137020:0:24847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1789136305.137024:0:24847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7fa3bcb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3637:x1876044666920448:12345-0@lo:8:kworker.0 00010000:00080000:1.0:1789136305.137064:0:24847:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 753 last 0 00000020:00000080:1.0:1789136305.137087:0:24847:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x559c8745c6de46cc 00002000:00100000:1.0:1789136305.137101:0:24847:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff90a6c443a000 ocd_connect_flags: 0xa044401443000026 ocd_version: 211397f ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:1.0:1789136305.137113:0:24847:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00002000:00100000:1.0:1789136305.137115:0:24847:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:1.0:1789136305.137190:0:24847:0:(ofd_obd.c:389:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00100000:0.0:1789136305.137767:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c109b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1876044666920320:0@lo:400:kworker.0 00000100:00080000:1.0:1789136305.137885:0:24847:0:(import.c:65:import_set_state_nolock()) ffff90a6c443f800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789136305.137960:0:24847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7fa3bcb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3637:x1876044666920448:12345-0@lo:8:kworker.0 Request processed in 934us (2500us total) trans 0 rc 0/0 00000100:00100000:1.0:1789136305.137968:0:24847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1789136305.137998:0:24847:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:1.0:1789136305.138011:0:24847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1789136305.138016:0:24847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7fa3bde00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3637:x1876044666920576:12345-0@lo:8:kworker.0 00010000:00020000:1.0:1789136305.138031:0:24847:0:(ldlm_lib.c:1228:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1789136305.138062:0:24847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7fa3bde00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3637:x1876044666920576:12345-0@lo:8:kworker.0 Request processed in 45us (2527us total) trans 0 rc -19/-19 00000100:00100000:1.0:1789136305.138067:0:24847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1789136305.138077:0:24847:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:1.0:1789136305.138082:0:24847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1789136305.138086:0:24847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7fa3bc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3637:x1876044666921088:12345-0@lo:8:kworker.0 00010000:00020000:1.0:1789136305.138095:0:24847:0:(ldlm_lib.c:1228:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1789136305.138119:0:24847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7fa3bc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3637:x1876044666921088:12345-0@lo:8:kworker.0 Request processed in 32us (2552us total) trans 0 rc -19/-19 00000100:00100000:1.0:1789136305.138123:0:24847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:0.0:1789136305.138967:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90a6c109bc00 x1876044666920448/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1789136330 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789136305.138990:0:3637:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1789136305.138999:0:3637:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 3 00000100:00080000:0.0:1789136305.139008:0:3637:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:0.0:1789136305.139014:0:3637:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:0.0:1789136305.139017:0:3637:0:(import.c:65:import_set_state_nolock()) ffff90a7ff553800 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:0.0:1789136305.139035:0:3637:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:0.0:1789136305.139040:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c109bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3637:1876044666920448:0@lo:8:kworker.0 00000100:00080000:0.0:1789136305.139054:0:3637:0:(import.c:65:import_set_state_nolock()) ffff90a6c228c000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1789136305.139058:0:3637:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1789136305.139061:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c1099680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3637:1876044666920576:0@lo:8:kworker.0 00000100:00080000:0.0:1789136305.139075:0:3637:0:(import.c:65:import_set_state_nolock()) ffff90a7d8b2a800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1789136305.139079:0:3637:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1789136305.139092:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c109a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3637:1876044666921088:0@lo:8:kworker.0 00000100:00100000:2.0:1789136305.139319:0:24846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7f662f0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3638:x1876044666920960:12345-0@lo:400:kworker.0 Request processed in 4168us (5414us total) trans 0 rc 0/0 00000100:00100000:2.0:1789136305.139329:0:24846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000004:00080000:2.0:1789136305.139523:0:23358:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x280000401:0x22:0x0] 00000100:00100000:2.0:1789136305.139545:0:23358:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c4761a40 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:23358:1876044666921728:0@lo:5:osp-pre-0-0.0 00000100:00100000:2.0:1789136305.139583:0:23358:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789136305.139609:0:23358:0:(client.c:2715:ptlrpc_set_wait()) set ffff90a7c78e6600 going to sleep for 11 seconds 00000100:00100000:2.0:1789136305.139624:0:24847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666921728 00000100:00100000:2.0:1789136305.139629:0:24847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666921728 00000100:00100000:2.0:1789136305.139670:0:24847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1789136305.139677:0:24847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c47612c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:23358:x1876044666921728:12345-0@lo:5:osp-pre-0-0.0 00000100:00100000:0.0:1789136305.140171:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c4761680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1876044666921600:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789136305.140206:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1789136305.140254:0:23328:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789136305.142737:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c109b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1876044666920832:0@lo:400:kworker.0 00010000:00080000:3.0:1789136305.142772:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90a6c1098f00 x1876044666920960/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789136321 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789136305.142783:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c1098f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1876044666920960:0@lo:400:kworker.0 00000004:00080000:3.0:1789136305.142805:0:23357:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:3.0:1789136305.142913:0:23357:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 753262057363ns, next at 0ns, rc = 0 00080000:00080000:3.0:1789136305.142919:0:23357:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0000: async commit OSD 00000100:00100000:3.0:1789136305.142949:0:24848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666921600 00000100:00100000:3.0:1789136305.142956:0:24848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666921600 00000100:00100000:3.0:1789136305.143011:0:24848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1789136305.143021:0:24848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c3cea1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3639:x1876044666921600:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789136305.143732:0:24848:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3915853824 avail 3684331520 00000100:00100000:3.0:1789136305.143815:0:24848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c3cea1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3639:x1876044666921600:12345-0@lo:13:osp-pre-0-0.0 Request processed in 793us (3606us total) trans 0 rc 0/0 00000100:00100000:3.0:1789136305.143823:0:24848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1789136305.145427:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90a6c4761680 x1876044666921600/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789136321 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789136305.145452:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c4761680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1876044666921600:0@lo:13:osp-pre-0-0.0 00002000:00080000:2.0:1789136305.146623:0:24847:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x280000401 00002000:00080000:2.0:1789136305.146632:0:24847:0:(ofd_dev.c:1654:ofd_create_hdl()) ofd_last_id() = 65 -> diff = -31 00002000:02000040:2.0:1789136305.146638:0:24847:0:(ofd_dev.c:1505:ofd_orphans_destroy()) lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:35 to 0x280000401:65) 00000004:00080000:3.0:1789136305.147542:0:23312:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00002000:00010000:2.0:1789136305.155145:0:24847:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x41:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1789136305.155158:0:24847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000ae5a170/0x559c8745c6de46d3 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136305.155175:0:24847:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x41:0x0].0x0 since=753s v=(0 0) 00010000:00010000:2.0:1789136305.155180:0:24847:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x41:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789136305.155187:0:24847:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000ae5a170/0x559c8745c6de46d3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136305.155204:0:24847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000ae5a170/0x559c8745c6de46d3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136305.155239:0:24847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000ae5a170/0x559c8745c6de46d3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136305.155247:0:24847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000ae5a170/0x559c8745c6de46d3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136305.155271:0:24847:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789136305.155559:0:23321:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789136305.155567:0:23321:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000ae5a170/0x559c8745c6de46d3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136305.155576:0:23321:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a7d1878200 already unused, calling callback (ffffffffc0dbf540) 00010000:00010000:0.0:1789136305.155580:0:23321:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000ae5a170/0x559c8745c6de46d3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136305.155590:0:23321:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000ae5a170/0x559c8745c6de46d3 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136305.155609:0:23321:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000ae5a170/0x559c8745c6de46d3 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136305.155617:0:23321:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000ae5a170/0x559c8745c6de46d3 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136305.155634:0:23321:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789136305.155636:0:23321:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789136305.155637:0:23321:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789136305.155835:0:24847:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x40:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1789136305.155841:0:24847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000630d6314/0x559c8745c6de46da lrc: 3/0,1 mode: --/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136305.155850:0:24847:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x40:0x0].0x0 since=753s v=(0 0) 00010000:00010000:2.0:1789136305.155882:0:24847:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x40:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789136305.155887:0:24847:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000630d6314/0x559c8745c6de46da lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136305.155897:0:24847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000630d6314/0x559c8745c6de46da lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136305.155905:0:24847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000630d6314/0x559c8745c6de46da lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136305.155913:0:24847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000630d6314/0x559c8745c6de46da lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136305.155939:0:24847:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789136305.156120:0:23320:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789136305.156126:0:23320:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000630d6314/0x559c8745c6de46da lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136305.156144:0:23320:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a7d1879600 already unused, calling callback (ffffffffc0dbf540) 00010000:00010000:0.0:1789136305.156148:0:23320:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000630d6314/0x559c8745c6de46da lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136305.156156:0:23320:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000630d6314/0x559c8745c6de46da lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136305.156168:0:23320:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000630d6314/0x559c8745c6de46da lrc: 1/0,0 mode: --/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136305.156176:0:23320:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000630d6314/0x559c8745c6de46da lrc: 0/0,0 mode: --/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136305.156188:0:23320:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789136305.156189:0:23320:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789136305.156190:0:23320:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789136305.156466:0:24847:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1789136305.156472:0:24847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000099f7d35b/0x559c8745c6de46e1 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136305.156481:0:24847:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3f:0x0].0x0 since=753s v=(0 0) 00010000:00010000:2.0:1789136305.156484:0:24847:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789136305.156488:0:24847:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000099f7d35b/0x559c8745c6de46e1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136305.156497:0:24847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000099f7d35b/0x559c8745c6de46e1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136305.156504:0:24847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000099f7d35b/0x559c8745c6de46e1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136305.156512:0:24847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000099f7d35b/0x559c8745c6de46e1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136305.156531:0:24847:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789136305.156748:0:23321:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789136305.156753:0:23321:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000099f7d35b/0x559c8745c6de46e1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136305.156761:0:23321:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a7d1878a00 already unused, calling callback (ffffffffc0dbf540) 00010000:00010000:0.0:1789136305.156764:0:23321:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000099f7d35b/0x559c8745c6de46e1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136305.156772:0:23321:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000099f7d35b/0x559c8745c6de46e1 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136305.156789:0:23321:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000099f7d35b/0x559c8745c6de46e1 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136305.156797:0:23321:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000099f7d35b/0x559c8745c6de46e1 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136305.156811:0:23321:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789136305.156812:0:23321:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789136305.156813:0:23321:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789136305.156967:0:24847:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1789136305.156973:0:24847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d81a9ff5/0x559c8745c6de46e8 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136305.156993:0:24847:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3e:0x0].0x0 since=753s v=(0 0) 00010000:00010000:2.0:1789136305.157001:0:24847:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789136305.157006:0:24847:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d81a9ff5/0x559c8745c6de46e8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136305.157015:0:24847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d81a9ff5/0x559c8745c6de46e8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136305.157023:0:24847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d81a9ff5/0x559c8745c6de46e8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136305.157030:0:24847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d81a9ff5/0x559c8745c6de46e8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136305.157043:0:24847:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1789136305.157351:0:24847:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1789136305.157358:0:24847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004e998057/0x559c8745c6de46ef lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136305.157366:0:24847:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3d:0x0].0x0 since=753s v=(0 0) 00010000:00010000:2.0:1789136305.157368:0:24847:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789136305.157372:0:24847:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004e998057/0x559c8745c6de46ef lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136305.157381:0:24847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004e998057/0x559c8745c6de46ef lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136305.157389:0:24847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004e998057/0x559c8745c6de46ef lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136305.157403:0:24847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004e998057/0x559c8745c6de46ef lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136305.157499:0:24847:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:2.0:1789136305.157758:0:24847:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1789136305.157764:0:24847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ba12fccc/0x559c8745c6de46f6 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136305.157773:0:24847:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3c:0x0].0x0 since=753s v=(0 0) 00010000:00010000:2.0:1789136305.157777:0:24847:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789136305.157781:0:24847:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ba12fccc/0x559c8745c6de46f6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136305.157790:0:24847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ba12fccc/0x559c8745c6de46f6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136305.157798:0:24847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ba12fccc/0x559c8745c6de46f6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136305.157806:0:24847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ba12fccc/0x559c8745c6de46f6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136305.158405:0:23321:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1789136305.158418:0:23321:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d81a9ff5/0x559c8745c6de46e8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136305.158427:0:23321:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a7d1879800 already unused, calling callback (ffffffffc0dbf540) 00010000:00010000:3.0:1789136305.158431:0:23321:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d81a9ff5/0x559c8745c6de46e8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136305.158439:0:23321:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d81a9ff5/0x559c8745c6de46e8 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136305.158457:0:23321:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d81a9ff5/0x559c8745c6de46e8 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136305.158464:0:23321:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d81a9ff5/0x559c8745c6de46e8 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136305.158480:0:23321:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1789136305.158484:0:23321:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004e998057/0x559c8745c6de46ef lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136305.158490:0:23321:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a7d1878800 already unused, calling callback (ffffffffc0dbf540) 00010000:00010000:3.0:1789136305.158494:0:23321:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004e998057/0x559c8745c6de46ef lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136305.158501:0:23321:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004e998057/0x559c8745c6de46ef lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136305.158521:0:23321:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004e998057/0x559c8745c6de46ef lrc: 1/0,0 mode: --/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136305.158528:0:23321:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004e998057/0x559c8745c6de46ef lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136305.158540:0:23321:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789136305.158543:0:23321:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ba12fccc/0x559c8745c6de46f6 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136305.158548:0:23321:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a7d1878000 already unused, calling callback (ffffffffc0dbf540) 00010000:00010000:3.0:1789136305.158552:0:23321:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ba12fccc/0x559c8745c6de46f6 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136305.158559:0:23321:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ba12fccc/0x559c8745c6de46f6 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136305.158566:0:23321:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ba12fccc/0x559c8745c6de46f6 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136305.158573:0:23321:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789136305.158574:0:23321:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789136305.158576:0:23321:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789136305.158631:0:23320:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789136305.162265:0:24847:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1789136305.162282:0:24847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ba12fccc/0x559c8745c6de46f6 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136305.162590:0:23321:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789136305.162949:0:24847:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1789136305.162958:0:24847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006f08e423/0x559c8745c6de46fd lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136305.162972:0:24847:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3b:0x0].0x0 since=753s v=(0 0) 00010000:00010000:2.0:1789136305.162988:0:24847:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789136305.162995:0:24847:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006f08e423/0x559c8745c6de46fd lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136305.163010:0:24847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006f08e423/0x559c8745c6de46fd lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136305.163019:0:24847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006f08e423/0x559c8745c6de46fd lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136305.163026:0:24847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006f08e423/0x559c8745c6de46fd lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136305.163046:0:24847:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789136305.163262:0:23320:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789136305.163269:0:23320:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006f08e423/0x559c8745c6de46fd lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136305.163284:0:23320:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a7d1879a00 already unused, calling callback (ffffffffc0dbf540) 00010000:00010000:3.0:1789136305.163288:0:23320:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006f08e423/0x559c8745c6de46fd lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136305.163299:0:23320:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006f08e423/0x559c8745c6de46fd lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136305.163317:0:23320:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006f08e423/0x559c8745c6de46fd lrc: 1/0,0 mode: --/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136305.163324:0:23320:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006f08e423/0x559c8745c6de46fd lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136305.163340:0:23320:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789136305.163342:0:23320:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789136305.163344:0:23320:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789136305.163531:0:24847:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1789136305.163537:0:24847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001fb160f8/0x559c8745c6de4704 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136305.163547:0:24847:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3a:0x0].0x0 since=753s v=(0 0) 00010000:00010000:2.0:1789136305.163550:0:24847:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789136305.163562:0:24847:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001fb160f8/0x559c8745c6de4704 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136305.163572:0:24847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001fb160f8/0x559c8745c6de4704 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136305.163581:0:24847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001fb160f8/0x559c8745c6de4704 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136305.163590:0:24847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001fb160f8/0x559c8745c6de4704 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136305.163610:0:24847:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789136305.163771:0:23321:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789136305.163777:0:23321:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001fb160f8/0x559c8745c6de4704 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136305.163786:0:23321:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a7d1878600 already unused, calling callback (ffffffffc0dbf540) 00010000:00010000:3.0:1789136305.163790:0:23321:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001fb160f8/0x559c8745c6de4704 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136305.163799:0:23321:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001fb160f8/0x559c8745c6de4704 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136305.163817:0:23321:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001fb160f8/0x559c8745c6de4704 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136305.163825:0:23321:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001fb160f8/0x559c8745c6de4704 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136305.163841:0:23321:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789136305.163843:0:23321:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789136305.163845:0:23321:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789136305.164025:0:24847:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x39:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1789136305.164031:0:24847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000457375d3/0x559c8745c6de470b lrc: 3/0,1 mode: --/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136305.164041:0:24847:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x39:0x0].0x0 since=753s v=(0 0) 00010000:00010000:2.0:1789136305.164045:0:24847:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x39:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789136305.164049:0:24847:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000457375d3/0x559c8745c6de470b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136305.164059:0:24847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000457375d3/0x559c8745c6de470b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136305.164068:0:24847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000457375d3/0x559c8745c6de470b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136305.164087:0:24847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000457375d3/0x559c8745c6de470b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136305.164107:0:24847:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789136305.164326:0:23320:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789136305.164331:0:23320:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000457375d3/0x559c8745c6de470b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136305.164338:0:23320:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a7d1879c00 already unused, calling callback (ffffffffc0dbf540) 00010000:00010000:3.0:1789136305.164341:0:23320:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000457375d3/0x559c8745c6de470b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136305.164348:0:23320:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000457375d3/0x559c8745c6de470b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136305.164360:0:23320:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000457375d3/0x559c8745c6de470b lrc: 1/0,0 mode: --/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136305.164367:0:23320:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000457375d3/0x559c8745c6de470b lrc: 0/0,0 mode: --/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136305.164393:0:23320:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789136305.164395:0:23320:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789136305.164396:0:23320:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789136305.164469:0:24847:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x38:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1789136305.164474:0:24847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000089b8808b/0x559c8745c6de4712 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136305.164483:0:24847:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x38:0x0].0x0 since=753s v=(0 0) 00010000:00010000:2.0:1789136305.164486:0:24847:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x38:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789136305.164490:0:24847:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000089b8808b/0x559c8745c6de4712 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136305.164499:0:24847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000089b8808b/0x559c8745c6de4712 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136305.164506:0:24847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000089b8808b/0x559c8745c6de4712 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136305.164513:0:24847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000089b8808b/0x559c8745c6de4712 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136305.164565:0:24847:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1789136305.165063:0:24847:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x37:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1789136305.165070:0:24847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d51ad772/0x559c8745c6de4719 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136305.165084:0:24847:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x37:0x0].0x0 since=753s v=(0 0) 00010000:00010000:2.0:1789136305.165088:0:24847:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x37:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789136305.165093:0:24847:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d51ad772/0x559c8745c6de4719 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136305.165103:0:24847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d51ad772/0x559c8745c6de4719 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136305.165112:0:24847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d51ad772/0x559c8745c6de4719 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136305.165120:0:24847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d51ad772/0x559c8745c6de4719 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136305.170150:0:23321:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1789136305.170166:0:23321:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000089b8808b/0x559c8745c6de4712 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136305.170181:0:23321:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a7c0031e00 already unused, calling callback (ffffffffc0dbf540) 00010000:00010000:3.0:1789136305.170186:0:23321:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000089b8808b/0x559c8745c6de4712 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136305.170198:0:23321:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000089b8808b/0x559c8745c6de4712 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136305.170230:0:23321:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000089b8808b/0x559c8745c6de4712 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136305.170237:0:23321:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000089b8808b/0x559c8745c6de4712 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136305.170418:0:24847:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789136305.170432:0:23321:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789136305.170437:0:23321:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d51ad772/0x559c8745c6de4719 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136305.170444:0:23321:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a7c0031000 already unused, calling callback (ffffffffc0dbf540) 00010000:00010000:2.0:1789136305.170448:0:23321:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d51ad772/0x559c8745c6de4719 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136305.170456:0:23321:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d51ad772/0x559c8745c6de4719 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136305.170488:0:23321:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d51ad772/0x559c8745c6de4719 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136305.170496:0:23321:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d51ad772/0x559c8745c6de4719 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136305.170510:0:23321:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789136305.170511:0:23321:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789136305.170513:0:23321:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789136305.170925:0:23320:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789136305.171040:0:24847:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x36:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1789136305.171142:0:24847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003cb87d39/0x559c8745c6de4720 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136305.171153:0:24847:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x36:0x0].0x0 since=753s v=(0 0) 00010000:00010000:2.0:1789136305.171158:0:24847:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x36:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789136305.171164:0:24847:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003cb87d39/0x559c8745c6de4720 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136305.171176:0:24847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003cb87d39/0x559c8745c6de4720 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136305.171185:0:24847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003cb87d39/0x559c8745c6de4720 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136305.171193:0:24847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003cb87d39/0x559c8745c6de4720 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136305.171298:0:24847:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1789136305.174284:0:24847:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x35:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1789136305.174297:0:24847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000167cce62/0x559c8745c6de4727 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136305.174314:0:24847:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x35:0x0].0x0 since=753s v=(0 0) 00010000:00010000:0.0:1789136305.174319:0:24847:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x35:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789136305.174325:0:24847:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000167cce62/0x559c8745c6de4727 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136305.174339:0:24847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000167cce62/0x559c8745c6de4727 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136305.174348:0:24847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000167cce62/0x559c8745c6de4727 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136305.174356:0:24847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000167cce62/0x559c8745c6de4727 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136305.177172:0:23321:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1789136305.177188:0:23321:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003cb87d39/0x559c8745c6de4720 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136305.177203:0:23321:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a7c0030200 already unused, calling callback (ffffffffc0dbf540) 00010000:00010000:3.0:1789136305.177228:0:23321:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003cb87d39/0x559c8745c6de4720 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136305.177240:0:23321:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003cb87d39/0x559c8745c6de4720 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136305.177268:0:23321:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003cb87d39/0x559c8745c6de4720 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136305.177275:0:23321:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003cb87d39/0x559c8745c6de4720 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136305.177301:0:23321:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789136305.177306:0:23321:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000167cce62/0x559c8745c6de4727 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136305.177313:0:23321:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a6c3cae400 already unused, calling callback (ffffffffc0dbf540) 00010000:00010000:3.0:1789136305.177315:0:23321:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000167cce62/0x559c8745c6de4727 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136305.177322:0:23321:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000167cce62/0x559c8745c6de4727 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136305.177332:0:23321:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000167cce62/0x559c8745c6de4727 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136305.177339:0:23321:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789136305.177347:0:23321:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789136305.177349:0:23321:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789136305.180167:0:24847:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1789136305.180189:0:24847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000167cce62/0x559c8745c6de4727 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136305.180785:0:23320:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1789136305.181318:0:24847:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x34:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1789136305.181327:0:24847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f1d20fab/0x559c8745c6de472e lrc: 3/0,1 mode: --/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136305.181342:0:24847:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x34:0x0].0x0 since=753s v=(0 0) 00010000:00010000:0.0:1789136305.181347:0:24847:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x34:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789136305.181354:0:24847:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f1d20fab/0x559c8745c6de472e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136305.181367:0:24847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f1d20fab/0x559c8745c6de472e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136305.181378:0:24847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f1d20fab/0x559c8745c6de472e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136305.181386:0:24847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f1d20fab/0x559c8745c6de472e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136305.181400:0:24847:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789136305.181676:0:23321:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789136305.181683:0:23321:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f1d20fab/0x559c8745c6de472e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136305.181690:0:23321:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a6c3caf800 already unused, calling callback (ffffffffc0dbf540) 00010000:00010000:3.0:1789136305.181694:0:23321:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f1d20fab/0x559c8745c6de472e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136305.181703:0:23321:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f1d20fab/0x559c8745c6de472e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136305.181721:0:23321:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f1d20fab/0x559c8745c6de472e lrc: 1/0,0 mode: --/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136305.181728:0:23321:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f1d20fab/0x559c8745c6de472e lrc: 0/0,0 mode: --/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136305.181744:0:23321:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789136305.181745:0:23321:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789136305.181747:0:23321:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1789136305.185056:0:24847:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x33:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1789136305.185071:0:24847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005f67a701/0x559c8745c6de4735 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136305.185102:0:24847:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x33:0x0].0x0 since=753s v=(0 0) 00010000:00010000:0.0:1789136305.185108:0:24847:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x33:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789136305.185116:0:24847:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005f67a701/0x559c8745c6de4735 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136305.185133:0:24847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005f67a701/0x559c8745c6de4735 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136305.185144:0:24847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005f67a701/0x559c8745c6de4735 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136305.185152:0:24847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005f67a701/0x559c8745c6de4735 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136305.185174:0:24847:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1789136305.186300:0:24847:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x32:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789136305.186309:0:24847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000caa63a15/0x559c8745c6de473c lrc: 3/0,1 mode: --/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136305.186321:0:24847:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x32:0x0].0x0 since=753s v=(0 0) 00010000:00010000:3.0:1789136305.186333:0:24847:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x32:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789136305.186339:0:24847:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000caa63a15/0x559c8745c6de473c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136305.186350:0:24847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000caa63a15/0x559c8745c6de473c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136305.186358:0:24847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000caa63a15/0x559c8745c6de473c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136305.186364:0:24847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000caa63a15/0x559c8745c6de473c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136305.186378:0:24847:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1789136305.186388:0:23321:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1789136305.186393:0:23321:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005f67a701/0x559c8745c6de4735 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136305.186400:0:23321:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a6c3caea00 already unused, calling callback (ffffffffc0dbf540) 00010000:00010000:3.0:1789136305.186404:0:23321:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005f67a701/0x559c8745c6de4735 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136305.186413:0:23321:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005f67a701/0x559c8745c6de4735 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136305.186429:0:23321:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005f67a701/0x559c8745c6de4735 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136305.186447:0:23321:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005f67a701/0x559c8745c6de4735 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136305.186463:0:23321:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789136305.186466:0:23321:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000caa63a15/0x559c8745c6de473c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136305.186471:0:23321:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a7e1c9fc00 already unused, calling callback (ffffffffc0dbf540) 00010000:00010000:3.0:1789136305.186474:0:23321:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000caa63a15/0x559c8745c6de473c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136305.186481:0:23321:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000caa63a15/0x559c8745c6de473c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136305.186489:0:23321:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000caa63a15/0x559c8745c6de473c lrc: 1/0,0 mode: --/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136305.186496:0:23321:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000caa63a15/0x559c8745c6de473c lrc: 0/0,0 mode: --/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136305.186506:0:23321:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789136305.186508:0:23321:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789136305.186509:0:23321:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789136305.186905:0:24847:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x31:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789136305.186911:0:24847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b31baa1e/0x559c8745c6de4743 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136305.186925:0:24847:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x31:0x0].0x0 since=753s v=(0 0) 00010000:00010000:3.0:1789136305.186928:0:24847:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x31:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789136305.186932:0:24847:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b31baa1e/0x559c8745c6de4743 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136305.186940:0:24847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b31baa1e/0x559c8745c6de4743 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136305.186948:0:24847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b31baa1e/0x559c8745c6de4743 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136305.186955:0:24847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b31baa1e/0x559c8745c6de4743 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136305.186967:0:24847:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789136305.186985:0:23321:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789136305.186989:0:23321:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b31baa1e/0x559c8745c6de4743 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136305.186994:0:23321:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a7e1c9f200 already unused, calling callback (ffffffffc0dbf540) 00010000:00010000:3.0:1789136305.186997:0:23321:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b31baa1e/0x559c8745c6de4743 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136305.187004:0:23321:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b31baa1e/0x559c8745c6de4743 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136305.187026:0:23321:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b31baa1e/0x559c8745c6de4743 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136305.187032:0:23321:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b31baa1e/0x559c8745c6de4743 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136305.187046:0:23321:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789136305.187048:0:23321:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789136305.187050:0:23321:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789136305.188397:0:24847:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x30:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789136305.188408:0:24847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006c9bdf8c/0x559c8745c6de474a lrc: 3/0,1 mode: --/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136305.188421:0:24847:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x30:0x0].0x0 since=753s v=(0 0) 00010000:00010000:3.0:1789136305.188425:0:24847:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x30:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789136305.188431:0:24847:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006c9bdf8c/0x559c8745c6de474a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136305.188442:0:24847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006c9bdf8c/0x559c8745c6de474a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136305.188452:0:24847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006c9bdf8c/0x559c8745c6de474a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136305.188460:0:24847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006c9bdf8c/0x559c8745c6de474a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136305.188490:0:24847:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789136305.188501:0:23321:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789136305.188505:0:23321:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006c9bdf8c/0x559c8745c6de474a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136305.188513:0:23321:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a7e1c9f800 already unused, calling callback (ffffffffc0dbf540) 00010000:00010000:3.0:1789136305.188516:0:23321:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006c9bdf8c/0x559c8745c6de474a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136305.188525:0:23321:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006c9bdf8c/0x559c8745c6de474a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136305.188538:0:23321:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006c9bdf8c/0x559c8745c6de474a lrc: 1/0,0 mode: --/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136305.188545:0:23321:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006c9bdf8c/0x559c8745c6de474a lrc: 0/0,0 mode: --/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136305.188560:0:23321:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789136305.188562:0:23321:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789136305.188563:0:23321:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789136305.189017:0:23320:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789136305.189597:0:24847:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789136305.189606:0:24847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e6a3ce05/0x559c8745c6de4751 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136305.189619:0:24847:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2f:0x0].0x0 since=753s v=(0 0) 00010000:00010000:3.0:1789136305.189648:0:24847:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789136305.189654:0:24847:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e6a3ce05/0x559c8745c6de4751 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136305.189665:0:24847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e6a3ce05/0x559c8745c6de4751 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136305.189675:0:24847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e6a3ce05/0x559c8745c6de4751 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136305.189682:0:24847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e6a3ce05/0x559c8745c6de4751 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136305.189723:0:24847:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1789136305.190091:0:24847:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789136305.190097:0:24847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000021abfc9d/0x559c8745c6de4758 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136305.190105:0:24847:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2e:0x0].0x0 since=753s v=(0 0) 00010000:00010000:3.0:1789136305.190108:0:24847:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789136305.190113:0:24847:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000021abfc9d/0x559c8745c6de4758 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136305.190121:0:24847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000021abfc9d/0x559c8745c6de4758 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136305.190128:0:24847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000021abfc9d/0x559c8745c6de4758 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136305.190142:0:24847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000021abfc9d/0x559c8745c6de4758 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136305.190156:0:24847:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1789136305.190395:0:23321:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1789136305.190409:0:23321:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e6a3ce05/0x559c8745c6de4751 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136305.190417:0:23321:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a7e1c9ea00 already unused, calling callback (ffffffffc0dbf540) 00010000:00010000:1.0:1789136305.190421:0:23321:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e6a3ce05/0x559c8745c6de4751 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136305.190432:0:23321:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e6a3ce05/0x559c8745c6de4751 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136305.190451:0:23321:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e6a3ce05/0x559c8745c6de4751 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136305.190459:0:23321:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e6a3ce05/0x559c8745c6de4751 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136305.190477:0:23321:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789136305.190481:0:23321:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000021abfc9d/0x559c8745c6de4758 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136305.190487:0:23321:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a7e1c9e800 already unused, calling callback (ffffffffc0dbf540) 00010000:00010000:1.0:1789136305.190490:0:23321:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000021abfc9d/0x559c8745c6de4758 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136305.190498:0:23321:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000021abfc9d/0x559c8745c6de4758 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136305.190520:0:23321:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000021abfc9d/0x559c8745c6de4758 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136305.190528:0:23321:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000021abfc9d/0x559c8745c6de4758 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136305.190540:0:23321:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789136305.190542:0:23321:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789136305.190544:0:23321:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789136305.190899:0:23320:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789136305.191195:0:24847:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789136305.191206:0:24847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003fdbfcc3/0x559c8745c6de475f lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136305.194065:0:24847:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2d:0x0].0x0 since=753s v=(0 0) 00010000:00010000:3.0:1789136305.194071:0:24847:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789136305.194080:0:24847:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003fdbfcc3/0x559c8745c6de475f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136305.194098:0:24847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003fdbfcc3/0x559c8745c6de475f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136305.194109:0:24847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003fdbfcc3/0x559c8745c6de475f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136305.194116:0:24847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003fdbfcc3/0x559c8745c6de475f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136305.194623:0:24847:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789136305.195072:0:23321:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789136305.195080:0:23321:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003fdbfcc3/0x559c8745c6de475f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136305.195090:0:23321:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a7e1c9e600 already unused, calling callback (ffffffffc0dbf540) 00010000:00010000:2.0:1789136305.195094:0:23321:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003fdbfcc3/0x559c8745c6de475f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136305.195104:0:23321:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003fdbfcc3/0x559c8745c6de475f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136305.195123:0:23321:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003fdbfcc3/0x559c8745c6de475f lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136305.195131:0:23321:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003fdbfcc3/0x559c8745c6de475f lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136305.195154:0:23321:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789136305.195156:0:23321:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789136305.195158:0:23321:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789136305.195519:0:24847:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1789136305.195527:0:24847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a81de015/0x559c8745c6de4766 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136305.195538:0:24847:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2c:0x0].0x0 since=753s v=(0 0) 00010000:00010000:1.0:1789136305.195543:0:24847:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789136305.195549:0:24847:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a81de015/0x559c8745c6de4766 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136305.195559:0:24847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a81de015/0x559c8745c6de4766 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136305.195566:0:24847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a81de015/0x559c8745c6de4766 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136305.195573:0:24847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a81de015/0x559c8745c6de4766 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136305.195605:0:24847:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789136305.196099:0:23320:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789136305.196106:0:23320:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a81de015/0x559c8745c6de4766 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136305.196125:0:23320:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a7c167d200 already unused, calling callback (ffffffffc0dbf540) 00010000:00010000:2.0:1789136305.196128:0:23320:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a81de015/0x559c8745c6de4766 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136305.196136:0:23320:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a81de015/0x559c8745c6de4766 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136305.196150:0:23320:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a81de015/0x559c8745c6de4766 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136305.196157:0:23320:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a81de015/0x559c8745c6de4766 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136305.196173:0:23320:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789136305.196175:0:23320:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789136305.196178:0:23320:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789136305.196426:0:24847:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1789136305.196433:0:24847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000173a0e3c/0x559c8745c6de476d lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136305.196442:0:24847:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2b:0x0].0x0 since=753s v=(0 0) 00010000:00010000:1.0:1789136305.196445:0:24847:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789136305.196450:0:24847:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000173a0e3c/0x559c8745c6de476d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136305.196460:0:24847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000173a0e3c/0x559c8745c6de476d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136305.196467:0:24847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000173a0e3c/0x559c8745c6de476d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136305.196475:0:24847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000173a0e3c/0x559c8745c6de476d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136305.196494:0:24847:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789136305.196884:0:23321:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789136305.196890:0:23321:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000173a0e3c/0x559c8745c6de476d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136305.196899:0:23321:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a7c167c800 already unused, calling callback (ffffffffc0dbf540) 00010000:00010000:2.0:1789136305.196902:0:23321:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000173a0e3c/0x559c8745c6de476d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136305.196910:0:23321:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000173a0e3c/0x559c8745c6de476d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136305.196933:0:23321:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000173a0e3c/0x559c8745c6de476d lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136305.196941:0:23321:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000173a0e3c/0x559c8745c6de476d lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136305.196955:0:23321:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789136305.196957:0:23321:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789136305.196959:0:23321:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789136305.197164:0:24847:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1789136305.197170:0:24847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000075625b9/0x559c8745c6de4774 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136305.197180:0:24847:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2a:0x0].0x0 since=753s v=(0 0) 00010000:00010000:1.0:1789136305.197190:0:24847:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789136305.197195:0:24847:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000075625b9/0x559c8745c6de4774 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136305.197204:0:24847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000075625b9/0x559c8745c6de4774 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136305.197276:0:24847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000075625b9/0x559c8745c6de4774 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136305.197283:0:24847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000075625b9/0x559c8745c6de4774 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136305.197478:0:24847:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1789136305.204033:0:24847:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x29:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1789136305.204057:0:24847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000167cce62/0x559c8745c6de477b lrc: 3/0,1 mode: --/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136305.204075:0:24847:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x29:0x0].0x0 since=753s v=(0 0) 00010000:00010000:0.0:1789136305.204080:0:24847:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x29:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789136305.204085:0:24847:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000167cce62/0x559c8745c6de477b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136305.204099:0:24847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000167cce62/0x559c8745c6de477b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136305.204124:0:24847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000167cce62/0x559c8745c6de477b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136305.204133:0:24847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000167cce62/0x559c8745c6de477b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136305.204492:0:23320:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1789136305.204500:0:23320:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000075625b9/0x559c8745c6de4774 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136305.204509:0:23320:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a7c167ca00 already unused, calling callback (ffffffffc0dbf540) 00010000:00010000:2.0:1789136305.204513:0:23320:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000075625b9/0x559c8745c6de4774 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136305.204524:0:23320:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000075625b9/0x559c8745c6de4774 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136305.204541:0:23320:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000075625b9/0x559c8745c6de4774 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136305.204549:0:23320:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000075625b9/0x559c8745c6de4774 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136305.204577:0:23320:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789136305.204580:0:23320:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000167cce62/0x559c8745c6de477b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136305.204587:0:23320:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a6c3cae400 already unused, calling callback (ffffffffc0dbf540) 00010000:00010000:2.0:1789136305.204590:0:23320:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000167cce62/0x559c8745c6de477b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136305.204598:0:23320:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000167cce62/0x559c8745c6de477b lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136305.204608:0:23320:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000167cce62/0x559c8745c6de477b lrc: 2/0,0 mode: --/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136305.204616:0:23320:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789136305.204617:0:23320:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789136305.204619:0:23320:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789136305.204725:0:24847:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1789136305.204731:0:24847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000167cce62/0x559c8745c6de477b lrc: 0/0,0 mode: --/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136305.204937:0:23321:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1789136305.205646:0:24847:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x28:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1789136305.205656:0:24847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005f67a701/0x559c8745c6de4782 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136305.205671:0:24847:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x28:0x0].0x0 since=753s v=(0 0) 00010000:00010000:0.0:1789136305.205676:0:24847:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x28:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789136305.205682:0:24847:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005f67a701/0x559c8745c6de4782 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136305.205694:0:24847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005f67a701/0x559c8745c6de4782 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136305.205703:0:24847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005f67a701/0x559c8745c6de4782 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136305.205725:0:24847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005f67a701/0x559c8745c6de4782 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136305.205750:0:24847:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1789136305.206108:0:24847:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x27:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1789136305.206115:0:24847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f1d20fab/0x559c8745c6de4789 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136305.206125:0:24847:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x27:0x0].0x0 since=753s v=(0 0) 00010000:00010000:0.0:1789136305.206128:0:24847:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x27:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789136305.206132:0:24847:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f1d20fab/0x559c8745c6de4789 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136305.206142:0:24847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f1d20fab/0x559c8745c6de4789 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136305.206150:0:24847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f1d20fab/0x559c8745c6de4789 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136305.206158:0:24847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f1d20fab/0x559c8745c6de4789 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136305.206170:0:24847:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:0.0:1789136305.206636:0:24847:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x26:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1789136305.206644:0:24847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000457375d3/0x559c8745c6de4790 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136305.206659:0:24847:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x26:0x0].0x0 since=753s v=(0 0) 00010000:00010000:0.0:1789136305.206663:0:24847:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x26:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789136305.206668:0:24847:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000457375d3/0x559c8745c6de4790 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136305.206677:0:24847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000457375d3/0x559c8745c6de4790 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136305.206686:0:24847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000457375d3/0x559c8745c6de4790 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136305.206693:0:24847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000457375d3/0x559c8745c6de4790 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136305.206703:0:24847:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00002000:00010000:0.0:1789136305.209962:0:24847:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x25:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1789136305.209990:0:24847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001fb160f8/0x559c8745c6de4797 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136305.210010:0:24847:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x25:0x0].0x0 since=753s v=(0 0) 00010000:00010000:0.0:1789136305.210016:0:24847:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x25:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789136305.210023:0:24847:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001fb160f8/0x559c8745c6de4797 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136305.210037:0:24847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001fb160f8/0x559c8745c6de4797 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136305.210085:0:24847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001fb160f8/0x559c8745c6de4797 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136305.210094:0:24847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001fb160f8/0x559c8745c6de4797 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136305.210104:0:24847:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00010000:00010000:2.0:1789136305.211555:0:23320:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:2.0:1789136305.211567:0:23320:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005f67a701/0x559c8745c6de4782 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136305.211578:0:23320:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a6c3caea00 already unused, calling callback (ffffffffc0dbf540) 00010000:00010000:2.0:1789136305.211584:0:23320:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005f67a701/0x559c8745c6de4782 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136305.211607:0:23320:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005f67a701/0x559c8745c6de4782 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136305.211630:0:23320:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005f67a701/0x559c8745c6de4782 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136305.211638:0:23320:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005f67a701/0x559c8745c6de4782 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136305.211663:0:23320:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1789136305.211667:0:23320:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f1d20fab/0x559c8745c6de4789 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136305.211673:0:23320:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a6c3caf800 already unused, calling callback (ffffffffc0dbf540) 00010000:00010000:2.0:1789136305.211676:0:23320:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f1d20fab/0x559c8745c6de4789 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136305.211682:0:23320:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f1d20fab/0x559c8745c6de4789 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136305.211691:0:23320:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f1d20fab/0x559c8745c6de4789 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136305.211698:0:23320:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f1d20fab/0x559c8745c6de4789 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136305.211722:0:23320:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1789136305.211726:0:23320:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000457375d3/0x559c8745c6de4790 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136305.211732:0:23320:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a7d1879c00 already unused, calling callback (ffffffffc0dbf540) 00010000:00010000:2.0:1789136305.211736:0:23320:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000457375d3/0x559c8745c6de4790 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136305.211743:0:23320:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000457375d3/0x559c8745c6de4790 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136305.211754:0:23320:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000457375d3/0x559c8745c6de4790 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136305.211760:0:23320:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000457375d3/0x559c8745c6de4790 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136305.211772:0:23320:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789136305.211775:0:23320:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001fb160f8/0x559c8745c6de4797 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136305.211782:0:23320:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a7d1878600 already unused, calling callback (ffffffffc0dbf540) 00010000:00010000:2.0:1789136305.211785:0:23320:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001fb160f8/0x559c8745c6de4797 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136305.211803:0:23320:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001fb160f8/0x559c8745c6de4797 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136305.211815:0:23320:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001fb160f8/0x559c8745c6de4797 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136305.211822:0:23320:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001fb160f8/0x559c8745c6de4797 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136305.211835:0:23320:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789136305.211837:0:23320:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789136305.211839:0:23320:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789136305.211848:0:23321:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1789136305.212746:0:24847:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x24:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1789136305.212757:0:24847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006f08e423/0x559c8745c6de479e lrc: 3/0,1 mode: --/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136305.212770:0:24847:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x24:0x0].0x0 since=753s v=(0 0) 00010000:00010000:0.0:1789136305.212775:0:24847:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x24:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789136305.212782:0:24847:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006f08e423/0x559c8745c6de479e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136305.212796:0:24847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006f08e423/0x559c8745c6de479e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136305.212804:0:24847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006f08e423/0x559c8745c6de479e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136305.212811:0:24847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006f08e423/0x559c8745c6de479e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136305.213017:0:24847:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789136305.220564:0:23320:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789136305.220582:0:23320:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006f08e423/0x559c8745c6de479e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136305.220599:0:23320:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a7d1879a00 already unused, calling callback (ffffffffc0dbf540) 00010000:00010000:2.0:1789136305.220604:0:23320:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006f08e423/0x559c8745c6de479e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136305.220617:0:23320:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006f08e423/0x559c8745c6de479e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136305.220644:0:23320:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006f08e423/0x559c8745c6de479e lrc: 1/0,0 mode: --/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136305.220670:0:23320:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006f08e423/0x559c8745c6de479e lrc: 0/0,0 mode: --/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136305.225455:0:23320:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789136305.225462:0:23320:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789136305.225464:0:23320:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1789136305.225552:0:24847:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x23:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1789136305.225563:0:24847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ba12fccc/0x559c8745c6de47a5 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136305.225580:0:24847:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x23:0x0].0x0 since=753s v=(0 0) 00010000:00010000:0.0:1789136305.225587:0:24847:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x23:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789136305.225594:0:24847:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ba12fccc/0x559c8745c6de47a5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136305.225610:0:24847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ba12fccc/0x559c8745c6de47a5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136305.225620:0:24847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ba12fccc/0x559c8745c6de47a5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136305.225628:0:24847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ba12fccc/0x559c8745c6de47a5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136305.225643:0:24847:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00080000:0.0:1789136305.225721:0:24847:0:(ofd_dev.c:1532:ofd_orphans_destroy()) lustre-OST0000: after destroy: set last_id to 0x280000401:34 00000100:00100000:0.0:1789136305.225821:0:24847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c47612c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:23358:x1876044666921728:12345-0@lo:5:osp-pre-0-0.0 Request processed in 86140us (86233us total) trans 0 rc 0/0 00000100:00100000:0.0:1789136305.225878:0:24847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1789136305.227338:0:23358:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c4761a40 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:23358:1876044666921728:0@lo:5:osp-pre-0-0.0 00000004:00080000:2.0:1789136305.227359:0:23358:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x280000401:0x41:0x0] from OST, last_created [0x280000401:0x41:0x0]last_used is [0x280000401:0x22:0x0] 00000100:00100000:2.0:1789136305.227774:0:23358:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c4761a40 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:23358:1876044666921856:0@lo:5:osp-pre-0-0.0 00000100:00100000:2.0:1789136305.227834:0:23358:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789136305.228228:0:23358:0:(client.c:2715:ptlrpc_set_wait()) set ffff90a7d1b6a0c0 going to sleep for 11 seconds 00010000:00010000:2.0:1789136305.228245:0:23321:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789136305.228253:0:23321:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ba12fccc/0x559c8745c6de47a5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136305.228266:0:23321:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a7d1878000 already unused, calling callback (ffffffffc0dbf540) 00010000:00010000:2.0:1789136305.228270:0:23321:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ba12fccc/0x559c8745c6de47a5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136305.228280:0:23321:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ba12fccc/0x559c8745c6de47a5 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136305.228302:0:23321:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ba12fccc/0x559c8745c6de47a5 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136305.228310:0:23321:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ba12fccc/0x559c8745c6de47a5 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136305.228346:0:23321:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789136305.228348:0:23321:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789136305.228349:0:23321:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789136305.234200:0:24846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666921856 00000100:00100000:3.0:1789136305.234294:0:24846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666921856 00000100:00100000:3.0:1789136305.234432:0:24846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1789136305.234444:0:24846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c4763480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:23358:x1876044666921856:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:3.0:1789136305.234506:0:24846:0:(ofd_dev.c:1761:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000401 at 66 00000001:00080000:1.0:1789136305.243245:0:24841:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 12884901890 is committed 00000001:00100000:1.0:1789136305.243298:0:24841:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:3.0:1789136305.243985:0:24846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c4763480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:23358:x1876044666921856:12345-0@lo:5:osp-pre-0-0.0 Request processed in 9529us (16136us total) trans 12884901890 rc 0/0 00000100:00100000:3.0:1789136305.243999:0:24846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1789136305.244268:0:23358:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 12884901890 gen 2 00000100:00100000:1.0:1789136305.244277:0:23358:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c4761a40 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:23358:1876044666921856:0@lo:5:osp-pre-0-0.0 00000004:00080000:1.0:1789136305.244293:0:23358:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x280000401:0x41:0x0]-[0x280000401:0x61:0x0] 00000100:00100000:1.0:1789136305.512335:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c4762d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1876044666921984:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1789136305.512414:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789136305.512660:0:24848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666921984 00000100:00100000:3.0:1789136305.512669:0:24848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666921984 00000100:00100000:3.0:1789136305.512725:0:24848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1789136305.512734:0:24848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7f662f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1876044666921984:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1789136305.512754:0:24848:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3915853824 avail 3684331520 00000100:00100000:3.0:1789136305.516937:0:24848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7f662f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1876044666921984:12345-0@lo:13:osp-pre-0-1.0 Request processed in 4192us (4512us total) trans 0 rc 0/0 00000100:00100000:3.0:1789136305.516953:0:24848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1789136305.523520:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c4762d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1876044666921984:0@lo:13:osp-pre-0-1.0 00010000:00010000:1.0:1789136305.896646:0:23320:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789136306.024506:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7fa3bd2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1876044666922112:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1789136306.024595:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789136306.024686:0:23338:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666922112 00000100:00100000:3.0:1789136306.024695:0:23338:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666922112 00000100:00100000:3.0:1789136306.024749:0:23338:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1789136306.024759:0:23338:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7f662cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3641:x1876044666922112:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1789136306.024796:0:23338:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:3.0:1789136306.024844:0:23338:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7f662cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3641:x1876044666922112:12345-0@lo:41:osp-pre-1-0.0 Request processed in 87us (249us total) trans 0 rc 0/0 00000100:00100000:3.0:1789136306.024873:0:23338:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1789136306.024918:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7fa3bd2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1876044666922112:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1789136306.040705:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c3ce83c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1876044666922240:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1789136306.040791:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789136306.042050:0:23339:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666922240 00000100:00100000:3.0:1789136306.042061:0:23339:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666922240 00000100:00100000:3.0:1789136306.042112:0:23339:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1789136306.042123:0:23339:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c4762d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3638:x1876044666922240:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1789136306.042160:0:23339:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446309888 avail 1300070400 00000100:00100000:3.0:1789136306.055098:0:23339:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c4762d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3638:x1876044666922240:12345-0@lo:41:osp-pre-0-1.0 Request processed in 12964us (14294us total) trans 0 rc 0/0 00000100:00100000:3.0:1789136306.055115:0:23339:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1789136306.060065:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c3ce83c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1876044666922240:0@lo:41:osp-pre-0-1.0 00010000:00010000:2.0:1789136306.920391:0:23321:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1789136307.178562:0:24094:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1789136307.944045:0:23320:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789136308.972511:0:23321:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789136309.998926:0:23320:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1789136310.332561:0:25662:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:3.0:1789136310.332565:0:25662:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/ost2_flakey 00000020:01000004:3.0:1789136310.332567:0:25662:0:(obd_mount.c:929:lmd_print()) options: errors=remount-ro 00000080:01200004:3.0:1789136310.332670:0:25662:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff90a7f08de000 00000020:01000004:3.0:1789136310.332686:0:25662:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-OST0001, type=osd-ldiskfs, lsifl=200002, mountfl=0 00000020:01000004:3.0:1789136310.332701:0:25662:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-ldiskfs) 00000020:00000080:3.0:1789136310.332715:0:25662:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff90a6c2b91a48) 00000020:00000080:3.0:1789136310.332731:0:25662:0:(obd_config.c:720:class_attach_name()) OBD: dev 25 attached type osd-ldiskfs with refcount 2 00100000:10000000:1.0:1789136310.479235:0:25662:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:1.0:1789136310.491631:0:25662:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:0.0:1789136310.492639:0:25662:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/32) registered 00100000:10000000:0.0:1789136310.494789:0:25662:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:0.0:1789136310.495412:0:25662:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000003:0x7:0x0] (8/32) registered 00100000:10000000:0.0:1789136310.495733:0:25662:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:0.0:1789136310.496591:0:25662:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/32) registered 00080000:01000000:0.0:1789136310.500364:0:25662:0:(osd_lproc.c:911:osd_procfs_init()) lustre-OST0001: register osd-ldiskfs tunable parameters 00000020:00000080:0.0:1789136310.500576:0:25662:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:0.0:1789136310.500590:0:25662:0:(osd_handler.c:8895:osd_obd_connect()) connect #0 00000020:00000080:0.0:1789136310.500601:0:25662:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x559c8745c6de47b3 00000020:01000004:0.0:1789136310.500622:0:25662:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-OST0001 on device /dev/mapper/ost2_flakey 00000020:01000004:0.0:1789136310.500642:0:25662:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.201.131@tcp:Set MGC reconnect 1 10000000:01000000:0.0:1789136310.500646:0:25662:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.201.131@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:0.0:1789136310.500652:0:25662:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-OST0001 00000020:01000004:0.0:1789136310.500697:0:25662:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/ost2_flakey 10000000:01000000:0.0:1789136310.500702:0:25662:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.201.131@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:2.0:1789136310.543650:0:25662:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.201.131@tcp ctxt 0 is initialized 00000020:01000004:2.0:1789136310.543697:0:25662:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.201.131@tcp, index=0001, flags=0x20002 00000020:01000004:2.0:1789136310.543702:0:25662:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1789136310.543703:0:25662:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1789136310.543704:0:25662:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789136310.543705:0:25662:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789136310.543706:0:25662:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789136310.543707:0:25662:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789136310.543709:0:25662:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1789136310.543710:0:25662:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789136310.543711:0:25662:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1789136310.543714:0:25662:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020002 00000020:01000004:2.0:1789136310.543716:0:25662:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1789136310.543718:0:25662:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1789136310.543719:0:25662:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789136310.543720:0:25662:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789136310.543721:0:25662:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789136310.543722:0:25662:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789136310.543723:0:25662:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1789136310.543723:0:25662:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789136310.543724:0:25662:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1789136310.543751:0:25662:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:2.0:1789136310.543789:0:25662:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c47603c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b11da215-324d-4c8d-90a5-0b7f26186c4c:25662:1876044666922368:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1789136310.544275:0:25662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789136310.544324:0:25662:0:(client.c:2715:ptlrpc_set_wait()) set ffff90a7ef985180 going to sleep for 11 seconds 00000100:00100000:0.0:1789136310.544373:0:23325:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666922368 00000100:00100000:0.0:1789136310.544381:0:23325:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666922368 00000100:00100000:0.0:1789136310.544440:0:23325:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:0.0:1789136310.544450:0:23325:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7fb159450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b11da215-324d-4c8d-90a5-0b7f26186c4c+21:25662:x1876044666922368:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1789136310.544482:0:23325:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:0.0:1789136310.544485:0:23325:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0001 is running on 0@lo 20000000:01000000:0.0:1789136310.544489:0:23325:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:0.0:1789136310.544953:0:23325:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7fb159450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b11da215-324d-4c8d-90a5-0b7f26186c4c+21:25662:x1876044666922368:12345-0@lo:253:mount.lustre.0 Request processed in 503us (679us total) trans 0 rc 0/0 00000100:00100000:0.0:1789136310.544961:0:23325:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:2.0:1789136310.545280:0:25662:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c47603c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b11da215-324d-4c8d-90a5-0b7f26186c4c:25662:1876044666922368:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1789136310.545291:0:25662:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:2.0:1789136310.545294:0:25662:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1789136310.545296:0:25662:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1789136310.545297:0:25662:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789136310.545298:0:25662:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789136310.545299:0:25662:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789136310.545300:0:25662:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789136310.545301:0:25662:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1789136310.545303:0:25662:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789136310.545304:0:25662:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1789136310.545323:0:25662:0:(tgt_mount.c:101:server_register_mount()) register mount ffff90a7f08de000 from lustre-OST0001 10000000:01000000:2.0:1789136310.545350:0:25662:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:2.0:1789136310.545353:0:25662:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:2.0:1789136310.545361:0:25662:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff90a6c4709a48 local copy 00010000:00010000:2.0:1789136310.545372:0:25662:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.131@tcp lock: ffff90a7e1c9f400/0x559c8745c6de43ed lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x559c8745c6de43f4 expref: -99 pid: 23311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789136310.545461:0:25662:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c47603c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b11da215-324d-4c8d-90a5-0b7f26186c4c:25662:1876044666922496:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789136310.545495:0:25662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789136310.545532:0:25662:0:(client.c:2715:ptlrpc_set_wait()) set ffff90a7ef985180 going to sleep for 11 seconds 00000100:00100000:1.0:1789136310.547274:0:23327:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666922496 00000100:00100000:1.0:1789136310.547287:0:23327:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666922496 00000100:00100000:1.0:1789136310.547357:0:23327:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:1.0:1789136310.547366:0:23327:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7fb15a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b11da215-324d-4c8d-90a5-0b7f26186c4c+21:25662:x1876044666922496:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789136310.547707:0:23327:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7fb15a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b11da215-324d-4c8d-90a5-0b7f26186c4c+21:25662:x1876044666922496:12345-0@lo:501:mount.lustre.0 Request processed in 341us (2211us total) trans 0 rc -2/-2 00000100:00100000:1.0:1789136310.547715:0:23327:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:3.0:1789136310.556821:0:25662:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c47603c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b11da215-324d-4c8d-90a5-0b7f26186c4c:25662:1876044666922496:0@lo:501:mount.lustre.0 10000000:01000000:3.0:1789136310.556889:0:25662:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.201.131@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:3.0:1789136310.556944:0:25662:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.201.131@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:3.0:1789136310.556956:0:25662:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.131@tcp lock: ffff90a7e1c9f400/0x559c8745c6de43ed lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x559c8745c6de43f4 expref: -99 pid: 23311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136310.556967:0:25662:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.131@tcp lock: ffff90a7e1c9f400/0x559c8745c6de43ed lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x559c8745c6de43f4 expref: -99 pid: 23311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789136310.557015:0:25662:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff90a7f08de000 10000000:01000000:3.0:1789136310.557022:0:25662:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1789136310.557028:0:25662:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:3.0:1789136310.557031:0:25662:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1789136310.557048:0:25662:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:3.0:1789136310.557052:0:25662:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:3.0:1789136310.557087:0:25662:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.131@tcp lock: ffff90a7e1c9f200/0x559c8745c6de47ba lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 25662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136310.557096:0:25662:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.131@tcp lock: ffff90a7e1c9f200/0x559c8745c6de47ba lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 25662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136310.557138:0:25662:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.131@tcp lock: ffff90a7e1c9f200/0x559c8745c6de47ba lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 25662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789136310.557161:0:25662:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7fa3bd2c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b11da215-324d-4c8d-90a5-0b7f26186c4c:25662:1876044666922624:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1789136310.557228:0:25662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789136310.557279:0:25662:0:(client.c:2715:ptlrpc_set_wait()) set ffff90a7c78e6cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1789136310.557542:0:23324:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666922624 00000100:00100000:1.0:1789136310.557549:0:23324:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666922624 00000100:00100000:1.0:1789136310.557606:0:23324:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:1.0:1789136310.557626:0:23324:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7fb15a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b11da215-324d-4c8d-90a5-0b7f26186c4c+21:25662:x1876044666922624:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789136310.557648:0:23324:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789136310.557662:0:23324:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90a7c167d000/0x559c8745c6de47c1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x559c8745c6de47ba expref: -99 pid: 23324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136310.557684:0:23324:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90a7c167d000/0x559c8745c6de47c1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x559c8745c6de47ba expref: 22 pid: 23324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136310.557695:0:23324:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90a7c167d000/0x559c8745c6de47c1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x559c8745c6de47ba expref: 22 pid: 23324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136310.557703:0:23324:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a7c167d000, rc 0) 00000100:00100000:1.0:1789136310.557745:0:23324:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7fb15a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b11da215-324d-4c8d-90a5-0b7f26186c4c+22:25662:x1876044666922624:12345-0@lo:101:mount.lustre.0 Request processed in 120us (516us total) trans 0 rc 0/0 00000100:00100000:1.0:1789136310.557752:0:23324:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:3.0:1789136310.558387:0:25662:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7fa3bd2c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b11da215-324d-4c8d-90a5-0b7f26186c4c:25662:1876044666922624:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789136310.558404:0:25662:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.131@tcp lock: ffff90a7e1c9f200/0x559c8745c6de47ba lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x559c8745c6de47c1 expref: -99 pid: 25662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136310.558415:0:25662:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.131@tcp lock: ffff90a7e1c9f200/0x559c8745c6de47ba lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x559c8745c6de47c1 expref: -99 pid: 25662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1789136310.562715:0:25662:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 11 count 11 00000040:00080000:3.0:1789136310.565256:0:25662:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1789136310.570468:0:25662:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].1, 224 off8416 00000040:00080000:3.0:1789136310.570526:0:25662:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].2, 128 off8544 00000040:00080000:3.0:1789136310.570543:0:25662:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].3, 112 off8656 00000040:00080000:3.0:1789136310.570558:0:25662:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].4, 224 off8880 00000040:00080000:3.0:1789136310.570575:0:25662:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].5, 224 off9104 00000040:00080000:3.0:1789136310.570587:0:25662:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].6, 80 off9184 00000040:00080000:3.0:1789136310.570601:0:25662:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].7, 224 off9408 00000040:00080000:3.0:1789136310.570720:0:25662:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].8, 224 off9632 00000040:00080000:3.0:1789136310.570740:0:25662:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].9, 120 off9752 00000040:00080000:3.0:1789136310.570765:0:25662:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].10, 224 off9976 00000040:00080000:3.0:1789136310.570771:0:25662:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 10 count 11 00000100:00100000:3.0:1789136310.571333:0:25662:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7fa3bd2c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b11da215-324d-4c8d-90a5-0b7f26186c4c:25662:1876044666922752:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789136310.571403:0:25662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789136310.571533:0:25662:0:(client.c:2715:ptlrpc_set_wait()) set ffff90a7c78e6600 going to sleep for 11 seconds 00000100:00100000:1.0:1789136310.574572:0:23327:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666922752 00000100:00100000:1.0:1789136310.574607:0:23327:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666922752 00000100:00100000:1.0:1789136310.574691:0:23327:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:1.0:1789136310.574701:0:23327:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7fb15b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b11da215-324d-4c8d-90a5-0b7f26186c4c+22:25662:x1876044666922752:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789136310.574969:0:23327:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7fb15b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b11da215-324d-4c8d-90a5-0b7f26186c4c+22:25662:x1876044666922752:12345-0@lo:501:mount.lustre.0 Request processed in 269us (3566us total) trans 0 rc 0/0 00000100:00100000:1.0:1789136310.574978:0:23327:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:3.0:1789136310.575171:0:25662:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7fa3bd2c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b11da215-324d-4c8d-90a5-0b7f26186c4c:25662:1876044666922752:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789136310.575219:0:25662:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7fa3bd2c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b11da215-324d-4c8d-90a5-0b7f26186c4c:25662:1876044666922880:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1789136310.575268:0:25662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789136310.575298:0:25662:0:(client.c:2715:ptlrpc_set_wait()) set ffff90a7c78e6600 going to sleep for 11 seconds 00000100:00100000:2.0:1789136310.575544:0:23325:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666922880 00000100:00100000:2.0:1789136310.575549:0:23325:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666922880 00000100:00100000:2.0:1789136310.575585:0:23325:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:2.0:1789136310.575592:0:23325:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7fb15b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b11da215-324d-4c8d-90a5-0b7f26186c4c+22:25662:x1876044666922880:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1789136310.576567:0:23325:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7fb15b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b11da215-324d-4c8d-90a5-0b7f26186c4c+22:25662:x1876044666922880:12345-0@lo:503:mount.lustre.0 Request processed in 972us (1295us total) trans 0 rc 0/0 00000100:00100000:2.0:1789136310.576585:0:23325:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:3.0:1789136310.577027:0:25662:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7fa3bd2c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b11da215-324d-4c8d-90a5-0b7f26186c4c:25662:1876044666922880:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1789136310.577469:0:25662:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1789136310.577563:0:25662:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7fa3bd2c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b11da215-324d-4c8d-90a5-0b7f26186c4c:25662:1876044666923008:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789136310.577630:0:25662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789136310.578571:0:25662:0:(client.c:2715:ptlrpc_set_wait()) set ffff90a7c78e6cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1789136310.580689:0:23325:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666923008 00000100:00100000:2.0:1789136310.580704:0:23325:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666923008 00000100:00100000:2.0:1789136310.581043:0:23325:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:2.0:1789136310.581055:0:23325:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7c4fff450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b11da215-324d-4c8d-90a5-0b7f26186c4c+22:25662:x1876044666923008:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789136310.582435:0:23325:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7c4fff450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b11da215-324d-4c8d-90a5-0b7f26186c4c+22:25662:x1876044666923008:12345-0@lo:502:mount.lustre.0 Request processed in 1377us (4799us total) trans 0 rc 0/0 00000100:00100000:2.0:1789136310.582447:0:23325:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:3.0:1789136310.582553:0:25662:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7fa3bd2c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b11da215-324d-4c8d-90a5-0b7f26186c4c:25662:1876044666923008:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1789136310.582794:0:25662:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].1, 224 off8416 00000040:00080000:3.0:1789136310.582840:0:25662:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].2, 128 off8544 00000040:00080000:3.0:1789136310.582929:0:25662:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].3, 112 off8656 00000040:00080000:3.0:1789136310.582950:0:25662:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].4, 224 off8880 00000040:00080000:3.0:1789136310.582964:0:25662:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].5, 224 off9104 00000040:00080000:3.0:1789136310.582977:0:25662:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].6, 80 off9184 00000040:00080000:3.0:1789136310.582987:0:25662:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].7, 224 off9408 00000040:00080000:3.0:1789136310.583001:0:25662:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].8, 224 off9632 00000040:00080000:3.0:1789136310.583013:0:25662:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].9, 120 off9752 00000100:00100000:3.0:1789136310.583053:0:25662:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7fa3bd2c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b11da215-324d-4c8d-90a5-0b7f26186c4c:25662:1876044666923136:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789136310.583100:0:25662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789136310.584191:0:25662:0:(client.c:2715:ptlrpc_set_wait()) set ffff90a7c78e6cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1789136310.584337:0:23324:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666923136 00000100:00100000:0.0:1789136310.584359:0:23324:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666923136 00000100:00100000:1.0:1789136310.585030:0:23324:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:1.0:1789136310.585258:0:23324:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7c4ffc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b11da215-324d-4c8d-90a5-0b7f26186c4c+22:25662:x1876044666923136:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789136310.585419:0:23324:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7c4ffc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b11da215-324d-4c8d-90a5-0b7f26186c4c+22:25662:x1876044666923136:12345-0@lo:502:mount.lustre.0 Request processed in 164us (2317us total) trans 0 rc 0/0 00000100:00100000:3.0:1789136310.585476:0:25662:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7fa3bd2c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b11da215-324d-4c8d-90a5-0b7f26186c4c:25662:1876044666923136:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1789136310.585554:0:25662:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].10, 224 off9976 00000040:00080000:3.0:1789136310.585566:0:25662:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 10 count 11 00000100:00100000:1.0:1789136310.586756:0:23324:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000020:01000000:3.0:1789136310.587271:0:25666:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1789136310.587280:0:25666:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/ost2_flakey 00000020:00000080:3.0:1789136310.587286:0:25666:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789136310.587287:0:25666:0:(obd_config.c:1563:class_process_config()) marker 29 (0x1) lustre-OST0001 add ost 00000020:00000080:3.0:1789136310.587292:0:25666:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1789136310.587306:0:25666:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff90a6c2b93490) 00000020:00000080:3.0:1789136310.587328:0:25666:0:(obd_config.c:720:class_attach_name()) OBD: dev 26 attached type obdfilter with refcount 2 00000020:00000080:3.0:1789136310.587332:0:25666:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1789136310.587416:0:25666:0:(tgt_mount.c:153:server_get_mount()) get mount ffff90a7f08de000 from lustre-OST0001, refs=2 00080000:01000000:3.0:1789136310.587425:0:25666:0:(osd_handler.c:8895:osd_obd_connect()) connect #1 00000020:00000080:3.0:1789136310.587432:0:25666:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x559c8745c6de47cf 00010000:00010000:2.0:1789136310.599773:0:25666:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-4 is initialized 00000001:00000004:2.0:1789136310.600984:0:25666:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 3, last_transno is 8589934594 00080000:10000000:2.0:1789136310.603423:0:25666:0:(osd_handler.c:5551:osd_index_try()) lustre-OST0001: index object [0x200000003:0xc:0x0] (8/32) registered 00000020:00000080:2.0:1789136310.609318:0:25666:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:2.0:1789136310.609330:0:25666:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789136310.609337:0:25666:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789136310.609339:0:25666:0:(obd_config.c:1563:class_process_config()) marker 29 (0x2) lustre-OST0001 add ost 00000020:01000000:2.0:1789136310.609343:0:25666:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789136310.609346:0:25666:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789136310.609347:0:25666:0:(obd_config.c:1563:class_process_config()) marker 36 (0x1) lustre sys.timeout 00000020:00000080:2.0:1789136310.609350:0:25666:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1789136310.609352:0:25666:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1789136310.609355:0:25666:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789136310.609357:0:25666:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789136310.609358:0:25666:0:(obd_config.c:1563:class_process_config()) marker 36 (0x2) lustre sys.timeout 00000020:01000000:2.0:1789136310.609360:0:25666:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789136310.609362:0:25666:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789136310.609363:0:25666:0:(obd_config.c:1563:class_process_config()) marker 41 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1789136310.609366:0:25666:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:2.0:1789136310.609384:0:25666:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789136310.609387:0:25666:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789136310.609388:0:25666:0:(obd_config.c:1563:class_process_config()) marker 41 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1789136310.609399:0:25666:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xc:0x0] index 11 count 11 00000020:01000000:3.0:1789136310.609570:0:25662:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-10 (rc=0) 10000000:01000000:3.0:1789136310.609610:0:25662:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.131@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:3.0:1789136310.609647:0:25662:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.131@tcp lock: ffff90a7e1c9f200/0x559c8745c6de47ba lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x559c8745c6de47c1 expref: -99 pid: 25662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136310.609660:0:25662:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.131@tcp lock: ffff90a7e1c9f200/0x559c8745c6de47ba lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x559c8745c6de47c1 expref: -99 pid: 25662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789136310.609668:0:25662:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff90a7f08de000 from 1 10000000:01000000:3.0:1789136310.609671:0:25662:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1789136310.609709:0:25662:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.131@tcp lock: ffff90a7e1c9fc00/0x559c8745c6de47d6 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 25662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136310.609718:0:25662:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.131@tcp lock: ffff90a7e1c9fc00/0x559c8745c6de47d6 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 25662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136310.609730:0:25662:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.131@tcp lock: ffff90a7e1c9fc00/0x559c8745c6de47d6 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 25662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789136310.609756:0:25662:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7fa3bd2c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b11da215-324d-4c8d-90a5-0b7f26186c4c:25662:1876044666923264:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1789136310.609891:0:25662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789136310.609934:0:25662:0:(client.c:2715:ptlrpc_set_wait()) set ffff90a7c78e6600 going to sleep for 11 seconds 00000100:00100000:2.0:1789136310.610249:0:23327:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666923264 00000100:00100000:2.0:1789136310.610255:0:23327:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666923264 00000100:00100000:2.0:1789136310.610296:0:23327:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:2.0:1789136310.610305:0:23327:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7c4ffc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b11da215-324d-4c8d-90a5-0b7f26186c4c+22:25662:x1876044666923264:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789136310.610318:0:23327:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789136310.610330:0:23327:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90a7c0030a00/0x559c8745c6de47dd lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x559c8745c6de47d6 expref: -99 pid: 23327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136310.610353:0:23327:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90a7c0030a00/0x559c8745c6de47dd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x559c8745c6de47d6 expref: 23 pid: 23327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136310.610362:0:23327:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90a7c0030a00/0x559c8745c6de47dd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x559c8745c6de47d6 expref: 23 pid: 23327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136310.610370:0:23327:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a7c0030a00, rc 0) 00000100:00100000:2.0:1789136310.610416:0:23327:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7c4ffc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b11da215-324d-4c8d-90a5-0b7f26186c4c+23:25662:x1876044666923264:12345-0@lo:101:mount.lustre.0 Request processed in 112us (526us total) trans 0 rc 0/0 00000100:00100000:2.0:1789136310.610422:0:23327:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:3.0:1789136310.610537:0:25662:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7fa3bd2c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b11da215-324d-4c8d-90a5-0b7f26186c4c:25662:1876044666923264:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789136310.610551:0:25662:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.131@tcp lock: ffff90a7e1c9fc00/0x559c8745c6de47d6 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x559c8745c6de47dd expref: -99 pid: 25662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136310.610561:0:25662:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.131@tcp lock: ffff90a7e1c9fc00/0x559c8745c6de47d6 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x559c8745c6de47dd expref: -99 pid: 25662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1789136310.611404:0:25662:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 19 count 19 00000040:00080000:3.0:1789136310.611665:0:25662:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1789136310.611816:0:25662:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].1, 224 off8416 00000040:00080000:3.0:1789136310.611840:0:25662:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].2, 112 off8528 00000040:00080000:2.0:1789136310.632358:0:25662:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].3, 224 off8752 00000040:00080000:2.0:1789136310.632407:0:25662:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].4, 224 off8976 00000040:00080000:2.0:1789136310.632423:0:25662:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].5, 112 off9088 00000040:00080000:2.0:1789136310.632438:0:25662:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].6, 224 off9312 00000040:00080000:2.0:1789136310.632452:0:25662:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].7, 224 off9536 00000040:00080000:2.0:1789136310.632464:0:25662:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].8, 144 off9680 00000040:00080000:2.0:1789136310.632476:0:25662:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].9, 224 off9904 00000040:00080000:2.0:1789136310.632490:0:25662:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].10, 224 off10128 00000040:00080000:2.0:1789136310.632504:0:25662:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].11, 144 off10272 00000040:00080000:2.0:1789136310.632518:0:25662:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].12, 224 off10496 00000040:00080000:2.0:1789136310.632529:0:25662:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].13, 224 off10720 00000040:00080000:2.0:1789136310.632542:0:25662:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].14, 128 off10848 00000040:00080000:2.0:1789136310.632567:0:25662:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].15, 224 off11072 00000040:00080000:2.0:1789136310.632581:0:25662:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].16, 224 off11296 00000040:00080000:2.0:1789136310.632593:0:25662:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].17, 128 off11424 00000040:00080000:2.0:1789136310.632629:0:25662:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].18, 224 off11648 00000040:00080000:2.0:1789136310.632635:0:25662:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 18 count 19 00000100:00100000:2.0:1789136310.632749:0:25662:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c4763c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b11da215-324d-4c8d-90a5-0b7f26186c4c:25662:1876044666923392:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789136310.632826:0:25662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789136310.632909:0:25662:0:(client.c:2715:ptlrpc_set_wait()) set ffff90a801889cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1789136310.633108:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7fa3bd2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1876044666923520:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1789136310.633156:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789136310.633195:0:24849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666923520 00000100:00100000:3.0:1789136310.633202:0:24849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666923520 00000100:00100000:3.0:1789136310.633248:0:24849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1789136310.633257:0:24849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c3fe2940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1876044666923520:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1789136310.633285:0:24849:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3915853824 avail 3684331520 00000100:00100000:3.0:1789136310.633326:0:24849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c3fe2940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1876044666923520:12345-0@lo:13:osp-pre-0-1.0 Request processed in 70us (168us total) trans 0 rc 0/0 00000100:00100000:3.0:1789136310.633333:0:24849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00080000:3.0:1789136310.633355:0:23328:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789136310.633396:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7fa3bd2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1876044666923520:0@lo:13:osp-pre-0-1.0 00000100:00080000:0.0:1789136310.634407:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789136310.634412:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1789136310.634416:0:487:0:(import.c:65:import_set_state_nolock()) ffff90a6c228c000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1789136310.634421:0:487:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 753 00000100:00080000:0.0:1789136310.634426:0:487:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1789136310.634432:0:487:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff90a6c228c000 using connection 192.168.201.131@tcp/0@lo 00000100:00100000:0.0:1789136310.634453:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff90a6c3ce8000 x1876044666923904/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1789136310.634487:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789136310.634490:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1789136310.634492:0:487:0:(import.c:65:import_set_state_nolock()) ffff90a7d8b2a800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1789136310.634496:0:487:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 753 00000100:00080000:0.0:1789136310.634497:0:487:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1789136310.634501:0:487:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff90a7d8b2a800 using connection 192.168.201.131@tcp/0@lo 00000100:00100000:0.0:1789136310.634512:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff90a6c3cea940 x1876044666924288/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1789136310.634545:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c3ce8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3637:1876044666923904:0@lo:8:kworker.0 00000100:00100000:0.0:1789136310.634581:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789136310.634652:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c3ce9680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3638:1876044666924032:0@lo:400:kworker.0 00000100:00100000:2.0:1789136310.634682:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789136310.634704:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c1098f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3638:1876044666924672:0@lo:400:kworker.0 00000100:00100000:2.0:1789136310.634724:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789136310.634740:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789136310.634745:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c3ce83c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1876044666924160:0@lo:400:kworker.0 00000100:00100000:2.0:1789136310.634766:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789136310.634792:0:23334:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666924032 00000100:00100000:2.0:1789136310.634798:0:23334:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666924032 00000100:00100000:2.0:1789136310.634844:0:23334:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666924672 00000100:00100000:2.0:1789136310.634847:0:23334:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666924672 00000100:00100000:2.0:1789136310.634902:0:23334:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1789136310.634909:0:23334:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c4760000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1876044666924032:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789136310.634952:0:23334:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c4760000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1876044666924032:12345-0@lo:400:kworker.0 Request processed in 43us (269us total) trans 0 rc 0/0 00000100:00100000:2.0:1789136310.634959:0:23334:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1789136310.634990:0:23334:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1789136310.634996:0:23334:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c47630c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3638:x1876044666924672:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789136310.635022:0:23334:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c47630c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3638:x1876044666924672:12345-0@lo:400:kworker.0 Request processed in 26us (297us total) trans 0 rc 0/0 00000100:00100000:2.0:1789136310.635036:0:23334:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1789136310.635062:0:24077:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666924160 00000100:00100000:2.0:1789136310.635065:0:24077:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666924160 00000100:00100000:2.0:1789136310.635088:0:24077:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1789136310.635094:0:24077:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c47603c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3638:x1876044666924160:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789136310.635416:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c3cebc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1876044666923648:0@lo:400:kworker.0 00000100:00100000:3.0:1789136310.635446:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789136310.635471:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c3ceb0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3640:1876044666924416:0@lo:400:kworker.0 00000100:00100000:3.0:1789136310.635490:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789136310.635505:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1789136310.635510:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c3cea580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1876044666923776:0@lo:400:kworker.0 00000100:00100000:3.0:1789136310.635539:0:23339:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666923648 00000100:00100000:3.0:1789136310.635543:0:23339:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666923648 00000100:00100000:3.0:1789136310.635563:0:23339:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1789136310.635568:0:23339:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c3fe2580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3640:x1876044666923648:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789136310.635601:0:23339:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c3fe2580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3640:x1876044666923648:12345-0@lo:400:kworker.0 Request processed in 33us (155us total) trans 0 rc 0/0 00000100:00100000:3.0:1789136310.635607:0:23339:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00080000:3.0:1789136310.635622:0:23328:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1789136310.635634:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c3fe0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1876044666924800:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789136310.635657:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789136310.635684:0:24849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666924800 00000100:00100000:3.0:1789136310.635687:0:24849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666924800 00000100:00100000:3.0:1789136310.635712:0:24849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1789136310.635718:0:24849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c3fe12c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3639:x1876044666924800:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789136310.635730:0:24849:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3915853824 avail 3684331520 00000100:00100000:3.0:1789136310.635760:0:24849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c3fe12c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3639:x1876044666924800:12345-0@lo:13:osp-pre-0-0.0 Request processed in 43us (102us total) trans 0 rc 0/0 00000100:00100000:3.0:1789136310.635765:0:24849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00080000:3.0:1789136310.635778:0:23328:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789136310.635815:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c3fe0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1876044666924800:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789136310.635833:0:23334:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666924416 00000100:00100000:3.0:1789136310.635836:0:23334:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666924416 00000100:00100000:3.0:1789136310.635870:0:23334:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1789136310.635894:0:23334:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c3fe1e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3640:x1876044666924416:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789136310.635922:0:23334:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c3fe1e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3640:x1876044666924416:12345-0@lo:400:kworker.0 Request processed in 30us (432us total) trans 0 rc 0/0 00000100:00100000:3.0:1789136310.635927:0:23334:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1789136310.636333:0:24077:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c47603c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3638:x1876044666924160:12345-0@lo:400:kworker.0 Request processed in 1238us (1564us total) trans 0 rc 0/0 00000100:00100000:2.0:1789136310.636341:0:24077:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1789136310.636381:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c3ce83c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1876044666924160:0@lo:400:kworker.0 00010000:00080000:2.0:1789136310.636405:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90a6c3ce9680 x1876044666924032/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789136326 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789136310.636415:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c3ce9680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3638:1876044666924032:0@lo:400:kworker.0 00010000:00080000:2.0:1789136310.636425:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90a6c1098f00 x1876044666924672/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789136326 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789136310.636434:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c1098f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3638:1876044666924672:0@lo:400:kworker.0 00000100:00100000:0.0:1789136310.636606:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c3cea940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3637:1876044666924288:0@lo:8:kworker.0 00000100:00100000:0.0:1789136310.636642:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789136310.636746:0:24847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666923904 00000100:00100000:2.0:1789136310.636750:0:24847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666923904 00000100:00100000:2.0:1789136310.636786:0:24847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666924288 00000100:00100000:2.0:1789136310.636789:0:24847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666924288 00000100:00100000:2.0:1789136310.636816:0:24847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1789136310.636821:0:24847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c109b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3637:x1876044666923904:12345-0@lo:8:kworker.0 00000100:00100000:2.0:1789136310.636902:0:24847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c109b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3637:x1876044666923904:12345-0@lo:8:kworker.0 Request processed in 80us (2321us total) trans 0 rc -11/-11 00000100:00100000:2.0:1789136310.636909:0:24847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1789136310.636921:0:24847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1789136310.636934:0:24847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c109a1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3637:x1876044666924288:12345-0@lo:8:kworker.0 00000100:00100000:2.0:1789136310.636967:0:24847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c109a1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3637:x1876044666924288:12345-0@lo:8:kworker.0 Request processed in 33us (325us total) trans 0 rc -11/-11 00000100:00100000:2.0:1789136310.636973:0:24847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1789136310.636995:0:3637:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1789136310.637001:0:3637:0:(import.c:65:import_set_state_nolock()) ffff90a6c228c000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1789136310.637005:0:3637:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-11) 00000100:00100000:2.0:1789136310.637007:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c3ce8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3637:1876044666923904:0@lo:8:kworker.0 00000100:00100000:2.0:1789136310.637019:0:3637:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:2.0:1789136310.637022:0:3637:0:(import.c:65:import_set_state_nolock()) ffff90a7d8b2a800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1789136310.637026:0:3637:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-11) 00000100:00100000:2.0:1789136310.637029:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c3cea940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3637:1876044666924288:0@lo:8:kworker.0 00000100:00100000:2.0:1789136310.638171:0:23324:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666923392 00000100:00100000:2.0:1789136310.638179:0:23324:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666923392 00000100:00100000:2.0:1789136310.638221:0:23324:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:2.0:1789136310.638228:0:23324:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7c4ffd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b11da215-324d-4c8d-90a5-0b7f26186c4c+23:25662:x1876044666923392:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789136310.638361:0:23324:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7c4ffd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b11da215-324d-4c8d-90a5-0b7f26186c4c+23:25662:x1876044666923392:12345-0@lo:501:mount.lustre.0 Request processed in 133us (5535us total) trans 0 rc 0/0 00000100:00100000:2.0:1789136310.638368:0:23324:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:2.0:1789136310.638435:0:25662:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c4763c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b11da215-324d-4c8d-90a5-0b7f26186c4c:25662:1876044666923392:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789136310.638479:0:25662:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c4763c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b11da215-324d-4c8d-90a5-0b7f26186c4c:25662:1876044666924928:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1789136310.638523:0:25662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789136310.638552:0:25662:0:(client.c:2715:ptlrpc_set_wait()) set ffff90a801889cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1789136310.641274:0:23325:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666924928 00000100:00100000:0.0:1789136310.641285:0:23325:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666924928 00000100:00100000:0.0:1789136310.641336:0:23325:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:0.0:1789136310.641344:0:23325:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7c4fffc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b11da215-324d-4c8d-90a5-0b7f26186c4c+23:25662:x1876044666924928:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1789136310.641523:0:23325:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7c4fffc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b11da215-324d-4c8d-90a5-0b7f26186c4c+23:25662:x1876044666924928:12345-0@lo:503:mount.lustre.0 Request processed in 178us (2999us total) trans 0 rc 0/0 00000100:00100000:0.0:1789136310.641531:0:23325:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:3.0:1789136310.641791:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789136310.641837:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c3ce92c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3640:1876044666924544:0@lo:400:kworker.0 00000100:00100000:3.0:1789136310.641897:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789136310.641931:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c3cebc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1876044666923648:0@lo:400:kworker.0 00010000:00080000:3.0:1789136310.641944:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90a6c3ceb0c0 x1876044666924416/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789136326 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789136310.641954:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c3ceb0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3640:1876044666924416:0@lo:400:kworker.0 00000100:00100000:3.0:1789136310.641983:0:23334:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666924544 00000100:00100000:3.0:1789136310.641986:0:23334:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666924544 00000100:00100000:3.0:1789136310.642025:0:23334:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1789136310.642032:0:23334:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c3fe1a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3640:x1876044666924544:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789136310.642069:0:23334:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c3fe1a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3640:x1876044666924544:12345-0@lo:400:kworker.0 Request processed in 38us (171us total) trans 0 rc 0/0 00000100:00100000:3.0:1789136310.642075:0:23334:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00080000:3.0:1789136310.642094:0:23328:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1789136310.642109:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90a6c3ce92c0 x1876044666924544/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789136326 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789136310.642132:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c3ce92c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3640:1876044666924544:0@lo:400:kworker.0 00000100:00100000:0.0:1789136310.642321:0:24847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666923776 00000100:00100000:0.0:1789136310.642326:0:24847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666923776 00000100:00100000:0.0:1789136310.642363:0:24847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1789136310.642371:0:24847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c3fe0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3640:x1876044666923776:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789136310.642423:0:24847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c3fe0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3640:x1876044666923776:12345-0@lo:400:kworker.0 Request processed in 53us (632us total) trans 0 rc 0/0 00000100:00100000:0.0:1789136310.642429:0:24847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1789136310.642561:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c3cea580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1876044666923776:0@lo:400:kworker.0 00000100:00100000:2.0:1789136310.646509:0:25662:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c4763c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b11da215-324d-4c8d-90a5-0b7f26186c4c:25662:1876044666924928:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1789136310.649595:0:25662:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1789136310.649736:0:25662:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c4763c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b11da215-324d-4c8d-90a5-0b7f26186c4c:25662:1876044666925056:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789136310.650058:0:25662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789136310.650122:0:25662:0:(client.c:2715:ptlrpc_set_wait()) set ffff90a801889cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1789136310.650499:0:23327:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666925056 00000100:00100000:3.0:1789136310.650513:0:23327:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666925056 00000100:00100000:3.0:1789136310.650569:0:23327:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:3.0:1789136310.650580:0:23327:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7c4ffe450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b11da215-324d-4c8d-90a5-0b7f26186c4c+23:25662:x1876044666925056:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789136310.651257:0:23327:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7c4ffe450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b11da215-324d-4c8d-90a5-0b7f26186c4c+23:25662:x1876044666925056:12345-0@lo:502:mount.lustre.0 Request processed in 677us (1197us total) trans 0 rc 0/0 00000100:00100000:3.0:1789136310.651266:0:23327:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:2.0:1789136310.651444:0:25662:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c4763c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b11da215-324d-4c8d-90a5-0b7f26186c4c:25662:1876044666925056:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1789136310.652036:0:25662:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].1, 224 off8416 00000040:00080000:2.0:1789136310.652068:0:25662:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].2, 112 off8528 00000040:00080000:2.0:1789136310.652082:0:25662:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].3, 224 off8752 00000040:00080000:2.0:1789136310.652095:0:25662:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].4, 224 off8976 00000040:00080000:2.0:1789136310.652108:0:25662:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].5, 112 off9088 00000040:00080000:2.0:1789136310.652214:0:25662:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].6, 224 off9312 00000040:00080000:2.0:1789136310.652230:0:25662:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].7, 224 off9536 00000040:00080000:2.0:1789136310.652241:0:25662:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].8, 144 off9680 00000040:00080000:2.0:1789136310.652251:0:25662:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].9, 224 off9904 00000040:00080000:2.0:1789136310.652263:0:25662:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].10, 224 off10128 00000040:00080000:2.0:1789136310.652275:0:25662:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].11, 144 off10272 00000040:00080000:2.0:1789136310.652287:0:25662:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].12, 224 off10496 00000040:00080000:2.0:1789136310.652299:0:25662:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].13, 224 off10720 00000040:00080000:2.0:1789136310.652314:0:25662:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].14, 128 off10848 00000040:00080000:2.0:1789136310.652345:0:25662:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].15, 224 off11072 00000040:00080000:2.0:1789136310.652360:0:25662:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].16, 224 off11296 00000040:00080000:2.0:1789136310.652373:0:25662:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].17, 128 off11424 00000100:00100000:2.0:1789136310.652484:0:25662:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c4763c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b11da215-324d-4c8d-90a5-0b7f26186c4c:25662:1876044666925184:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789136310.652547:0:25662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789136310.652655:0:25662:0:(client.c:2715:ptlrpc_set_wait()) set ffff90a801889cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1789136310.655469:0:23324:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666925184 00000100:00100000:3.0:1789136310.655481:0:23324:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666925184 00000100:00100000:3.0:1789136310.655537:0:23324:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:3.0:1789136310.655545:0:23324:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7c4ffdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b11da215-324d-4c8d-90a5-0b7f26186c4c+23:25662:x1876044666925184:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789136310.655888:0:23324:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7c4ffdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b11da215-324d-4c8d-90a5-0b7f26186c4c+23:25662:x1876044666925184:12345-0@lo:502:mount.lustre.0 Request processed in 333us (3330us total) trans 0 rc 0/0 00000100:00100000:3.0:1789136310.655896:0:23324:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:2.0:1789136310.660026:0:25662:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c4763c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b11da215-324d-4c8d-90a5-0b7f26186c4c:25662:1876044666925184:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1789136310.660262:0:25662:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].18, 224 off11648 00000040:00080000:0.0:1789136310.660279:0:25662:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 18 count 19 00000020:01000000:2.0:1789136310.661469:0:25670:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789136310.661480:0:25670:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789136310.661493:0:25670:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:2.0:1789136310.661501:0:25670:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff90a7f08de000 00000020:00000080:2.0:1789136310.661507:0:25670:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1789136310.661513:0:25670:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789136310.661515:0:25670:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789136310.661517:0:25670:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:2.0:1789136310.661519:0:25670:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789136310.661521:0:25670:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789136310.661522:0:25670:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:2.0:1789136310.661526:0:25670:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff90a7f08de000 00000020:00000080:2.0:1789136310.661528:0:25670:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1789136310.661589:0:25670:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789136310.661592:0:25670:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789136310.661594:0:25670:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:2.0:1789136310.661596:0:25670:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789136310.661598:0:25670:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789136310.661599:0:25670:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre lod.lustre-MDT0000-mdtlov.enable_compr_rotational 00000020:01000000:2.0:1789136310.661602:0:25670:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff90a7f08de000 00000020:00000080:2.0:1789136310.661605:0:25670:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1789136310.661639:0:25670:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789136310.661642:0:25670:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789136310.661644:0:25670:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre lod.lustre-MDT0000-mdtlov.enable_compr_rotational 00000020:01000000:2.0:1789136310.661646:0:25670:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789136310.661648:0:25670:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789136310.661650:0:25670:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre lod.lustre-MDT0001-mdtlov.enable_compr_rotational 00000020:01000000:2.0:1789136310.661653:0:25670:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff90a7f08de000 00000020:00000080:2.0:1789136310.661655:0:25670:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1789136310.661669:0:25670:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789136310.661671:0:25670:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789136310.661673:0:25670:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre lod.lustre-MDT0001-mdtlov.enable_compr_rotational 00000020:01000000:2.0:1789136310.661675:0:25670:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789136310.661677:0:25670:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789136310.661678:0:25670:0:(obd_config.c:1563:class_process_config()) marker 6 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1789136310.661689:0:25670:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff90a7f08de000 00000020:00000080:2.0:1789136310.661691:0:25670:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1789136310.661708:0:25670:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789136310.661711:0:25670:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789136310.661712:0:25670:0:(obd_config.c:1563:class_process_config()) marker 6 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1789136310.661715:0:25670:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789136310.661718:0:25670:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789136310.661719:0:25670:0:(obd_config.c:1563:class_process_config()) marker 7 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:2.0:1789136310.661722:0:25670:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff90a7f08de000 00000020:00000080:2.0:1789136310.661723:0:25670:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1789136310.661742:0:25670:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789136310.661744:0:25670:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789136310.661745:0:25670:0:(obd_config.c:1563:class_process_config()) marker 7 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:2.0:1789136310.661748:0:25670:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xe:0x0] index 19 count 19 00000020:01000000:3.0:1789136310.662024:0:25662:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-18 (rc=0) 10000000:01000000:3.0:1789136310.662053:0:25662:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.131@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1789136310.662075:0:25662:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.131@tcp lock: ffff90a7e1c9fc00/0x559c8745c6de47d6 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x559c8745c6de47dd expref: -99 pid: 25662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136310.662087:0:25662:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.131@tcp lock: ffff90a7e1c9fc00/0x559c8745c6de47d6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x559c8745c6de47dd expref: -99 pid: 25662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789136310.662146:0:25662:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1789136310.662149:0:25662:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff90a7f08de000 10000000:01000000:3.0:1789136310.662151:0:25662:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff90a7f08de000 10000000:01000000:3.0:1789136310.662156:0:25662:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1789136310.662162:0:25662:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff90a7f08de000 from 1 10000000:01000000:3.0:1789136310.662164:0:25662:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1789136310.662197:0:25662:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.131@tcp lock: ffff90a7e1c9f600/0x559c8745c6de47e4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 25662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136310.662212:0:25662:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.131@tcp lock: ffff90a7e1c9f600/0x559c8745c6de47e4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 25662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136310.662223:0:25662:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.131@tcp lock: ffff90a7e1c9f600/0x559c8745c6de47e4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 25662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789136310.662243:0:25662:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c3fe0780 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b11da215-324d-4c8d-90a5-0b7f26186c4c:25662:1876044666925312:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1789136310.662311:0:25662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789136310.662348:0:23327:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666925312 00000100:00100000:3.0:1789136310.662354:0:23327:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666925312 00000100:00100000:3.0:1789136310.662396:0:23327:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:3.0:1789136310.662404:0:23327:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7c4ffc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b11da215-324d-4c8d-90a5-0b7f26186c4c+23:25662:x1876044666925312:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789136310.662416:0:23327:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789136310.662428:0:23327:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90a7e1c9e600/0x559c8745c6de47eb lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x559c8745c6de47e4 expref: -99 pid: 23327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136310.662450:0:23327:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90a7e1c9e600/0x559c8745c6de47eb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x559c8745c6de47e4 expref: 24 pid: 23327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136310.662461:0:23327:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90a7e1c9e600/0x559c8745c6de47eb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x559c8745c6de47e4 expref: 24 pid: 23327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136310.662468:0:23327:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a7e1c9e600, rc 0) 00000100:00100000:3.0:1789136310.662494:0:23327:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7c4ffc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b11da215-324d-4c8d-90a5-0b7f26186c4c+24:25662:x1876044666925312:12345-0@lo:101:mount.lustre.0 Request processed in 91us (184us total) trans 0 rc 0/0 00000100:00100000:3.0:1789136310.662501:0:23327:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:3.0:1789136310.662547:0:25662:0:(client.c:2715:ptlrpc_set_wait()) set ffff90a7c78e6240 going to sleep for 11 seconds 00000100:00100000:3.0:1789136310.662571:0:25662:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c3fe0780 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b11da215-324d-4c8d-90a5-0b7f26186c4c:25662:1876044666925312:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789136310.662583:0:25662:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.131@tcp lock: ffff90a7e1c9f600/0x559c8745c6de47e4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x559c8745c6de47eb expref: -99 pid: 25662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136310.662592:0:25662:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.131@tcp lock: ffff90a7e1c9f600/0x559c8745c6de47e4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x559c8745c6de47eb expref: -99 pid: 25662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1789136310.681545:0:25662:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 52 count 51 00000040:00080000:3.0:1789136310.686037:0:25662:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1789136310.686254:0:25662:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].1, 224 off8416 00000040:00080000:3.0:1789136310.686281:0:25662:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].2, 120 off8536 00000040:00080000:3.0:1789136310.686294:0:25662:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].3, 168 off8704 00000040:00080000:3.0:1789136310.686307:0:25662:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].4, 224 off8928 00000040:00080000:3.0:1789136310.686320:0:25662:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].5, 224 off9152 00000040:00080000:3.0:1789136310.686332:0:25662:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].6, 120 off9272 00000040:00080000:3.0:1789136310.686345:0:25662:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].7, 168 off9440 00000040:00080000:3.0:1789136310.686357:0:25662:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].8, 224 off9664 00000040:00080000:3.0:1789136310.686386:0:25662:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].9, 224 off9888 00000040:00080000:3.0:1789136310.686401:0:25662:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].10, 120 off10008 00000040:00080000:3.0:1789136310.686413:0:25662:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].11, 224 off10232 00000040:00080000:3.0:1789136310.686425:0:25662:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].12, 224 off10456 00000040:00080000:3.0:1789136310.686438:0:25662:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].13, 88 off10544 00000040:00080000:3.0:1789136310.686451:0:25662:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].14, 128 off10672 00000040:00080000:3.0:1789136310.686463:0:25662:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].15, 144 off10816 00000040:00080000:3.0:1789136310.686473:0:25662:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].16, 160 off10976 00000040:00080000:3.0:1789136310.686486:0:25662:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].17, 224 off11200 00000040:00080000:3.0:1789136310.686497:0:25662:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].18, 224 off11424 00000040:00080000:3.0:1789136310.686508:0:25662:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].19, 80 off11504 00000040:00080000:3.0:1789136310.686521:0:25662:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].20, 224 off11728 00000040:00080000:3.0:1789136310.686534:0:25662:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].21, 224 off11952 00000040:00080000:3.0:1789136310.686546:0:25662:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].22, 88 off12040 00000040:00080000:3.0:1789136310.686558:0:25662:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].23, 128 off12168 00000040:00080000:3.0:1789136310.686581:0:25662:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].24, 144 off12312 00000040:00080000:3.0:1789136310.686607:0:25662:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].25, 160 off12472 00000040:00080000:3.0:1789136310.686623:0:25662:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].26, 224 off12696 00000040:00080000:3.0:1789136310.686636:0:25662:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].27, 224 off12920 00000040:00080000:3.0:1789136310.686648:0:25662:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].28, 80 off13000 00000040:00080000:3.0:1789136310.686660:0:25662:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].29, 224 off13224 00000040:00080000:3.0:1789136310.686672:0:25662:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].30, 224 off13448 00000040:00080000:3.0:1789136310.686683:0:25662:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].31, 88 off13536 00000040:00080000:3.0:1789136310.686695:0:25662:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].32, 128 off13664 00000040:00080000:3.0:1789136310.686707:0:25662:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].33, 144 off13808 00000040:00080000:3.0:1789136310.686720:0:25662:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].34, 128 off13936 00000040:00080000:3.0:1789136310.686732:0:25662:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].35, 224 off14160 00000040:00080000:3.0:1789136310.686742:0:25662:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].36, 224 off14384 00000040:00080000:3.0:1789136310.686756:0:25662:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].37, 80 off14464 00000040:00080000:3.0:1789136310.686768:0:25662:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].38, 224 off14688 00000040:00080000:3.0:1789136310.686782:0:25662:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].39, 224 off14912 00000040:00080000:3.0:1789136310.686795:0:25662:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].40, 88 off15000 00000040:00080000:3.0:1789136310.686824:0:25662:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].41, 128 off15128 00000040:00080000:3.0:1789136310.686839:0:25662:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].42, 144 off15272 00000040:00080000:3.0:1789136310.686851:0:25662:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].43, 128 off15400 00000040:00080000:3.0:1789136310.686907:0:25662:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].44, 224 off15624 00000040:00080000:3.0:1789136310.686921:0:25662:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].45, 224 off15848 00000040:00080000:3.0:1789136310.686934:0:25662:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].46, 80 off15928 00000040:00080000:3.0:1789136310.686946:0:25662:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].47, 224 off16152 00000040:00080000:3.0:1789136310.686959:0:25662:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].48, 232 off16384 00000040:00080000:3.0:1789136310.687092:0:25662:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].49, 224 off16608 00000040:00080000:3.0:1789136310.687114:0:25662:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].50, 120 off16728 00000040:00080000:3.0:1789136310.687130:0:25662:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].51, 224 off16952 00000040:00080000:3.0:1789136310.687135:0:25662:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 51 count 51 00000100:00100000:3.0:1789136310.687232:0:25662:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c3fe0780 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b11da215-324d-4c8d-90a5-0b7f26186c4c:25662:1876044666925440:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789136310.687300:0:25662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789136310.692521:0:25662:0:(client.c:2715:ptlrpc_set_wait()) set ffff90a7c78e63c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789136310.694949:0:23325:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666925440 00000100:00100000:1.0:1789136310.694961:0:23325:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666925440 00000100:00100000:1.0:1789136310.695015:0:23325:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:1.0:1789136310.695024:0:23325:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7c4ffd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b11da215-324d-4c8d-90a5-0b7f26186c4c+24:25662:x1876044666925440:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789136310.695267:0:23325:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7c4ffd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b11da215-324d-4c8d-90a5-0b7f26186c4c+24:25662:x1876044666925440:12345-0@lo:501:mount.lustre.0 Request processed in 244us (7966us total) trans 0 rc 0/0 00000100:00100000:1.0:1789136310.695276:0:23325:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:3.0:1789136310.695539:0:25662:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c3fe0780 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b11da215-324d-4c8d-90a5-0b7f26186c4c:25662:1876044666925440:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789136310.695589:0:25662:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c3fe0780 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b11da215-324d-4c8d-90a5-0b7f26186c4c:25662:1876044666925568:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1789136310.695636:0:25662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789136310.695658:0:25662:0:(client.c:2715:ptlrpc_set_wait()) set ffff90a7c78e63c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789136310.695674:0:23324:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666925568 00000100:00100000:3.0:1789136310.695677:0:23324:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666925568 00000100:00100000:3.0:1789136310.695706:0:23324:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:3.0:1789136310.695712:0:23324:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7c4ffd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b11da215-324d-4c8d-90a5-0b7f26186c4c+24:25662:x1876044666925568:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1789136310.695792:0:23324:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7c4ffd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b11da215-324d-4c8d-90a5-0b7f26186c4c+24:25662:x1876044666925568:12345-0@lo:503:mount.lustre.0 Request processed in 79us (155us total) trans 0 rc 0/0 00000100:00100000:3.0:1789136310.695798:0:23324:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:3.0:1789136310.695870:0:25662:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c3fe0780 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b11da215-324d-4c8d-90a5-0b7f26186c4c:25662:1876044666925568:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1789136310.696278:0:25662:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1789136310.696338:0:25662:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c3fe0780 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b11da215-324d-4c8d-90a5-0b7f26186c4c:25662:1876044666925696:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789136310.696375:0:25662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789136310.697209:0:25662:0:(client.c:2715:ptlrpc_set_wait()) set ffff90a7e00d16c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789136310.697238:0:23327:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666925696 00000100:00100000:3.0:1789136310.697243:0:23327:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666925696 00000100:00100000:3.0:1789136310.697296:0:23327:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:3.0:1789136310.697305:0:23327:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7c4ffe850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b11da215-324d-4c8d-90a5-0b7f26186c4c+24:25662:x1876044666925696:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789136310.697482:0:23327:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7c4ffe850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b11da215-324d-4c8d-90a5-0b7f26186c4c+24:25662:x1876044666925696:12345-0@lo:502:mount.lustre.0 Request processed in 178us (1106us total) trans 0 rc 0/0 00000100:00100000:3.0:1789136310.697490:0:23327:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:3.0:1789136310.697544:0:25662:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c3fe0780 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b11da215-324d-4c8d-90a5-0b7f26186c4c:25662:1876044666925696:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1789136310.697733:0:25662:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].1, 224 off8416 00000040:00080000:3.0:1789136310.697767:0:25662:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].2, 120 off8536 00000040:00080000:3.0:1789136310.697780:0:25662:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].3, 168 off8704 00000040:00080000:3.0:1789136310.697793:0:25662:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].4, 224 off8928 00000040:00080000:3.0:1789136310.699370:0:25662:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].5, 224 off9152 00000040:00080000:3.0:1789136310.699476:0:25662:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].6, 120 off9272 00000040:00080000:3.0:1789136310.699492:0:25662:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].7, 168 off9440 00000040:00080000:3.0:1789136310.699504:0:25662:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].8, 224 off9664 00000040:00080000:3.0:1789136310.699516:0:25662:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].9, 224 off9888 00000040:00080000:3.0:1789136310.699527:0:25662:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].10, 120 off10008 00000040:00080000:3.0:1789136310.699539:0:25662:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].11, 224 off10232 00000040:00080000:3.0:1789136310.699553:0:25662:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].12, 224 off10456 00000040:00080000:3.0:1789136310.699565:0:25662:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].13, 88 off10544 00000040:00080000:3.0:1789136310.699577:0:25662:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].14, 128 off10672 00000040:00080000:3.0:1789136310.699589:0:25662:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].15, 144 off10816 00000040:00080000:3.0:1789136310.699602:0:25662:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].16, 160 off10976 00000040:00080000:3.0:1789136310.699614:0:25662:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].17, 224 off11200 00000040:00080000:3.0:1789136310.699642:0:25662:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].18, 224 off11424 00000040:00080000:3.0:1789136310.699659:0:25662:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].19, 80 off11504 00000040:00080000:3.0:1789136310.699671:0:25662:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].20, 224 off11728 00000040:00080000:3.0:1789136310.699684:0:25662:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].21, 224 off11952 00000040:00080000:3.0:1789136310.699698:0:25662:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].22, 88 off12040 00000040:00080000:3.0:1789136310.699709:0:25662:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].23, 128 off12168 00000040:00080000:3.0:1789136310.699722:0:25662:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].24, 144 off12312 00000040:00080000:3.0:1789136310.699735:0:25662:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].25, 160 off12472 00000040:00080000:3.0:1789136310.699749:0:25662:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].26, 224 off12696 00000040:00080000:3.0:1789136310.699762:0:25662:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].27, 224 off12920 00000040:00080000:3.0:1789136310.699777:0:25662:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].28, 80 off13000 00000040:00080000:3.0:1789136310.699789:0:25662:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].29, 224 off13224 00000040:00080000:3.0:1789136310.699801:0:25662:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].30, 224 off13448 00000040:00080000:3.0:1789136310.700563:0:25662:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].31, 88 off13536 00000040:00080000:3.0:1789136310.700580:0:25662:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].32, 128 off13664 00000040:00080000:3.0:1789136310.700593:0:25662:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].33, 144 off13808 00000040:00080000:3.0:1789136310.700616:0:25662:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].34, 128 off13936 00000040:00080000:3.0:1789136310.700637:0:25662:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].35, 224 off14160 00000040:00080000:3.0:1789136310.700652:0:25662:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].36, 224 off14384 00000040:00080000:3.0:1789136310.700665:0:25662:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].37, 80 off14464 00000040:00080000:3.0:1789136310.700680:0:25662:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].38, 224 off14688 00000040:00080000:3.0:1789136310.700692:0:25662:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].39, 224 off14912 00000040:00080000:3.0:1789136310.700705:0:25662:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].40, 88 off15000 00000040:00080000:3.0:1789136310.700716:0:25662:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].41, 128 off15128 00000040:00080000:3.0:1789136310.700728:0:25662:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].42, 144 off15272 00000040:00080000:3.0:1789136310.700741:0:25662:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].43, 128 off15400 00000040:00080000:3.0:1789136310.700752:0:25662:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].44, 224 off15624 00000040:00080000:3.0:1789136310.700764:0:25662:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].45, 224 off15848 00000040:00080000:3.0:1789136310.700776:0:25662:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].46, 80 off15928 00000040:00080000:3.0:1789136310.700790:0:25662:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].47, 224 off16152 00000040:00080000:3.0:1789136310.700802:0:25662:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].48, 232 off16384 00000100:00100000:3.0:1789136310.703035:0:25662:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c3fe0780 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b11da215-324d-4c8d-90a5-0b7f26186c4c:25662:1876044666925824:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789136310.703933:0:25662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789136310.704000:0:23325:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666925824 00000100:00100000:3.0:1789136310.704008:0:23325:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666925824 00000100:00100000:3.0:1789136310.704053:0:23325:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:3.0:1789136310.704061:0:23325:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7c4ffe050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b11da215-324d-4c8d-90a5-0b7f26186c4c+24:25662:x1876044666925824:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789136310.705313:0:23325:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7c4ffe050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b11da215-324d-4c8d-90a5-0b7f26186c4c+24:25662:x1876044666925824:12345-0@lo:502:mount.lustre.0 Request processed in 1248us (1377us total) trans 0 rc 0/0 00000100:00100000:3.0:1789136310.705324:0:23325:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:3.0:1789136310.709003:0:25662:0:(client.c:2715:ptlrpc_set_wait()) set ffff90a7c78e6240 going to sleep for 11 seconds 00000100:00100000:3.0:1789136310.709047:0:25662:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c3fe0780 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b11da215-324d-4c8d-90a5-0b7f26186c4c:25662:1876044666925824:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1789136310.710301:0:25662:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].49, 224 off16608 00000040:00080000:3.0:1789136310.710345:0:25662:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].50, 120 off16728 00000100:00100000:3.0:1789136310.710686:0:25662:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c3fe0780 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b11da215-324d-4c8d-90a5-0b7f26186c4c:25662:1876044666925952:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789136310.710772:0:25662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789136310.710913:0:25662:0:(client.c:2715:ptlrpc_set_wait()) set ffff90a7e00d16c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789136310.730704:0:23324:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666925952 00000100:00100000:0.0:1789136310.730722:0:23324:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666925952 00000100:00100000:0.0:1789136310.730787:0:23324:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:0.0:1789136310.730797:0:23324:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7c4fff050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b11da215-324d-4c8d-90a5-0b7f26186c4c+24:25662:x1876044666925952:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789136310.731004:0:23324:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7c4fff050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b11da215-324d-4c8d-90a5-0b7f26186c4c+24:25662:x1876044666925952:12345-0@lo:502:mount.lustre.0 Request processed in 208us (20231us total) trans 0 rc 0/0 00000100:00100000:0.0:1789136310.731012:0:23324:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:3.0:1789136310.731017:0:25662:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c3fe0780 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b11da215-324d-4c8d-90a5-0b7f26186c4c:25662:1876044666925952:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1789136310.731102:0:25662:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].51, 224 off16952 00000040:00080000:3.0:1789136310.731116:0:25662:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 51 count 51 00000020:01000004:3.0:1789136310.735353:0:25677:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:3.0:1789136310.735370:0:25677:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff90a6c2b90000) 00000020:00000080:3.0:1789136310.735904:0:25677:0:(obd_config.c:720:class_attach_name()) OBD: dev 27 attached type lwp with refcount 2 00000020:01000004:3.0:1789136310.735987:0:25677:0:(tgt_mount.c:153:server_get_mount()) get mount ffff90a7f08de000 from lustre-OST0001, refs=3 00000020:01000004:3.0:1789136310.735992:0:25677:0:(tgt_mount.c:187:server_put_mount()) put mount ffff90a7f08de000 from lustre-OST0001, refs=3 00000020:01000004:3.0:1789136310.735994:0:25677:0:(obd_mount.c:710:lustre_put_lsi()) put ffff90a7f08de000 3 00010000:00080000:3.0:1789136310.736024:0:25677:0:(ldlm_lib.c:102:import_set_conn()) imp ffff90a7e1e01800@lustre-MDT0000-lwp-OST0001: add connection 192.168.201.131@tcp at head 00010000:00010000:2.0:1789136310.752004:0:25677:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-11 is initialized 00000020:00000080:2.0:1789136310.752200:0:25677:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:2.0:1789136310.752263:0:25677:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1789136310.752276:0:25677:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0x559c8745c6de47f9 00000100:00080000:2.0:1789136310.752286:0:25677:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1789136310.752292:0:25677:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff90a7e1e01800 using connection 192.168.201.131@tcp/0@lo 00000100:00100000:2.0:1789136310.752325:0:25677:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff90a6c4763c00 x1876044666926080/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1789136310.752357:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c4763c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3637:1876044666926080:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1789136310.752572:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1789136310.752638:0:25677:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00100000:1.0:1789136310.753423:0:23333:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666926080 00000100:00100000:1.0:1789136310.753434:0:23333:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666926080 00000100:00100000:1.0:1789136310.753476:0:23333:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1789136310.753483:0:23333:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c4761e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3637:x1876044666926080:12345-0@lo:38:llog_process_th.0 00010000:00080000:1.0:1789136310.753506:0:23333:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 758 last 0 00000020:00000080:1.0:1789136310.753536:0:23333:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0x559c8745c6de4800 00000004:00100000:1.0:1789136310.753551:0:23333:0:(mdt_handler.c:7306:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1789136310.753580:0:23333:0:(import.c:65:import_set_state_nolock()) ffff90a6c443e800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789136310.753645:0:23333:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c4761e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3637:x1876044666926080:12345-0@lo:38:llog_process_th.0 Request processed in 161us (1072us total) trans 0 rc 0/0 00000100:00100000:1.0:1789136310.753653:0:23333:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:2.0:1789136310.756164:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90a6c4763c00 x1876044666926080/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789136320 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789136310.756180:0:3637:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:2.0:1789136310.756192:0:3637:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 3 00000100:00080000:2.0:1789136310.756220:0:3637:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:2.0:1789136310.756226:0:3637:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1789136310.756229:0:3637:0:(import.c:65:import_set_state_nolock()) ffff90a7e1e01800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1789136310.756237:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c4763c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3637:1876044666926080:0@lo:38:llog_process_th.0 00000020:01000004:0.0:1789136310.756628:0:25677:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-lwp-OST0001 (typ=lwp) 00000020:00000080:0.0:1789136310.756655:0:25677:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-lwp-OST0001 (ffff90a7efa1ced8) 00000020:00000080:0.0:1789136310.756681:0:25677:0:(obd_config.c:720:class_attach_name()) OBD: dev 28 attached type lwp with refcount 2 00000020:01000004:0.0:1789136310.756769:0:25677:0:(tgt_mount.c:153:server_get_mount()) get mount ffff90a7f08de000 from lustre-OST0001, refs=3 00000020:01000004:0.0:1789136310.756773:0:25677:0:(tgt_mount.c:187:server_put_mount()) put mount ffff90a7f08de000 from lustre-OST0001, refs=3 00000020:01000004:0.0:1789136310.756776:0:25677:0:(obd_mount.c:710:lustre_put_lsi()) put ffff90a7f08de000 3 00010000:00080000:0.0:1789136310.756805:0:25677:0:(ldlm_lib.c:102:import_set_conn()) imp ffff90a7f6294800@lustre-MDT0001-lwp-OST0001: add connection 192.168.201.131@tcp at head 00010000:00010000:1.0:1789136310.762476:0:25677:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-lwp-OST0001-12 is initialized 00000020:00000080:1.0:1789136310.762633:0:25677:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-lwp-OST0001 (uuid lustre-MDT0001-lwp-OST0001_UUID) 00000010:01000000:1.0:1789136310.762680:0:25677:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1789136310.762693:0:25677:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0001, cookie 0x559c8745c6de480e 00000100:00080000:1.0:1789136310.762703:0:25677:0:(import.c:510:import_select_connection()) lustre-MDT0001-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1789136310.762709:0:25677:0:(import.c:624:import_select_connection()) lustre-MDT0001-lwp-OST0001: import ffff90a7f6294800 using connection 192.168.201.131@tcp/0@lo 00000100:00100000:1.0:1789136310.762746:0:25677:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff90a7f662cf00 x1876044666926208/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1789136310.762768:0:25677:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID 00000100:00100000:2.0:1789136310.763018:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7f662cf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3637:1876044666926208:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1789136310.763091:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789136310.763497:0:23332:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666926208 00000100:00100000:1.0:1789136310.763505:0:23332:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666926208 00000100:00100000:1.0:1789136310.763574:0:23332:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1789136310.763581:0:23332:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c4763c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3637:x1876044666926208:12345-0@lo:38:llog_process_th.0 00010000:00080000:1.0:1789136310.763606:0:23332:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0001-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 758 last 0 00000020:00000080:1.0:1789136310.763670:0:23332:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0001_UUID, cookie 0x559c8745c6de4815 00000004:00100000:1.0:1789136310.763686:0:23332:0:(mdt_handler.c:7306:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1789136310.763716:0:23332:0:(import.c:65:import_set_state_nolock()) ffff90a6c4439000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789136310.763779:0:23332:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c4763c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3637:x1876044666926208:12345-0@lo:38:llog_process_th.0 Request processed in 195us (685us total) trans 0 rc 0/0 00000100:00100000:1.0:1789136310.763787:0:23332:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:3.0:1789136310.764022:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90a7f662cf00 x1876044666926208/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789136320 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789136310.764033:0:3637:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:3.0:1789136310.764040:0:3637:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0001-lwp-OST0001: connect to target with instance 3 00000100:00080000:3.0:1789136310.764047:0:3637:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0001-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:3.0:1789136310.764051:0:3637:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:3.0:1789136310.764053:0:3637:0:(import.c:65:import_set_state_nolock()) ffff90a7f6294800 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1789136310.764058:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7f662cf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3637:1876044666926208:0@lo:38:llog_process_th.0 00000040:00080000:1.0:1789136310.767024:0:25677:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x10:0x0] index 52 count 51 00000020:01000000:3.0:1789136310.767644:0:25662:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:3.0:1789136310.767671:0:25662:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.131@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1789136310.767688:0:25662:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.131@tcp lock: ffff90a7e1c9f600/0x559c8745c6de47e4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x559c8745c6de47eb expref: -99 pid: 25662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136310.767701:0:25662:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.131@tcp lock: ffff90a7e1c9f600/0x559c8745c6de47e4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x559c8745c6de47eb expref: -99 pid: 25662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:3.0:1789136310.767760:0:25662:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:3.0:1789136310.767763:0:25662:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1789136310.767765:0:25662:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789136310.767766:0:25662:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789136310.767767:0:25662:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789136310.767769:0:25662:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789136310.767770:0:25662:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1789136310.767772:0:25662:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789136310.767774:0:25662:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1789136310.767777:0:25662:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020002 00000020:01000004:3.0:1789136310.767779:0:25662:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1789136310.767781:0:25662:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1789136310.767781:0:25662:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789136310.767782:0:25662:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789136310.767783:0:25662:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789136310.767784:0:25662:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789136310.767785:0:25662:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1789136310.767786:0:25662:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789136310.767787:0:25662:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1789136310.767814:0:25662:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:3.0:1789136310.767836:0:25662:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c3fe0780 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b11da215-324d-4c8d-90a5-0b7f26186c4c:25662:1876044666926336:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1789136310.767932:0:25662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789136310.767981:0:25662:0:(client.c:2715:ptlrpc_set_wait()) set ffff90a7c78e6600 going to sleep for 11 seconds 00000100:00100000:1.0:1789136310.768026:0:23327:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666926336 00000100:00100000:1.0:1789136310.768034:0:23327:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666926336 00000100:00100000:1.0:1789136310.768081:0:23327:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:1.0:1789136310.768090:0:23327:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7c4fff850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b11da215-324d-4c8d-90a5-0b7f26186c4c+24:25662:x1876044666926336:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1789136310.768136:0:23327:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:1.0:1789136310.768150:0:23327:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:1.0:1789136310.774760:0:23327:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1789136310.774779:0:23327:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:2.0:1789136310.775032:0:23349:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1789136310.775037:0:23349:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1789136310.775061:0:23349:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff90a7c0031800/0x559c8745c6de481c lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 23349 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136310.775079:0:23349:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90a6c3cafe00/0x559c8745c6de46b0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x559c8745c6de46a9 expref: 24 pid: 23327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136310.775087:0:23349:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90a6c3caf600/0x559c8745c6de46be lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x559c8745c6de46b7 expref: 24 pid: 23324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136310.775094:0:23349:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff90a7c0031800/0x559c8745c6de481c lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 23349 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136310.775136:0:23349:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90a6c3caf600/0x559c8745c6de46be lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x559c8745c6de46b7 expref: 24 pid: 23324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136310.775165:0:23349:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff90a6c3caf600/0x559c8745c6de46be lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x559c8745c6de46b7 expref: 24 pid: 23324 timeout: 858 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789136310.775179:0:23349:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c4762580 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:23349:1876044666926464:0@lo:104: 00000100:00100000:2.0:1789136310.775246:0:23349:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1789136310.775312:0:23349:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90a6c3cafe00/0x559c8745c6de46b0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x559c8745c6de46a9 expref: 24 pid: 23327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136310.775329:0:23349:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff90a6c3cafe00/0x559c8745c6de46b0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x559c8745c6de46a9 expref: 24 pid: 23327 timeout: 858 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789136310.775337:0:23349:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c4761680 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:23349:1876044666926592:0@lo:104: 00000100:00100000:2.0:1789136310.775358:0:23349:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789136310.775369:0:23349:0:(client.c:2715:ptlrpc_set_wait()) set ffff90a7e076f0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789136310.775489:0:23316:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666926464 00000100:00100000:1.0:1789136310.775496:0:23316:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666926464 00000100:00100000:1.0:1789136310.775531:0:23316:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666926592 00000100:00100000:1.0:1789136310.775533:0:23316:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666926592 00000100:00100000:1.0:1789136310.775545:0:23316:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1789136310.775553:0:23316:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c4761a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:b11da215-324d-4c8d-90a5-0b7f26186c4c+4:23349:x1876044666926464:12345-0@lo:104: 00010000:00010000:1.0:1789136310.775566:0:23316:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.131@tcp lock: ffff90a7e1c9e200/0x559c8745c6de46b7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x559c8745c6de46be expref: -99 pid: 23329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136310.775624:0:23316:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1789136310.775630:0:23316:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c4761a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:b11da215-324d-4c8d-90a5-0b7f26186c4c+4:23349:x1876044666926464:12345-0@lo:104: Request processed in 78us (384us total) trans 0 rc 0/0 00000100:00100000:1.0:1789136310.775637:0:23316:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1789136310.775656:0:23316:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1789136310.775662:0:23316:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c4763840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:b11da215-324d-4c8d-90a5-0b7f26186c4c+3:23349:x1876044666926592:12345-0@lo:104: 00010000:00010000:1.0:1789136310.775669:0:23316:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.131@tcp lock: ffff90a7e1c9ee00/0x559c8745c6de46a9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x559c8745c6de46b0 expref: -99 pid: 23329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136310.775702:0:23316:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1789136310.775707:0:23316:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c4763840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:b11da215-324d-4c8d-90a5-0b7f26186c4c+3:23349:x1876044666926592:12345-0@lo:104: Request processed in 46us (349us total) trans 0 rc 0/0 00000100:00100000:1.0:1789136310.775713:0:23316:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00010000:1.0:1789136310.775729:0:23320:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1789136310.775734:0:23320:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.131@tcp lock: ffff90a7e1c9e200/0x559c8745c6de46b7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x559c8745c6de46be expref: -99 pid: 23329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136310.775747:0:23320:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a7e1c9e200 already unused, calling callback (ffffffffc13bbc20) 10000000:00010000:1.0:1789136310.775751:0:23320:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.131@tcp lock: ffff90a7e1c9e200/0x559c8745c6de46b7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x559c8745c6de46be expref: -99 pid: 23329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136310.775759:0:23320:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.131@tcp lock: ffff90a7e1c9e200/0x559c8745c6de46b7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x559c8745c6de46be expref: -99 pid: 23329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789136310.775767:0:23320:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.131@tcp lock: ffff90a7e1c9e200/0x559c8745c6de46b7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x559c8745c6de46be expref: -99 pid: 23329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789136310.775773:0:23320:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1789136310.775800:0:23320:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.131@tcp lock: ffff90a7e1c9e200/0x559c8745c6de46b7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x559c8745c6de46be expref: -99 pid: 23329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136310.775807:0:23320:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789136310.775828:0:23320:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.131@tcp lock: ffff90a7e1c9e200/0x559c8745c6de46b7 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x559c8745c6de46be expref: -99 pid: 23329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136310.775834:0:23320:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.131@tcp lock: ffff90a7e1c9e200/0x559c8745c6de46b7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x559c8745c6de46be expref: -99 pid: 23329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136310.775845:0:23320:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789136310.775848:0:23320:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.131@tcp lock: ffff90a7e1c9ee00/0x559c8745c6de46a9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x559c8745c6de46b0 expref: -99 pid: 23329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136310.775884:0:23320:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a7e1c9ee00 already unused, calling callback (ffffffffc13bbc20) 10000000:00010000:1.0:1789136310.775888:0:23320:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.131@tcp lock: ffff90a7e1c9ee00/0x559c8745c6de46a9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x559c8745c6de46b0 expref: -99 pid: 23329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136310.775905:0:23320:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.131@tcp lock: ffff90a7e1c9ee00/0x559c8745c6de46a9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x559c8745c6de46b0 expref: -99 pid: 23329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789136310.775911:0:23320:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.131@tcp lock: ffff90a7e1c9ee00/0x559c8745c6de46a9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x559c8745c6de46b0 expref: -99 pid: 23329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789136310.775915:0:23320:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1789136310.775929:0:23320:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.131@tcp lock: ffff90a7e1c9ee00/0x559c8745c6de46a9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x559c8745c6de46b0 expref: -99 pid: 23329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136310.775934:0:23320:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789136310.775941:0:23320:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.131@tcp lock: ffff90a7e1c9ee00/0x559c8745c6de46a9 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x559c8745c6de46b0 expref: -99 pid: 23329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136310.775948:0:23320:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.131@tcp lock: ffff90a7e1c9ee00/0x559c8745c6de46a9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x559c8745c6de46b0 expref: -99 pid: 23329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136310.775960:0:23320:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789136310.775962:0:23320:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789136310.775967:0:23320:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789136310.775982:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7f662ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b11da215-324d-4c8d-90a5-0b7f26186c4c:3640:1876044666926720:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789136310.776011:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789136310.776029:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789136310.776035:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7f662e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b11da215-324d-4c8d-90a5-0b7f26186c4c:3640:1876044666926848:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789136310.776054:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1789136310.776278:0:23321:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789136310.776302:0:23318:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666926720 00000100:00100000:2.0:1789136310.776306:0:23318:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666926720 00010000:00010000:2.0:1789136310.776324:0:23318:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90a6c3caf600/0x559c8745c6de46be lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x559c8745c6de46b7 expref: 25 pid: 23324 timeout: 858 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789136310.776350:0:23318:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666926848 00000100:00100000:2.0:1789136310.776353:0:23318:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666926848 00010000:00010000:2.0:1789136310.776364:0:23318:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90a6c3cafe00/0x559c8745c6de46b0 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x559c8745c6de46a9 expref: 26 pid: 23327 timeout: 858 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789136310.776376:0:23318:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1789136310.776382:0:23318:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7f662cf00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b11da215-324d-4c8d-90a5-0b7f26186c4c+26:3640:x1876044666926720:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789136310.776507:0:23318:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789136310.776513:0:23318:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90a6c3caf600/0x559c8745c6de46be lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x559c8745c6de46b7 expref: 26 pid: 23324 timeout: 858 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136310.776523:0:23318:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90a6c3caf600/0x559c8745c6de46be lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x559c8745c6de46b7 expref: 26 pid: 23324 timeout: 858 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136310.776537:0:23318:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789136310.776568:0:23318:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7f662cf00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b11da215-324d-4c8d-90a5-0b7f26186c4c+26:3640:x1876044666926720:12345-0@lo:103:ldlm_bl.0 Request processed in 187us (556us total) trans 0 rc 0/0 00000100:00100000:2.0:1789136310.776582:0:23318:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1789136310.776597:0:23318:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1789136310.776603:0:23318:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7f662d680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b11da215-324d-4c8d-90a5-0b7f26186c4c+25:3640:x1876044666926848:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789136310.776610:0:23318:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789136310.776702:0:23318:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90a6c3cafe00/0x559c8745c6de46b0 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x559c8745c6de46a9 expref: 25 pid: 23327 timeout: 858 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136310.776713:0:23318:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90a6c3cafe00/0x559c8745c6de46b0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x559c8745c6de46a9 expref: 25 pid: 23327 timeout: 858 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136310.776725:0:23318:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff90a7c0031800/0x559c8745c6de481c lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 23349 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136310.776733:0:23318:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90a7c0031800/0x559c8745c6de481c lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 23349 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1789136310.776749:0:23318:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.006523026s 00010000:00010000:2.0:1789136310.776753:0:23318:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff90a7c0031800/0x559c8745c6de481c lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 23349 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136310.776759:0:23318:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff90a7c0031800/0x559c8745c6de481c lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 23349 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136310.776765:0:23318:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff90a7c0031800/0x559c8745c6de481c lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 23349 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136310.776772:0:23318:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff90a7c0031800/0x559c8745c6de481c lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 23349 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136310.776777:0:23318:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a7c0031800 already unused, calling callback (ffffffffc0dbf540) 00010000:00010000:2.0:1789136310.776786:0:23318:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff90a7c0031800/0x559c8745c6de481c lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 23349 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136310.776795:0:23318:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff90a7c0031800/0x559c8745c6de481c lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 23349 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136310.776803:0:23318:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff90a7c0031800/0x559c8745c6de481c lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 23349 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136310.776812:0:23318:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789136310.776836:0:23318:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7f662d680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b11da215-324d-4c8d-90a5-0b7f26186c4c+25:3640:x1876044666926848:12345-0@lo:103:ldlm_bl.0 Request processed in 234us (781us total) trans 0 rc 0/0 00000100:00100000:2.0:1789136310.776842:0:23318:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00010000:1.0:1789136310.776940:0:23349:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90a6c3caf600/0x559c8745c6de46be lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x559c8745c6de46b7 expref: 24 pid: 23324 timeout: 858 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789136310.776951:0:23349:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c4762580 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:23349:1876044666926464:0@lo:104: 00010000:00010000:1.0:1789136310.776972:0:23349:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90a6c3cafe00/0x559c8745c6de46b0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x559c8745c6de46a9 expref: 23 pid: 23327 timeout: 858 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789136310.776980:0:23349:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c4761680 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:23349:1876044666926592:0@lo:104: 00010000:00010000:1.0:1789136310.776997:0:23349:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff90a7c0031800/0x559c8745c6de481c lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 23349 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136310.777006:0:23349:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff90a7c0031800/0x559c8745c6de481c lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 23349 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136310.777012:0:23349:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff90a7c0031800/0x559c8745c6de481c lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 23349 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136310.777020:0:23349:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90a7c0031800/0x559c8745c6de481c lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 23349 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789136310.777334:0:23327:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7c4fff850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b11da215-324d-4c8d-90a5-0b7f26186c4c+22:25662:x1876044666926336:12345-0@lo:253:mount.lustre.0 Request processed in 9244us (9401us total) trans 0 rc 0/0 00000100:00100000:1.0:1789136310.777344:0:23327:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:0.0:1789136310.777707:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7f662e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b11da215-324d-4c8d-90a5-0b7f26186c4c:3640:1876044666926848:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789136310.777729:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7f662ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b11da215-324d-4c8d-90a5-0b7f26186c4c:3640:1876044666926720:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789136310.778021:0:25662:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c3fe0780 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b11da215-324d-4c8d-90a5-0b7f26186c4c:25662:1876044666926336:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1789136310.778034:0:25662:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:2.0:1789136310.778037:0:25662:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1789136310.778039:0:25662:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1789136310.778040:0:25662:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789136310.778041:0:25662:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789136310.778042:0:25662:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789136310.778043:0:25662:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789136310.778045:0:25662:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1789136310.778047:0:25662:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789136310.778048:0:25662:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1789136310.778060:0:25662:0:(tgt_mount.c:2692:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00000001:00000004:3.0:1789136310.785960:0:25662:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 3, last_transno is 12884901888 00002000:00080000:3.0:1789136310.790067:0:25662:0:(ofd_obd.c:543:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:3.0:1789136310.790077:0:25662:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:3.0:1789136310.790174:0:25662:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:3.0:1789136310.790216:0:25662:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.201.131@tcp: cl_mgc_mutex unlock 00000020:01000004:3.0:1789136310.790237:0:25662:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=50 00000080:00000004:3.0:1789136310.790330:0:25662:0:(super25.c:182:lustre_fill_super()) /dev/mapper/ost2_flakey: Mount complete 00000020:00000004:3.0:1789136310.791324:0:25662:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1789136310.791565:0:25662:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1789136311.024237:0:23320:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789136311.146117:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789136311.146152:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c3fe21c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1876044666926976:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1789136311.146270:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789136311.146342:0:23339:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666926976 00000100:00100000:3.0:1789136311.146352:0:23339:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666926976 00000100:00100000:3.0:1789136311.146430:0:23339:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1789136311.146443:0:23339:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c3fe0b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3639:x1876044666926976:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1789136311.146489:0:23339:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:3.0:1789136311.146546:0:23339:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c3fe0b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3639:x1876044666926976:12345-0@lo:41:osp-pre-1-0.0 Request processed in 106us (277us total) trans 0 rc 0/0 00000100:00100000:3.0:1789136311.146557:0:23339:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1789136311.146615:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c3fe21c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1876044666926976:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1789136311.146648:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c4762940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1876044666927104:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1789136311.146675:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789136311.146806:0:23338:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666927104 00000100:00100000:2.0:1789136311.146823:0:23338:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666927104 00000100:00100000:2.0:1789136311.146935:0:23338:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1789136311.146948:0:23338:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c3fe21c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3639:x1876044666927104:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1789136311.146985:0:23338:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446309888 avail 1300070400 00000100:00100000:2.0:1789136311.147092:0:23338:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c3fe21c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3639:x1876044666927104:12345-0@lo:41:osp-pre-0-1.0 Request processed in 139us (407us total) trans 0 rc 0/0 00000100:00100000:3.0:1789136311.147119:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c4762940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1876044666927104:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1789136311.147120:0:23338:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00010000:00010000:2.0:1789136312.041216:0:23321:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:3.0:1789136312.064407:0:25730:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1789136312.064732:0:25730:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 10000000:01000000:2.0:1789136312.296516:0:23329:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1789136312.296524:0:23329:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff90a6c3ba1800 from 14 10000000:01000000:2.0:1789136312.296531:0:23329:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1789136312.296580:0:23329:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.131@tcp lock: ffff90a7c0031e00/0x559c8745c6de4823 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 23329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136312.296592:0:23329:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.131@tcp lock: ffff90a7c0031e00/0x559c8745c6de4823 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 23329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136312.296604:0:23329:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.131@tcp lock: ffff90a7c0031e00/0x559c8745c6de4823 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 23329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789136312.296633:0:23329:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c4761680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b11da215-324d-4c8d-90a5-0b7f26186c4c:23329:1876044666927232:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789136312.296709:0:23329:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789136312.296754:0:23329:0:(client.c:2715:ptlrpc_set_wait()) set ffff90a7c2bbc6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789136312.297010:0:23325:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666927232 00000100:00100000:0.0:1789136312.297026:0:23325:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666927232 00000100:00100000:0.0:1789136312.297104:0:23325:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:0.0:1789136312.297116:0:23325:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7c4ffcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b11da215-324d-4c8d-90a5-0b7f26186c4c+22:23329:x1876044666927232:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789136312.297135:0:23325:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789136312.297157:0:23325:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90a7d1879800/0x559c8745c6de482a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x559c8745c6de4823 expref: -99 pid: 23325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136312.297191:0:23325:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90a7d1879800/0x559c8745c6de482a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x559c8745c6de4823 expref: 23 pid: 23325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136312.297204:0:23325:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90a7d1879800/0x559c8745c6de482a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x559c8745c6de4823 expref: 23 pid: 23325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136312.297216:0:23325:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a7d1879800, rc 0) 00000100:00100000:0.0:1789136312.297299:0:23325:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7c4ffcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b11da215-324d-4c8d-90a5-0b7f26186c4c+23:23329:x1876044666927232:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 185us (590us total) trans 0 rc 0/0 00000100:00100000:0.0:1789136312.297308:0:23325:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:2.0:1789136312.297346:0:23329:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c4761680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b11da215-324d-4c8d-90a5-0b7f26186c4c:23329:1876044666927232:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789136312.297371:0:23329:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.131@tcp lock: ffff90a7c0031e00/0x559c8745c6de4823 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x559c8745c6de482a expref: -99 pid: 23329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136312.297384:0:23329:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.131@tcp lock: ffff90a7c0031e00/0x559c8745c6de4823 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x559c8745c6de482a expref: -99 pid: 23329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789136312.297446:0:23329:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c4761680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b11da215-324d-4c8d-90a5-0b7f26186c4c:23329:1876044666927360:0@lo:256:ll_cfg_requeue.0 00000100:00100000:2.0:1789136312.297494:0:23329:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789136312.297524:0:23329:0:(client.c:2715:ptlrpc_set_wait()) set ffff90a7c2bbc6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789136312.297700:0:23327:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666927360 00000100:00100000:0.0:1789136312.297706:0:23327:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666927360 00000100:00100000:0.0:1789136312.297741:0:23327:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:0.0:1789136312.297748:0:23327:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7c4ffec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b11da215-324d-4c8d-90a5-0b7f26186c4c+23:23329:x1876044666927360:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:0.0:1789136312.297767:0:23327:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1789136312.297791:0:23327:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1789136312.297794:0:23327:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 14 00000100:00100000:0.0:1789136312.297952:0:23327:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7c4ffec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b11da215-324d-4c8d-90a5-0b7f26186c4c+23:23329:x1876044666927360:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 204us (457us total) trans 0 rc 0/0 00000100:00100000:0.0:1789136312.297966:0:23327:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:2.0:1789136312.298005:0:23329:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c4761680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b11da215-324d-4c8d-90a5-0b7f26186c4c:23329:1876044666927360:0@lo:256:ll_cfg_requeue.0 10000000:01000000:2.0:1789136312.298238:0:23329:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.131@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1789136312.298247:0:23329:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.131@tcp lock: ffff90a7c0031e00/0x559c8745c6de4823 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x559c8745c6de482a expref: -99 pid: 23329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136312.298257:0:23329:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.131@tcp lock: ffff90a7c0031e00/0x559c8745c6de4823 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x559c8745c6de482a expref: -99 pid: 23329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789136312.298267:0:23329:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1789136312.298269:0:23329:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff90a7fa55b800 from 14 10000000:01000000:2.0:1789136312.298271:0:23329:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1789136312.298296:0:23329:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.131@tcp lock: ffff90a7c0030200/0x559c8745c6de4831 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 23329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136312.298303:0:23329:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.131@tcp lock: ffff90a7c0030200/0x559c8745c6de4831 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 23329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136312.298310:0:23329:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.131@tcp lock: ffff90a7c0030200/0x559c8745c6de4831 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 23329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789136312.298322:0:23329:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c4761680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b11da215-324d-4c8d-90a5-0b7f26186c4c:23329:1876044666927488:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789136312.298362:0:23329:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789136312.298392:0:23329:0:(client.c:2715:ptlrpc_set_wait()) set ffff90a7c2bbc6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789136312.298460:0:23325:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666927488 00000100:00100000:0.0:1789136312.298478:0:23325:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666927488 00000100:00100000:0.0:1789136312.298564:0:23325:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:0.0:1789136312.298573:0:23325:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7dd563050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b11da215-324d-4c8d-90a5-0b7f26186c4c+23:23329:x1876044666927488:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789136312.298585:0:23325:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789136312.298597:0:23325:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90a7d1878a00/0x559c8745c6de4838 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x559c8745c6de4831 expref: -99 pid: 23325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136312.298617:0:23325:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90a7d1878a00/0x559c8745c6de4838 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x559c8745c6de4831 expref: 24 pid: 23325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136312.298627:0:23325:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90a7d1878a00/0x559c8745c6de4838 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x559c8745c6de4831 expref: 24 pid: 23325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136312.298635:0:23325:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a7d1878a00, rc 0) 00000100:00100000:0.0:1789136312.298676:0:23325:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7dd563050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b11da215-324d-4c8d-90a5-0b7f26186c4c+24:23329:x1876044666927488:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 103us (313us total) trans 0 rc 0/0 00000100:00100000:0.0:1789136312.298683:0:23325:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:3.0:1789136312.301404:0:23329:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c4761680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b11da215-324d-4c8d-90a5-0b7f26186c4c:23329:1876044666927488:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789136312.301439:0:23329:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.131@tcp lock: ffff90a7c0030200/0x559c8745c6de4831 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x559c8745c6de4838 expref: -99 pid: 23329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136312.301452:0:23329:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.131@tcp lock: ffff90a7c0030200/0x559c8745c6de4831 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x559c8745c6de4838 expref: -99 pid: 23329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789136312.301592:0:23329:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c3fe03c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b11da215-324d-4c8d-90a5-0b7f26186c4c:23329:1876044666927616:0@lo:256:ll_cfg_requeue.0 00000100:00100000:3.0:1789136312.301732:0:23329:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789136312.301982:0:23329:0:(client.c:2715:ptlrpc_set_wait()) set ffff90a6c2f68540 going to sleep for 11 seconds 00000100:00100000:2.0:1789136312.302078:0:23324:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666927616 00000100:00100000:2.0:1789136312.302257:0:23324:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666927616 00000100:00100000:2.0:1789136312.302305:0:23324:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:2.0:1789136312.302315:0:23324:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7dd562050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b11da215-324d-4c8d-90a5-0b7f26186c4c+24:23329:x1876044666927616:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:2.0:1789136312.302337:0:23324:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1789136312.302358:0:23324:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1789136312.302362:0:23324:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 14 00000100:00100000:2.0:1789136312.302727:0:23324:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7dd562050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b11da215-324d-4c8d-90a5-0b7f26186c4c+24:23329:x1876044666927616:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 413us (996us total) trans 0 rc 0/0 00000100:00100000:2.0:1789136312.302739:0:23324:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:3.0:1789136312.308791:0:23329:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c3fe03c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b11da215-324d-4c8d-90a5-0b7f26186c4c:23329:1876044666927616:0@lo:256:ll_cfg_requeue.0 10000000:01000000:3.0:1789136312.308966:0:23329:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.131@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1789136312.308977:0:23329:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.131@tcp lock: ffff90a7c0030200/0x559c8745c6de4831 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x559c8745c6de4838 expref: -99 pid: 23329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136312.308987:0:23329:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.131@tcp lock: ffff90a7c0030200/0x559c8745c6de4831 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x559c8745c6de4838 expref: -99 pid: 23329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1789136312.683788:0:23370:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1789136313.068299:0:23320:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789136314.088524:0:23321:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789136315.120192:0:23320:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789136315.753050:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c3fe1680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1876044666927744:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789136315.753128:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789136315.753188:0:24849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666927744 00000100:00100000:3.0:1789136315.753195:0:24849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666927744 00000100:00100000:3.0:1789136315.753248:0:24849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1789136315.753257:0:24849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c3fe3840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1876044666927744:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789136315.753288:0:24849:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3915853824 avail 3684331520 00000100:00100000:3.0:1789136315.753332:0:24849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c3fe3840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1876044666927744:12345-0@lo:13:osp-pre-0-0.0 Request processed in 76us (203us total) trans 0 rc 0/0 00000100:00100000:3.0:1789136315.753339:0:24849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00080000:3.0:1789136315.753359:0:23328:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789136315.753397:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c3fe1680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1876044666927744:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789136315.753517:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7f662e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1876044666927872:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1789136315.753568:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789136315.753604:0:24849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666927872 00000100:00100000:1.0:1789136315.753607:0:24849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666927872 00000100:00100000:1.0:1789136315.753641:0:24849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1789136315.753646:0:24849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7f662ed00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1876044666927872:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1789136315.753658:0:24849:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3915853824 avail 3684331520 00000100:00100000:1.0:1789136315.753687:0:24849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7f662ed00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1876044666927872:12345-0@lo:13:osp-pre-0-1.0 Request processed in 41us (129us total) trans 0 rc 0/0 00000100:00100000:1.0:1789136315.753709:0:24849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00080000:1.0:1789136315.753727:0:23328:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789136315.753748:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7f662e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1876044666927872:0@lo:13:osp-pre-0-1.0 00010000:00010000:2.0:1789136316.137223:0:23321:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789136316.265386:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789136316.265409:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c3fe1680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1876044666928000:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1789136316.265477:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789136316.265541:0:23339:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666928000 00000100:00100000:3.0:1789136316.265548:0:23339:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666928000 00000100:00100000:3.0:1789136316.265605:0:23339:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1789136316.265613:0:23339:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c3fe3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3639:x1876044666928000:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1789136316.265655:0:23339:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:3.0:1789136316.265701:0:23339:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c3fe3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3639:x1876044666928000:12345-0@lo:41:osp-pre-1-0.0 Request processed in 89us (224us total) trans 0 rc 0/0 00000100:00100000:3.0:1789136316.265709:0:23339:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1789136316.265914:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c3fe1680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1876044666928000:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1789136316.271750:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789136316.271783:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7f662e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1876044666928128:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1789136316.271875:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789136316.271948:0:23338:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666928128 00000100:00100000:1.0:1789136316.271955:0:23338:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666928128 00000100:00100000:1.0:1789136316.272003:0:23338:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1789136316.272013:0:23338:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7fa39a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3638:x1876044666928128:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1789136316.272048:0:23338:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446309888 avail 1300070400 00000100:00100000:1.0:1789136316.272092:0:23338:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7fa39a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3638:x1876044666928128:12345-0@lo:41:osp-pre-0-1.0 Request processed in 81us (240us total) trans 0 rc 0/0 00000100:00100000:1.0:1789136316.272099:0:23338:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1789136316.272144:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7f662e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1876044666928128:0@lo:41:osp-pre-0-1.0 00000100:00080000:0.0:1789136316.273078:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789136316.273083:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1789136316.273087:0:38:0:(import.c:65:import_set_state_nolock()) ffff90a6c228c000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1789136316.273095:0:38:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff90a6c228c000 using connection 192.168.201.131@tcp/0@lo 00000100:00100000:0.0:1789136316.273115:0:38:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff90a6c109a580 x1876044666928512/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1789136316.273173:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789136316.273177:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1789136316.273179:0:38:0:(import.c:65:import_set_state_nolock()) ffff90a7d8b2a800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1789136316.273184:0:38:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff90a7d8b2a800 using connection 192.168.201.131@tcp/0@lo 00000100:00100000:0.0:1789136316.273197:0:38:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff90a6c1099680 x1876044666928896/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1789136316.273252:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c1099a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1876044666928384:0@lo:400:kworker.0 00000100:00100000:0.0:1789136316.273301:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789136316.273327:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7d55acf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3641:1876044666929152:0@lo:400:kworker.0 00000100:00100000:0.0:1789136316.273353:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789136316.273375:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:0.0:1789136316.273381:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c10992c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b11da215-324d-4c8d-90a5-0b7f26186c4c:3641:1876044666928256:0@lo:400:kworker.0 00000100:00100000:0.0:1789136316.273411:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789136316.273444:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c1098f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3641:1876044666929024:0@lo:400:kworker.0 00000100:00100000:0.0:1789136316.273467:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789136316.273484:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7d55ac000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3641:1876044666929536:0@lo:400:kworker.0 00000100:00100000:0.0:1789136316.273510:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789136316.273537:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c109a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3637:1876044666928512:0@lo:8:kworker.0 00000100:00100000:1.0:1789136316.274691:0:23334:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666929152 00000100:00100000:1.0:1789136316.274702:0:23334:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666929152 00000100:00100000:1.0:1789136316.274842:0:23334:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666929024 00000100:00100000:1.0:1789136316.274847:0:23334:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666929024 00000100:00100000:1.0:1789136316.274886:0:23334:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666929536 00000100:00100000:1.0:1789136316.274889:0:23334:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666929536 00000100:00100000:1.0:1789136316.274909:0:23334:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1789136316.274918:0:23334:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7d55af840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3641:x1876044666929152:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789136316.282353:0:23334:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7d55af840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3641:x1876044666929152:12345-0@lo:400:kworker.0 Request processed in 7425us (8988us total) trans 0 rc 0/0 00000100:00100000:1.0:1789136316.282369:0:23334:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1789136316.282420:0:23334:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1789136316.282433:0:23334:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7d55afc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1876044666929024:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789136316.282486:0:23334:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7d55afc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1876044666929024:12345-0@lo:400:kworker.0 Request processed in 58us (9018us total) trans 0 rc 0/0 00000100:00100000:1.0:1789136316.282492:0:23334:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1789136316.282505:0:23334:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1789136316.282513:0:23334:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7d55acb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3641:x1876044666929536:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789136316.282543:0:23334:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7d55acb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3641:x1876044666929536:12345-0@lo:400:kworker.0 Request processed in 32us (9032us total) trans 0 rc 0/0 00000100:00100000:1.0:1789136316.282560:0:23334:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1789136316.282585:0:24846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666928384 00000100:00100000:1.0:1789136316.282593:0:24846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666928384 00000100:00100000:1.0:1789136316.282629:0:24846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1789136316.282635:0:24846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7d55ad2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3641:x1876044666928384:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789136316.282666:0:24846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7d55ad2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3641:x1876044666928384:12345-0@lo:400:kworker.0 Request processed in 31us (9365us total) trans 0 rc 0/0 00000100:00100000:1.0:1789136316.282671:0:24846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00080000:1.0:1789136316.282687:0:23328:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1789136316.282692:0:23328:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789136316.282709:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c109bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1876044666928768:0@lo:400:kworker.0 00000100:00100000:1.0:1789136316.282759:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789136316.282800:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7d55af480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3639:1876044666929408:0@lo:400:kworker.0 00000100:00100000:1.0:1789136316.282829:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789136316.282849:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1789136316.282874:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c1099e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3639:1876044666928640:0@lo:400:kworker.0 00000100:00100000:1.0:1789136316.282897:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789136316.282918:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7d55aed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3639:1876044666929280:0@lo:400:kworker.0 00000100:00100000:1.0:1789136316.282953:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789136316.282973:0:24845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666928768 00000100:00100000:1.0:1789136316.282976:0:24845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666928768 00000100:00100000:1.0:1789136316.282998:0:24845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1789136316.283004:0:24845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7fa3983c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3639:x1876044666928768:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789136316.283037:0:24845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7fa3983c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3639:x1876044666928768:12345-0@lo:400:kworker.0 Request processed in 34us (277us total) trans 0 rc 0/0 00000100:00100000:1.0:1789136316.283044:0:24845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1789136316.283082:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c109bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1876044666928768:0@lo:400:kworker.0 00000100:00100000:1.0:1789136316.283117:0:23334:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666929408 00000100:00100000:1.0:1789136316.283120:0:23334:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666929408 00000100:00100000:1.0:1789136316.283146:0:23334:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666928640 00000100:00100000:1.0:1789136316.283148:0:23334:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666928640 00000100:00100000:1.0:1789136316.283157:0:23334:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666929280 00000100:00100000:1.0:1789136316.283160:0:23334:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666929280 00000100:00100000:1.0:1789136316.283173:0:23334:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1789136316.283178:0:23334:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7fa398000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3639:x1876044666929408:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789136316.283209:0:23334:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7fa398000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3639:x1876044666929408:12345-0@lo:400:kworker.0 Request processed in 31us (380us total) trans 0 rc 0/0 00000100:00100000:1.0:1789136316.283214:0:23334:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1789136316.283226:0:23334:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1789136316.283232:0:23334:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7fa39b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3639:x1876044666928640:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789136316.283259:0:23334:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7fa39b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3639:x1876044666928640:12345-0@lo:400:kworker.0 Request processed in 27us (361us total) trans 0 rc 0/0 00000100:00100000:1.0:1789136316.283265:0:23334:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1789136316.283276:0:23334:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1789136316.283289:0:23334:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7fa399e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3639:x1876044666929280:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789136316.283314:0:23334:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7fa399e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3639:x1876044666929280:12345-0@lo:400:kworker.0 Request processed in 27us (361us total) trans 0 rc 0/0 00000100:00100000:1.0:1789136316.283320:0:23334:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00080000:1.0:1789136316.283334:0:23328:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1789136316.283337:0:23328:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1789136316.283355:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90a6c1099e00 x1876044666928640/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789136332 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789136316.283366:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c1099e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3639:1876044666928640:0@lo:400:kworker.0 00010000:00080000:1.0:1789136316.283376:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90a7d55aed00 x1876044666929280/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789136332 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789136316.283385:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7d55aed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3639:1876044666929280:0@lo:400:kworker.0 00010000:00080000:1.0:1789136316.283394:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90a7d55af480 x1876044666929408/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789136332 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789136316.283402:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7d55af480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3639:1876044666929408:0@lo:400:kworker.0 00000100:00100000:2.0:1789136316.285273:0:23324:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666928256 00000100:00100000:2.0:1789136316.285285:0:23324:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666928256 00000100:00100000:2.0:1789136316.285340:0:23324:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:2.0:1789136316.285349:0:23324:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7dd562850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b11da215-324d-4c8d-90a5-0b7f26186c4c+24:3641:x1876044666928256:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789136316.285427:0:23324:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7dd562850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b11da215-324d-4c8d-90a5-0b7f26186c4c+24:3641:x1876044666928256:12345-0@lo:400:kworker.0 Request processed in 79us (12015us total) trans 0 rc 0/0 00000100:00100000:2.0:1789136316.285434:0:23324:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:0.0:1789136316.285897:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789136316.285968:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c10992c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b11da215-324d-4c8d-90a5-0b7f26186c4c:3641:1876044666928256:0@lo:400:kworker.0 00010000:00080000:0.0:1789136316.285986:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90a6c1098f00 x1876044666929024/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789136332 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789136316.285999:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c1098f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3641:1876044666929024:0@lo:400:kworker.0 00010000:00080000:0.0:1789136316.286030:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90a7d55ac000 x1876044666929536/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789136332 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789136316.286040:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7d55ac000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3641:1876044666929536:0@lo:400:kworker.0 00000100:00100000:0.0:1789136316.286054:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c1099a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1876044666928384:0@lo:400:kworker.0 00010000:00080000:0.0:1789136316.286066:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90a7d55acf00 x1876044666929152/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789136332 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789136316.286075:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7d55acf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3641:1876044666929152:0@lo:400:kworker.0 00000100:00100000:0.0:1789136316.286120:0:24847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666928512 00000100:00100000:0.0:1789136316.286125:0:24847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666928512 00000100:00100000:0.0:1789136316.286152:0:24847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1789136316.286157:0:24847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7d55ae580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3637:x1876044666928512:12345-0@lo:8:kworker.0 00010000:00080000:0.0:1789136316.286191:0:24847:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 764 last 0 00000020:00000080:0.0:1789136316.286222:0:24847:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x559c8745c6de483f 00002000:00100000:0.0:1789136316.286235:0:24847:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff90a7f0966800 ocd_connect_flags: 0xa044401443000026 ocd_version: 211397f ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:0.0:1789136316.286240:0:24847:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00002000:00100000:0.0:1789136316.286243:0:24847:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:0.0:1789136316.286427:0:24847:0:(ofd_obd.c:389:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1789136316.286453:0:24847:0:(import.c:65:import_set_state_nolock()) ffff90a7f0961000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789136316.286497:0:24847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7d55ae580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3637:x1876044666928512:12345-0@lo:8:kworker.0 Request processed in 338us (600us total) trans 0 rc 0/0 00000100:00100000:0.0:1789136316.286505:0:24847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00080000:0.0:1789136316.286541:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90a6c109a580 x1876044666928512/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1789136341 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1789136316.286568:0:3637:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 3 00000100:00080000:0.0:1789136316.286584:0:3637:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:0.0:1789136316.286589:0:3637:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:0.0:1789136316.286592:0:3637:0:(import.c:65:import_set_state_nolock()) ffff90a6c228c000 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:0.0:1789136316.286606:0:3637:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:0.0:1789136316.286611:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c109a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3637:1876044666928512:0@lo:8:kworker.0 00000004:00080000:0.0:1789136316.286651:0:23360:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x2c0000401:0x6:0x0] 00000100:00100000:0.0:1789136316.286673:0:23360:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7d55ac000 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:23360:1876044666929792:0@lo:5:osp-pre-1-0.0 00000100:00100000:0.0:1789136316.286704:0:23360:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789136316.286721:0:23360:0:(client.c:2715:ptlrpc_set_wait()) set ffff90a6c2d230c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789136316.287035:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7d55acf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1876044666929664:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789136316.287064:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789136316.287096:0:25418:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666929792 00000100:00100000:0.0:1789136316.287100:0:25418:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666929792 00000100:00100000:0.0:1789136316.287131:0:25418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1789136316.287136:0:25418:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7d55ade00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:23360:x1876044666929792:12345-0@lo:5:osp-pre-1-0.0 00000100:00100000:0.0:1789136316.287343:0:24849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666929664 00000100:00100000:0.0:1789136316.287348:0:24849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666929664 00000100:00100000:0.0:1789136316.287377:0:24849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1789136316.287383:0:24849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7d55ad680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3641:x1876044666929664:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789136316.287401:0:24849:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923501056 avail 3691978752 00000100:00100000:0.0:1789136316.287440:0:24849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7d55ad680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3641:x1876044666929664:12345-0@lo:13:osp-pre-1-0.0 Request processed in 57us (375us total) trans 0 rc 0/0 00000100:00100000:0.0:1789136316.287446:0:24849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00080000:0.0:1789136316.287464:0:23328:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:0.0:1789136316.287486:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90a7d55acf00 x1876044666929664/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789136332 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789136316.287514:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7d55acf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1876044666929664:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789136316.287539:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c1099680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3637:1876044666928896:0@lo:8:kworker.0 00000004:00080000:2.0:1789136316.288170:0:23359:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:2.0:1789136316.288264:0:23359:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 764407408729ns, next at 0ns, rc = 0 00080000:00080000:2.0:1789136316.288272:0:23359:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0000: async commit OSD 00000004:00080000:2.0:1789136316.289709:0:23312:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00002000:00080000:0.0:1789136316.299382:0:25418:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x2c0000401 00002000:00080000:0.0:1789136316.299395:0:25418:0:(ofd_dev.c:1654:ofd_create_hdl()) ofd_last_id() = 65 -> diff = -59 00002000:02000040:0.0:1789136316.299403:0:25418:0:(ofd_dev.c:1505:ofd_orphans_destroy()) lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x2c0000401:7 to 0x2c0000401:65) 00000100:00100000:1.0:1789136316.300982:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789136316.301135:0:24845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666928896 00000100:00100000:2.0:1789136316.301144:0:24845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666928896 00000100:00100000:2.0:1789136316.301193:0:24845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1789136316.301200:0:24845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7fa398f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3637:x1876044666928896:12345-0@lo:8:kworker.0 00010000:00080000:2.0:1789136316.301236:0:24845:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 764 last 0 00000020:00000080:2.0:1789136316.301268:0:24845:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x559c8745c6de4846 00002000:00100000:2.0:1789136316.301285:0:24845:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0001-mdtlov_UUID/ffff90a6c44f0000 ocd_connect_flags: 0xa044401443000026 ocd_version: 211397f ocd_grant: 0 ocd_index: 1 ocd_group 1 00002000:00080000:2.0:1789136316.301289:0:24845:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 1 00002000:00100000:2.0:1789136316.301292:0:24845:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:2.0:1789136316.301361:0:24845:0:(ofd_obd.c:389:ofd_obd_connect()) lustre-OST0001: get connection from MDS 1 00000100:00080000:2.0:1789136316.301388:0:24845:0:(import.c:65:import_set_state_nolock()) ffff90a6c44f6000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789136316.301447:0:24845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7fa398f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:3637:x1876044666928896:12345-0@lo:8:kworker.0 Request processed in 245us (475us total) trans 0 rc 0/0 00000100:00100000:2.0:1789136316.301469:0:24845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00010000:00080000:1.0:1789136316.302681:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90a6c1099680 x1876044666928896/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/416 e 0 to 0 dl 1789136341 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1789136316.302699:0:3637:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0001: connect to target with instance 3 00000100:00080000:1.0:1789136316.302707:0:3637:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0001: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:1.0:1789136316.302713:0:3637:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:1.0:1789136316.302716:0:3637:0:(import.c:65:import_set_state_nolock()) ffff90a7d8b2a800 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:1.0:1789136316.302743:0:3637:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:1.0:1789136316.302749:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c1099680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3637:1876044666928896:0@lo:8:kworker.0 00000004:00080000:2.0:1789136316.302885:0:24081:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: going to cleanup orphans since [0x2c0000400:0x1:0x0] 00000100:00100000:2.0:1789136316.302909:0:24081:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c4762940 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:24081:1876044666930048:0@lo:7:osp-pre-1-1.0 00000100:00100000:2.0:1789136316.302954:0:24081:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789136316.302978:0:24081:0:(client.c:2715:ptlrpc_set_wait()) set ffff90a7c2bbcc00 going to sleep for 11 seconds 00000004:00080000:2.0:1789136316.302993:0:24080:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:2.0:1789136316.303076:0:24080:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 764422220375ns, next at 0ns, rc = 0 00080000:00080000:2.0:1789136316.303083:0:24080:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0001: async commit OSD 00000100:00100000:2.0:1789136316.303108:0:24846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666930048 00000100:00100000:2.0:1789136316.303114:0:24846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666930048 00000100:00100000:2.0:1789136316.303160:0:24846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1789136316.303169:0:24846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c4761680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:24081:x1876044666930048:12345-0@lo:7:osp-pre-1-1.0 00000100:00100000:1.0:1789136316.303579:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c4762580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1876044666929920:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1789136316.303615:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789136316.303695:0:24849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666929920 00000100:00100000:2.0:1789136316.303700:0:24849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666929920 00000100:00100000:2.0:1789136316.303734:0:24849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1789136316.303741:0:24849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7fa3992c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+7:3638:x1876044666929920:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1789136316.303757:0:24849:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923501056 avail 3691978752 00000100:00100000:2.0:1789136316.303809:0:24849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7fa3992c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+7:3638:x1876044666929920:12345-0@lo:13:osp-pre-1-1.0 Request processed in 68us (193us total) trans 0 rc 0/0 00000100:00100000:2.0:1789136316.303816:0:24849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00080000:1.0:1789136316.303898:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90a6c4762580 x1876044666929920/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789136332 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789136316.303916:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c4762580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1876044666929920:0@lo:13:osp-pre-1-1.0 00002000:00080000:1.0:1789136316.309182:0:24846:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x2c0000400 00002000:00080000:1.0:1789136316.309191:0:24846:0:(ofd_dev.c:1222:ofd_get_info_hdl()) lustre-OST0001: LAST FID is [0x2c0000400:0x41:0x0] 00000100:00100000:1.0:1789136316.309287:0:24846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c4761680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:24081:x1876044666930048:12345-0@lo:7:osp-pre-1-1.0 Request processed in 6114us (6327us total) trans 0 rc 0/0 00000100:00100000:1.0:1789136316.309298:0:24846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00010000:00080000:1.0:1789136316.309359:0:24081:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90a6c4762940 x1876044666930048/t0(0) o7->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 264/240 e 0 to 0 dl 1789136332 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789136316.309374:0:24081:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c4762940 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:24081:1876044666930048:0@lo:7:osp-pre-1-1.0 00000004:00080000:1.0:1789136316.309389:0:24081:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0001-osc-MDT0001: Got last_fid [0x2c0000400:0x41:0x0] 00000100:00100000:1.0:1789136316.309429:0:24081:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7fa398b40 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:24081:1876044666930176:0@lo:5:osp-pre-1-1.0 00000100:00100000:1.0:1789136316.309465:0:24081:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789136316.309487:0:24081:0:(client.c:2715:ptlrpc_set_wait()) set ffff90a7c6319b40 going to sleep for 11 seconds 00000100:00100000:1.0:1789136316.309505:0:24847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666930176 00000100:00100000:1.0:1789136316.309510:0:24847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666930176 00000100:00100000:1.0:1789136316.309554:0:24847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1789136316.309563:0:24847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7fa399680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:24081:x1876044666930176:12345-0@lo:5:osp-pre-1-1.0 00002000:00080000:1.0:1789136316.309589:0:24847:0:(ofd_dev.c:1654:ofd_create_hdl()) ofd_last_id() = 65 -> diff = 0 00000100:00100000:1.0:1789136316.309620:0:24847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7fa399680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:24081:x1876044666930176:12345-0@lo:5:osp-pre-1-1.0 Request processed in 58us (155us total) trans 0 rc 0/0 00000100:00100000:1.0:1789136316.309627:0:24847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00010000:00080000:1.0:1789136316.309665:0:24081:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90a7fa398b40 x1876044666930176/t0(0) o5->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1789136332 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789136316.309675:0:24081:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7fa398b40 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:24081:1876044666930176:0@lo:5:osp-pre-1-1.0 00000004:00080000:1.0:1789136316.309683:0:24081:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: Got last_id [0x2c0000400:0x41:0x0] from OST, last_created [0x2c0000400:0x41:0x0]last_used is [0x2c0000400:0x41:0x0] 00000100:00100000:1.0:1789136316.309708:0:24081:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7fa398b40 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:24081:1876044666930304:0@lo:5:osp-pre-1-1.0 00000100:00100000:1.0:1789136316.309730:0:24081:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789136316.309745:0:24081:0:(client.c:2715:ptlrpc_set_wait()) set ffff90a7c6319b40 going to sleep for 11 seconds 00000100:00100000:1.0:1789136316.309757:0:24846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666930304 00000100:00100000:1.0:1789136316.309761:0:24846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666930304 00000100:00100000:1.0:1789136316.309794:0:24846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1789136316.309800:0:24846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7fa39ad00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:24081:x1876044666930304:12345-0@lo:5:osp-pre-1-1.0 00002000:00080000:1.0:1789136316.309827:0:24846:0:(ofd_dev.c:1761:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000400 at 66 00000100:00080000:1.0:1789136316.313121:0:23328:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00002000:00010000:1.0:1789136316.324451:0:25418:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x41:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1789136316.324466:0:25418:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000075625b9/0x559c8745c6de484d lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136316.324485:0:25418:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x41:0x0].0x0 since=764s v=(0 0) 00010000:00010000:1.0:1789136316.324490:0:25418:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x41:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789136316.324497:0:25418:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000075625b9/0x559c8745c6de484d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136316.324515:0:25418:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000075625b9/0x559c8745c6de484d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136316.324526:0:25418:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000075625b9/0x559c8745c6de484d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136316.324542:0:25418:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000075625b9/0x559c8745c6de484d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136316.324568:0:25418:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789136316.327971:0:23320:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789136316.327986:0:23320:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000075625b9/0x559c8745c6de484d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136316.328000:0:23320:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a7c167ca00 already unused, calling callback (ffffffffc0dbf540) 00010000:00010000:0.0:1789136316.328005:0:23320:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000075625b9/0x559c8745c6de484d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136316.328017:0:23320:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000075625b9/0x559c8745c6de484d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136316.328043:0:23320:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000075625b9/0x559c8745c6de484d lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136316.328051:0:23320:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000075625b9/0x559c8745c6de484d lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136316.328072:0:23320:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789136316.328073:0:23320:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789136316.328075:0:23320:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:2.0:1789136316.330376:0:24069:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 1 committed 00002000:00010000:0.0:1789136316.336426:0:25418:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x40:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1789136316.336441:0:25418:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001fb160f8/0x559c8745c6de4854 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136316.336460:0:25418:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x40:0x0].0x0 since=764s v=(0 0) 00010000:00010000:0.0:1789136316.336465:0:25418:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x40:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789136316.336471:0:25418:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001fb160f8/0x559c8745c6de4854 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136316.336486:0:25418:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001fb160f8/0x559c8745c6de4854 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136316.336496:0:25418:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001fb160f8/0x559c8745c6de4854 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136316.336503:0:25418:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001fb160f8/0x559c8745c6de4854 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136316.336536:0:25418:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1789136316.337124:0:25418:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1789136316.337131:0:25418:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000457375d3/0x559c8745c6de485b lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136316.337141:0:25418:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3f:0x0].0x0 since=764s v=(0 0) 00010000:00010000:0.0:1789136316.337144:0:25418:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789136316.337148:0:25418:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000457375d3/0x559c8745c6de485b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136316.337172:0:25418:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000457375d3/0x559c8745c6de485b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136316.337181:0:25418:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000457375d3/0x559c8745c6de485b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136316.337189:0:25418:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000457375d3/0x559c8745c6de485b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136316.337206:0:25418:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:0.0:1789136316.337516:0:25418:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1789136316.337523:0:25418:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006f08e423/0x559c8745c6de4862 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136316.337533:0:25418:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3e:0x0].0x0 since=764s v=(0 0) 00010000:00010000:0.0:1789136316.337536:0:25418:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789136316.337540:0:25418:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006f08e423/0x559c8745c6de4862 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136316.337549:0:25418:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006f08e423/0x559c8745c6de4862 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136316.337557:0:25418:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006f08e423/0x559c8745c6de4862 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136316.337576:0:25418:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006f08e423/0x559c8745c6de4862 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136316.337585:0:25418:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00002000:00010000:0.0:1789136316.337838:0:25418:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1789136316.337844:0:25418:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ba12fccc/0x559c8745c6de4869 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136316.337872:0:25418:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3d:0x0].0x0 since=764s v=(0 0) 00010000:00010000:0.0:1789136316.337876:0:25418:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789136316.337880:0:25418:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ba12fccc/0x559c8745c6de4869 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136316.337890:0:25418:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ba12fccc/0x559c8745c6de4869 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136316.337898:0:25418:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ba12fccc/0x559c8745c6de4869 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136316.337905:0:25418:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ba12fccc/0x559c8745c6de4869 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136316.337913:0:25418:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00010000:00010000:1.0:1789136316.338520:0:23321:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:1.0:1789136316.338529:0:23321:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001fb160f8/0x559c8745c6de4854 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136316.338537:0:23321:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a7d1878600 already unused, calling callback (ffffffffc0dbf540) 00010000:00010000:1.0:1789136316.338541:0:23321:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001fb160f8/0x559c8745c6de4854 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136316.338550:0:23321:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001fb160f8/0x559c8745c6de4854 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136316.338568:0:23321:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001fb160f8/0x559c8745c6de4854 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136316.338575:0:23321:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001fb160f8/0x559c8745c6de4854 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136316.338595:0:23321:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1789136316.338598:0:23321:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000457375d3/0x559c8745c6de485b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136316.338617:0:23321:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a7d1879c00 already unused, calling callback (ffffffffc0dbf540) 00010000:00010000:1.0:1789136316.338620:0:23321:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000457375d3/0x559c8745c6de485b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136316.338629:0:23321:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000457375d3/0x559c8745c6de485b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136316.338639:0:23321:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000457375d3/0x559c8745c6de485b lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136316.338646:0:23321:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000457375d3/0x559c8745c6de485b lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136316.338658:0:23321:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1789136316.338661:0:23321:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006f08e423/0x559c8745c6de4862 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136316.338666:0:23321:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a7d1879a00 already unused, calling callback (ffffffffc0dbf540) 00010000:00010000:1.0:1789136316.338669:0:23321:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006f08e423/0x559c8745c6de4862 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136316.338675:0:23321:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006f08e423/0x559c8745c6de4862 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136316.338684:0:23321:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006f08e423/0x559c8745c6de4862 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136316.338697:0:23321:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006f08e423/0x559c8745c6de4862 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136316.338708:0:23321:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789136316.338711:0:23321:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ba12fccc/0x559c8745c6de4869 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136316.338716:0:23321:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a7d1878000 already unused, calling callback (ffffffffc0dbf540) 00010000:00010000:1.0:1789136316.338719:0:23321:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ba12fccc/0x559c8745c6de4869 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136316.338725:0:23321:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ba12fccc/0x559c8745c6de4869 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136316.338734:0:23321:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ba12fccc/0x559c8745c6de4869 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136316.338741:0:23321:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ba12fccc/0x559c8745c6de4869 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136316.338752:0:23321:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789136316.338754:0:23321:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789136316.338756:0:23321:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1789136316.338848:0:25418:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1789136316.338989:0:25418:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004e998057/0x559c8745c6de4870 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136316.339004:0:25418:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3c:0x0].0x0 since=764s v=(0 0) 00010000:00010000:1.0:1789136316.339917:0:23320:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789136316.339966:0:25418:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789136316.339977:0:25418:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004e998057/0x559c8745c6de4870 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136316.339990:0:25418:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004e998057/0x559c8745c6de4870 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136316.340000:0:25418:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004e998057/0x559c8745c6de4870 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136316.340063:0:25418:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004e998057/0x559c8745c6de4870 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136316.340247:0:25418:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1789136316.342528:0:25418:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1789136316.342539:0:25418:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000630d6314/0x559c8745c6de4877 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136316.342557:0:25418:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3b:0x0].0x0 since=764s v=(0 0) 00010000:00010000:0.0:1789136316.342562:0:25418:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789136316.342568:0:25418:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000630d6314/0x559c8745c6de4877 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136316.342581:0:25418:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000630d6314/0x559c8745c6de4877 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136316.342603:0:25418:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000630d6314/0x559c8745c6de4877 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136316.342611:0:25418:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000630d6314/0x559c8745c6de4877 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136316.347881:0:23321:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1789136316.347895:0:23321:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004e998057/0x559c8745c6de4870 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136316.347918:0:23321:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a7d1878800 already unused, calling callback (ffffffffc0dbf540) 00010000:00010000:1.0:1789136316.347923:0:23321:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004e998057/0x559c8745c6de4870 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136316.347944:0:23321:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004e998057/0x559c8745c6de4870 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136316.347966:0:23321:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004e998057/0x559c8745c6de4870 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136316.347973:0:23321:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004e998057/0x559c8745c6de4870 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136316.347997:0:23321:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789136316.348000:0:23321:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000630d6314/0x559c8745c6de4877 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136316.348006:0:23321:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a7d1879600 already unused, calling callback (ffffffffc0dbf540) 00010000:00010000:1.0:1789136316.348009:0:23321:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000630d6314/0x559c8745c6de4877 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136316.348016:0:23321:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000630d6314/0x559c8745c6de4877 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136316.348025:0:23321:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000630d6314/0x559c8745c6de4877 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136316.348037:0:23321:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789136316.348039:0:23321:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789136316.348041:0:23321:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789136316.349145:0:25418:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1789136316.349157:0:25418:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000630d6314/0x559c8745c6de4877 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789136316.349265:0:25663:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 12884901889 is committed 00000001:00100000:1.0:1789136316.349283:0:25663:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000001:00100000:1.0:1789136316.349287:0:25663:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00010000:00010000:2.0:1789136316.349403:0:23320:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1789136316.349705:0:25418:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1789136316.349712:0:25418:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000ae5a170/0x559c8745c6de487e lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136316.349725:0:25418:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3a:0x0].0x0 since=764s v=(0 0) 00010000:00010000:0.0:1789136316.349730:0:25418:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789136316.349736:0:25418:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000ae5a170/0x559c8745c6de487e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136316.349750:0:25418:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000ae5a170/0x559c8745c6de487e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136316.349759:0:25418:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000ae5a170/0x559c8745c6de487e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136316.349790:0:25418:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000ae5a170/0x559c8745c6de487e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136316.349813:0:25418:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1789136316.350103:0:25418:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x39:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1789136316.350110:0:25418:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c254fd19/0x559c8745c6de4885 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136316.350118:0:25418:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x39:0x0].0x0 since=764s v=(0 0) 00010000:00010000:0.0:1789136316.350121:0:25418:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x39:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789136316.350124:0:25418:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c254fd19/0x559c8745c6de4885 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136316.350133:0:25418:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c254fd19/0x559c8745c6de4885 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136316.350140:0:25418:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c254fd19/0x559c8745c6de4885 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136316.350147:0:25418:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c254fd19/0x559c8745c6de4885 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136316.350163:0:25418:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1789136316.350173:0:23320:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1789136316.350179:0:23320:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000ae5a170/0x559c8745c6de487e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136316.350194:0:23320:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a7d1878200 already unused, calling callback (ffffffffc0dbf540) 00010000:00010000:0.0:1789136316.350199:0:23320:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000ae5a170/0x559c8745c6de487e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136316.350207:0:23320:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000ae5a170/0x559c8745c6de487e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136316.350223:0:23320:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000ae5a170/0x559c8745c6de487e lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136316.350230:0:23320:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000ae5a170/0x559c8745c6de487e lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136316.350247:0:23320:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789136316.350251:0:23320:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c254fd19/0x559c8745c6de4885 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136316.350257:0:23320:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a6c3cafe00 already unused, calling callback (ffffffffc0dbf540) 00010000:00010000:0.0:1789136316.350260:0:23320:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c254fd19/0x559c8745c6de4885 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136316.350266:0:23320:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c254fd19/0x559c8745c6de4885 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136316.350275:0:23320:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c254fd19/0x559c8745c6de4885 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136316.350289:0:23320:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c254fd19/0x559c8745c6de4885 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136316.350301:0:23320:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789136316.350304:0:23320:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789136316.350306:0:23320:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789136316.350400:0:23321:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1789136316.350684:0:25418:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x38:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1789136316.350690:0:25418:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c8d9075d/0x559c8745c6de488c lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136316.350699:0:25418:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x38:0x0].0x0 since=764s v=(0 0) 00010000:00010000:0.0:1789136316.350703:0:25418:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x38:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789136316.350708:0:25418:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c8d9075d/0x559c8745c6de488c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136316.350718:0:25418:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c8d9075d/0x559c8745c6de488c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136316.350726:0:25418:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c8d9075d/0x559c8745c6de488c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136316.350732:0:25418:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c8d9075d/0x559c8745c6de488c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136316.350793:0:25418:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1789136316.351159:0:25418:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x37:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1789136316.351171:0:25418:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f1d20fab/0x559c8745c6de4893 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136316.351180:0:25418:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x37:0x0].0x0 since=764s v=(0 0) 00010000:00010000:0.0:1789136316.351183:0:25418:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x37:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789136316.351187:0:25418:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f1d20fab/0x559c8745c6de4893 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136316.351197:0:25418:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f1d20fab/0x559c8745c6de4893 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136316.351205:0:25418:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f1d20fab/0x559c8745c6de4893 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136316.351212:0:25418:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f1d20fab/0x559c8745c6de4893 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789136316.351649:0:24846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7fa39ad00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:24081:x1876044666930304:12345-0@lo:5:osp-pre-1-1.0 Request processed in 41517us (41586us total) trans 12884901889 rc 0/0 00000100:00100000:1.0:1789136316.351661:0:24846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1789136316.351724:0:24081:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 12884901889 gen 2 00000100:00100000:1.0:1789136316.351732:0:24081:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7fa398b40 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:24081:1876044666930304:0@lo:5:osp-pre-1-1.0 00000004:00080000:1.0:1789136316.352023:0:24081:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0001: current precreated pool: [0x2c0000400:0x41:0x0]-[0x2c0000400:0x61:0x0] 00000100:00100000:1.0:1789136316.352079:0:24081:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7fa398b40 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0000-lwp-MDT0001_UUID:24081:1876044666930432:0@lo:900:osp-pre-1-1.0 00000100:00100000:1.0:1789136316.352130:0:24081:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789136316.352160:0:24081:0:(client.c:2715:ptlrpc_set_wait()) set ffff90a7c6319b40 going to sleep for 11 seconds 00000100:00100000:1.0:1789136316.352185:0:23344:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666930432 00000100:00100000:1.0:1789136316.352191:0:23344:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666930432 00000100:00100000:1.0:1789136316.352229:0:23344:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1789136316.352237:0:23344:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7fa399a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:24081:x1876044666930432:12345-0@lo:900:osp-pre-1-1.0 00000100:00100000:1.0:1789136316.352283:0:23344:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7fa399a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:24081:x1876044666930432:12345-0@lo:900:osp-pre-1-1.0 Request processed in 47us (153us total) trans 0 rc 0/0 00000100:00100000:1.0:1789136316.352290:0:23344:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:1.0:1789136316.352428:0:24081:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90a7fa398b40 x1876044666930432/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1789136332 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789136316.352453:0:24081:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7fa398b40 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0000-lwp-MDT0001_UUID:24081:1876044666930432:0@lo:900:osp-pre-1-1.0 00010000:00010000:2.0:1789136316.354384:0:23320:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1789136316.354397:0:23320:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c8d9075d/0x559c8745c6de488c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136316.354423:0:23320:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a6c3caf600 already unused, calling callback (ffffffffc0dbf540) 00010000:00010000:2.0:1789136316.354429:0:23320:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c8d9075d/0x559c8745c6de488c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136316.354439:0:23320:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c8d9075d/0x559c8745c6de488c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136316.354465:0:23320:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c8d9075d/0x559c8745c6de488c lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136316.354473:0:23320:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c8d9075d/0x559c8745c6de488c lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136316.354540:0:23320:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789136316.354544:0:23320:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f1d20fab/0x559c8745c6de4893 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136316.354550:0:23320:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a6c3caf800 already unused, calling callback (ffffffffc0dbf540) 00010000:00010000:2.0:1789136316.354554:0:23320:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f1d20fab/0x559c8745c6de4893 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136316.354561:0:23320:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f1d20fab/0x559c8745c6de4893 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136316.354570:0:23320:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f1d20fab/0x559c8745c6de4893 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136316.354584:0:23320:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789136316.354586:0:23320:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789136316.354588:0:23320:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789136316.354709:0:25418:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1789136316.354716:0:25418:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f1d20fab/0x559c8745c6de4893 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789136316.355694:0:25418:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x36:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1789136316.355703:0:25418:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005f67a701/0x559c8745c6de489a lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136316.355717:0:25418:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x36:0x0].0x0 since=764s v=(0 0) 00010000:00010000:0.0:1789136316.355721:0:25418:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x36:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789136316.355735:0:25418:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005f67a701/0x559c8745c6de489a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136316.355748:0:25418:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005f67a701/0x559c8745c6de489a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136316.355757:0:25418:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005f67a701/0x559c8745c6de489a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136316.355763:0:25418:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005f67a701/0x559c8745c6de489a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136316.359001:0:23321:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789136316.359062:0:23321:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005f67a701/0x559c8745c6de489a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136316.359075:0:23321:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a6c3caea00 already unused, calling callback (ffffffffc0dbf540) 00010000:00010000:2.0:1789136316.359081:0:23321:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005f67a701/0x559c8745c6de489a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136316.359093:0:23321:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005f67a701/0x559c8745c6de489a lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136316.359116:0:23321:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005f67a701/0x559c8745c6de489a lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136316.359129:0:23321:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789136316.359131:0:23321:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789136316.359133:0:23321:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789136316.359272:0:25418:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1789136316.359280:0:25418:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005f67a701/0x559c8745c6de489a lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789136316.361718:0:25418:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x35:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1789136316.361729:0:25418:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000075625b9/0x559c8745c6de48a1 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136316.361746:0:25418:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x35:0x0].0x0 since=764s v=(0 0) 00010000:00010000:1.0:1789136316.361751:0:25418:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x35:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789136316.361758:0:25418:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000075625b9/0x559c8745c6de48a1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136316.361782:0:25418:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000075625b9/0x559c8745c6de48a1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136316.361793:0:25418:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000075625b9/0x559c8745c6de48a1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136316.361801:0:25418:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000075625b9/0x559c8745c6de48a1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136316.361873:0:23320:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789136316.361881:0:23320:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000075625b9/0x559c8745c6de48a1 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136316.361888:0:23320:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a7c167ca00 already unused, calling callback (ffffffffc0dbf540) 00010000:00010000:2.0:1789136316.361894:0:23320:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000075625b9/0x559c8745c6de48a1 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136316.361911:0:23320:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000075625b9/0x559c8745c6de48a1 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136316.361928:0:23320:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000075625b9/0x559c8745c6de48a1 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136316.361939:0:23320:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789136316.361940:0:23320:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789136316.361942:0:23320:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789136316.365161:0:25418:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1789136316.365176:0:25418:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000075625b9/0x559c8745c6de48a1 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789136316.367114:0:25418:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x34:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1789136316.367129:0:25418:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000173a0e3c/0x559c8745c6de48a8 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136316.367154:0:25418:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x34:0x0].0x0 since=764s v=(0 0) 00010000:00010000:1.0:1789136316.367159:0:25418:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x34:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789136316.367165:0:25418:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000173a0e3c/0x559c8745c6de48a8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136316.367179:0:25418:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000173a0e3c/0x559c8745c6de48a8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136316.367189:0:25418:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000173a0e3c/0x559c8745c6de48a8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136316.367197:0:25418:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000173a0e3c/0x559c8745c6de48a8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136316.367273:0:23321:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789136316.367281:0:23321:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000173a0e3c/0x559c8745c6de48a8 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136316.367288:0:23321:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a7c167c800 already unused, calling callback (ffffffffc0dbf540) 00010000:00010000:2.0:1789136316.367292:0:23321:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000173a0e3c/0x559c8745c6de48a8 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136316.367301:0:23321:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000173a0e3c/0x559c8745c6de48a8 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136316.367318:0:23321:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000173a0e3c/0x559c8745c6de48a8 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136316.367328:0:23321:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789136316.367329:0:23321:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789136316.367331:0:23321:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789136316.369103:0:25418:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1789136316.369119:0:25418:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000173a0e3c/0x559c8745c6de48a8 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789136316.369734:0:25418:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x33:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1789136316.369743:0:25418:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a81de015/0x559c8745c6de48af lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136316.369757:0:25418:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x33:0x0].0x0 since=764s v=(0 0) 00010000:00010000:1.0:1789136316.369762:0:25418:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x33:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789136316.369769:0:25418:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a81de015/0x559c8745c6de48af lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136316.369808:0:25418:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a81de015/0x559c8745c6de48af lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136316.369818:0:25418:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a81de015/0x559c8745c6de48af lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136316.369825:0:25418:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a81de015/0x559c8745c6de48af lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136316.372935:0:23320:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789136316.372952:0:23320:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a81de015/0x559c8745c6de48af lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136316.372966:0:23320:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a7c167d200 already unused, calling callback (ffffffffc0dbf540) 00010000:00010000:2.0:1789136316.372971:0:23320:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a81de015/0x559c8745c6de48af lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136316.372982:0:23320:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a81de015/0x559c8745c6de48af lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136316.373162:0:23320:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a81de015/0x559c8745c6de48af lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136316.373178:0:23320:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789136316.373179:0:23320:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789136316.373181:0:23320:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789136316.373298:0:25418:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1789136316.373306:0:25418:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a81de015/0x559c8745c6de48af lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789136316.373955:0:25418:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x32:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1789136316.373962:0:25418:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fcf06349/0x559c8745c6de48b6 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136316.373974:0:25418:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x32:0x0].0x0 since=764s v=(0 0) 00010000:00010000:1.0:1789136316.373978:0:25418:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x32:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789136316.373985:0:25418:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fcf06349/0x559c8745c6de48b6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136316.373997:0:25418:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fcf06349/0x559c8745c6de48b6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136316.374113:0:25418:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fcf06349/0x559c8745c6de48b6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136316.374121:0:25418:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000fcf06349/0x559c8745c6de48b6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136316.375953:0:23321:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789136316.375966:0:23321:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000fcf06349/0x559c8745c6de48b6 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136316.375977:0:23321:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a8021dda00 already unused, calling callback (ffffffffc0dbf540) 00010000:00010000:2.0:1789136316.375981:0:23321:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000fcf06349/0x559c8745c6de48b6 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136316.375992:0:23321:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000fcf06349/0x559c8745c6de48b6 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136316.377000:0:23321:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000fcf06349/0x559c8745c6de48b6 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136316.377092:0:23321:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789136316.377094:0:23321:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789136316.377096:0:23321:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789136316.377830:0:25418:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1789136316.377837:0:25418:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fcf06349/0x559c8745c6de48b6 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136316.377917:0:23320:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789136316.378459:0:25418:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x31:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1789136316.378466:0:25418:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005684428e/0x559c8745c6de48bd lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136316.378480:0:25418:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x31:0x0].0x0 since=764s v=(0 0) 00010000:00010000:1.0:1789136316.378485:0:25418:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x31:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789136316.378493:0:25418:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005684428e/0x559c8745c6de48bd lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136316.378506:0:25418:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005684428e/0x559c8745c6de48bd lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136316.378515:0:25418:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005684428e/0x559c8745c6de48bd lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136316.378534:0:25418:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005684428e/0x559c8745c6de48bd lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136316.378603:0:25418:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1789136316.378898:0:25418:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x30:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1789136316.378906:0:25418:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000047718f6e/0x559c8745c6de48c4 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136316.378913:0:25418:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x30:0x0].0x0 since=764s v=(0 0) 00010000:00010000:1.0:1789136316.378917:0:25418:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x30:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789136316.378920:0:25418:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000047718f6e/0x559c8745c6de48c4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136316.378929:0:25418:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000047718f6e/0x559c8745c6de48c4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136316.378937:0:25418:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000047718f6e/0x559c8745c6de48c4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136316.378944:0:25418:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000047718f6e/0x559c8745c6de48c4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136316.383104:0:23321:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1789136316.383121:0:23321:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005684428e/0x559c8745c6de48bd lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136316.383134:0:23321:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a8021dd800 already unused, calling callback (ffffffffc0dbf540) 00010000:00010000:2.0:1789136316.383139:0:23321:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005684428e/0x559c8745c6de48bd lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136316.383149:0:23321:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005684428e/0x559c8745c6de48bd lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136316.383171:0:23321:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005684428e/0x559c8745c6de48bd lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136316.383179:0:23321:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005684428e/0x559c8745c6de48bd lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136316.383327:0:25418:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1789136316.383847:0:25418:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1789136316.383877:0:25418:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b5d3c6e7/0x559c8745c6de48cb lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136316.383897:0:25418:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2f:0x0].0x0 since=764s v=(0 0) 00010000:00010000:1.0:1789136316.383902:0:25418:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789136316.383909:0:25418:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b5d3c6e7/0x559c8745c6de48cb lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136316.383923:0:25418:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b5d3c6e7/0x559c8745c6de48cb lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136316.383932:0:25418:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b5d3c6e7/0x559c8745c6de48cb lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136316.383940:0:25418:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b5d3c6e7/0x559c8745c6de48cb lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136316.383950:0:25418:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:1.0:1789136316.384273:0:25418:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1789136316.384279:0:25418:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ee1da7f4/0x559c8745c6de48d2 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136316.384288:0:25418:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2e:0x0].0x0 since=764s v=(0 0) 00010000:00010000:1.0:1789136316.384291:0:25418:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789136316.384295:0:25418:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ee1da7f4/0x559c8745c6de48d2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136316.384304:0:25418:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ee1da7f4/0x559c8745c6de48d2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136316.384322:0:25418:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ee1da7f4/0x559c8745c6de48d2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136316.384329:0:25418:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ee1da7f4/0x559c8745c6de48d2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136316.384336:0:25418:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:0.0:1789136316.384567:0:23321:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1789136316.384574:0:23321:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000047718f6e/0x559c8745c6de48c4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136316.384582:0:23321:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a8021dde00 already unused, calling callback (ffffffffc0dbf540) 00010000:00010000:0.0:1789136316.384585:0:23321:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000047718f6e/0x559c8745c6de48c4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136316.384594:0:23321:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000047718f6e/0x559c8745c6de48c4 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136316.384622:0:23321:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000047718f6e/0x559c8745c6de48c4 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136316.384629:0:23321:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000047718f6e/0x559c8745c6de48c4 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136316.384649:0:23321:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1789136316.384652:0:23321:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b5d3c6e7/0x559c8745c6de48cb lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136316.384658:0:23321:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a8021dcc00 already unused, calling callback (ffffffffc0dbf540) 00010000:00010000:0.0:1789136316.384661:0:23321:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b5d3c6e7/0x559c8745c6de48cb lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136316.384668:0:23321:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b5d3c6e7/0x559c8745c6de48cb lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136316.384678:0:23321:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b5d3c6e7/0x559c8745c6de48cb lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136316.384685:0:23321:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b5d3c6e7/0x559c8745c6de48cb lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136316.384697:0:23321:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789136316.384700:0:23321:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ee1da7f4/0x559c8745c6de48d2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136316.384719:0:23321:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a8021dc600 already unused, calling callback (ffffffffc0dbf540) 00010000:00010000:0.0:1789136316.384721:0:23321:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ee1da7f4/0x559c8745c6de48d2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136316.384728:0:23321:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ee1da7f4/0x559c8745c6de48d2 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136316.384738:0:23321:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ee1da7f4/0x559c8745c6de48d2 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136316.384745:0:23321:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ee1da7f4/0x559c8745c6de48d2 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136316.384756:0:23321:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789136316.384757:0:23321:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789136316.384759:0:23321:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789136316.384913:0:25418:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1789136316.384920:0:25418:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000903077df/0x559c8745c6de48d9 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136316.384928:0:25418:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2d:0x0].0x0 since=764s v=(0 0) 00010000:00010000:1.0:1789136316.384931:0:25418:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789136316.384935:0:25418:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000903077df/0x559c8745c6de48d9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136316.384945:0:25418:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000903077df/0x559c8745c6de48d9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136316.384953:0:25418:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000903077df/0x559c8745c6de48d9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136316.384960:0:25418:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000903077df/0x559c8745c6de48d9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136316.384992:0:25418:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789136316.385119:0:23320:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789136316.385126:0:23320:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000903077df/0x559c8745c6de48d9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136316.385138:0:23320:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a8021dc200 already unused, calling callback (ffffffffc0dbf540) 00010000:00010000:2.0:1789136316.385141:0:23320:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000903077df/0x559c8745c6de48d9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136316.385149:0:23320:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000903077df/0x559c8745c6de48d9 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136316.385160:0:23320:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000903077df/0x559c8745c6de48d9 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136316.385167:0:23320:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000903077df/0x559c8745c6de48d9 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136316.385179:0:23320:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789136316.385181:0:23320:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789136316.385182:0:23320:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789136316.385217:0:23321:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789136316.385511:0:25418:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1789136316.385517:0:25418:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d30ef084/0x559c8745c6de48e0 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136316.385526:0:25418:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2c:0x0].0x0 since=764s v=(0 0) 00010000:00010000:1.0:1789136316.385529:0:25418:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789136316.385533:0:25418:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d30ef084/0x559c8745c6de48e0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136316.385542:0:25418:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d30ef084/0x559c8745c6de48e0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136316.385550:0:25418:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d30ef084/0x559c8745c6de48e0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136316.385556:0:25418:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d30ef084/0x559c8745c6de48e0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136316.385608:0:25418:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1789136316.385902:0:25418:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1789136316.385907:0:25418:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000335b8403/0x559c8745c6de48e7 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136316.385915:0:25418:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2b:0x0].0x0 since=764s v=(0 0) 00010000:00010000:1.0:1789136316.385924:0:25418:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789136316.385928:0:25418:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000335b8403/0x559c8745c6de48e7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136316.385938:0:25418:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000335b8403/0x559c8745c6de48e7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136316.385947:0:25418:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000335b8403/0x559c8745c6de48e7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136316.385954:0:25418:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000335b8403/0x559c8745c6de48e7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136316.390135:0:23320:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1789136316.390150:0:23320:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d30ef084/0x559c8745c6de48e0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136316.390163:0:23320:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a8021ddc00 already unused, calling callback (ffffffffc0dbf540) 00010000:00010000:2.0:1789136316.390168:0:23320:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d30ef084/0x559c8745c6de48e0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136316.390180:0:23320:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d30ef084/0x559c8745c6de48e0 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136316.390212:0:23320:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d30ef084/0x559c8745c6de48e0 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136316.390219:0:23320:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d30ef084/0x559c8745c6de48e0 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136316.390301:0:23320:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789136316.390308:0:23320:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000335b8403/0x559c8745c6de48e7 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136316.390314:0:23320:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a8021dce00 already unused, calling callback (ffffffffc0dbf540) 00010000:00010000:0.0:1789136316.390317:0:23320:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000335b8403/0x559c8745c6de48e7 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136316.390334:0:23320:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000335b8403/0x559c8745c6de48e7 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136316.390344:0:23320:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000335b8403/0x559c8745c6de48e7 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136316.390352:0:23320:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789136316.390354:0:23320:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789136316.390356:0:23320:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789136316.396128:0:25418:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1789136316.396144:0:25418:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000335b8403/0x559c8745c6de48e7 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789136316.396661:0:25418:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1789136316.396670:0:25418:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000a9bf77e/0x559c8745c6de48ee lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136316.396684:0:25418:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2a:0x0].0x0 since=764s v=(0 0) 00010000:00010000:1.0:1789136316.396689:0:25418:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789136316.396695:0:25418:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000a9bf77e/0x559c8745c6de48ee lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136316.396708:0:25418:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000a9bf77e/0x559c8745c6de48ee lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136316.396724:0:25418:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000a9bf77e/0x559c8745c6de48ee lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136316.396730:0:25418:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000a9bf77e/0x559c8745c6de48ee lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136316.398143:0:23321:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789136316.398154:0:23321:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000a9bf77e/0x559c8745c6de48ee lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136316.398166:0:23321:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a8021dc400 already unused, calling callback (ffffffffc0dbf540) 00010000:00010000:0.0:1789136316.398172:0:23321:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000a9bf77e/0x559c8745c6de48ee lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136316.398182:0:23321:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000a9bf77e/0x559c8745c6de48ee lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136316.398201:0:23321:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000a9bf77e/0x559c8745c6de48ee lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136316.398963:0:23321:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789136316.398967:0:23321:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789136316.398970:0:23321:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789136316.402142:0:25418:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1789136316.402156:0:25418:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000a9bf77e/0x559c8745c6de48ee lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789136316.402745:0:25418:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x29:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1789136316.402753:0:25418:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000063a1fe34/0x559c8745c6de48f5 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136316.402767:0:25418:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x29:0x0].0x0 since=764s v=(0 0) 00010000:00010000:1.0:1789136316.402781:0:25418:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x29:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789136316.402788:0:25418:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000063a1fe34/0x559c8745c6de48f5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136316.402802:0:25418:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000063a1fe34/0x559c8745c6de48f5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136316.402813:0:25418:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000063a1fe34/0x559c8745c6de48f5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136316.402832:0:25418:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000063a1fe34/0x559c8745c6de48f5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136316.402878:0:25418:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789136316.403184:0:23320:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789136316.403193:0:23320:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000063a1fe34/0x559c8745c6de48f5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136316.403202:0:23320:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a8021dd400 already unused, calling callback (ffffffffc0dbf540) 00010000:00010000:0.0:1789136316.403206:0:23320:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000063a1fe34/0x559c8745c6de48f5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136316.403216:0:23320:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000063a1fe34/0x559c8745c6de48f5 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136316.403233:0:23320:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000063a1fe34/0x559c8745c6de48f5 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136316.403239:0:23320:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000063a1fe34/0x559c8745c6de48f5 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136316.403257:0:23320:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789136316.403258:0:23320:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789136316.403260:0:23320:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789136316.403307:0:23321:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789136316.404193:0:25418:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x28:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1789136316.404201:0:25418:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c6fa6073/0x559c8745c6de48fc lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136316.404214:0:25418:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x28:0x0].0x0 since=764s v=(0 0) 00010000:00010000:1.0:1789136316.404218:0:25418:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x28:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789136316.404224:0:25418:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c6fa6073/0x559c8745c6de48fc lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136316.404235:0:25418:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c6fa6073/0x559c8745c6de48fc lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136316.404243:0:25418:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c6fa6073/0x559c8745c6de48fc lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136316.404250:0:25418:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c6fa6073/0x559c8745c6de48fc lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136316.404268:0:25418:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789136316.404637:0:23320:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789136316.404644:0:23320:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c6fa6073/0x559c8745c6de48fc lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136316.404652:0:23320:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a6c3b4c200 already unused, calling callback (ffffffffc0dbf540) 00010000:00010000:0.0:1789136316.404655:0:23320:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c6fa6073/0x559c8745c6de48fc lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136316.404675:0:23320:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c6fa6073/0x559c8745c6de48fc lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136316.404689:0:23320:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c6fa6073/0x559c8745c6de48fc lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136316.404697:0:23320:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c6fa6073/0x559c8745c6de48fc lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136316.404714:0:23320:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789136316.404715:0:23320:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789136316.404717:0:23320:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789136316.404801:0:25418:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x27:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1789136316.404808:0:25418:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000032f8996/0x559c8745c6de4903 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136316.404822:0:25418:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x27:0x0].0x0 since=764s v=(0 0) 00010000:00010000:1.0:1789136316.404825:0:25418:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x27:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789136316.404830:0:25418:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000032f8996/0x559c8745c6de4903 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136316.404839:0:25418:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000032f8996/0x559c8745c6de4903 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136316.404846:0:25418:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000032f8996/0x559c8745c6de4903 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136316.404955:0:25418:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000032f8996/0x559c8745c6de4903 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136316.409115:0:25418:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1789136316.410082:0:25418:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x26:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1789136316.410093:0:25418:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005f67a701/0x559c8745c6de490a lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136316.410110:0:25418:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x26:0x0].0x0 since=764s v=(0 0) 00010000:00010000:0.0:1789136316.410115:0:25418:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x26:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789136316.410121:0:25418:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005f67a701/0x559c8745c6de490a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136316.410134:0:25418:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005f67a701/0x559c8745c6de490a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136316.410143:0:25418:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005f67a701/0x559c8745c6de490a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136316.410156:0:25418:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005f67a701/0x559c8745c6de490a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136316.411850:0:23321:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1789136316.411885:0:23321:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000032f8996/0x559c8745c6de4903 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136316.411897:0:23321:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a6c3b4d200 already unused, calling callback (ffffffffc0dbf540) 00010000:00010000:2.0:1789136316.411902:0:23321:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000032f8996/0x559c8745c6de4903 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136316.411911:0:23321:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000032f8996/0x559c8745c6de4903 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136316.411931:0:23321:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000032f8996/0x559c8745c6de4903 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136316.411939:0:23321:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000032f8996/0x559c8745c6de4903 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136316.411990:0:23321:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789136316.412004:0:23321:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005f67a701/0x559c8745c6de490a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136316.412122:0:23321:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a6c3caea00 already unused, calling callback (ffffffffc0dbf540) 00010000:00010000:2.0:1789136316.412126:0:23321:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005f67a701/0x559c8745c6de490a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136316.412134:0:23321:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005f67a701/0x559c8745c6de490a lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136316.412146:0:23321:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005f67a701/0x559c8745c6de490a lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136316.412154:0:23321:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789136316.412156:0:23321:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789136316.412158:0:23321:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789136316.414108:0:25418:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1789136316.414122:0:25418:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005f67a701/0x559c8745c6de490a lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789136316.414655:0:25418:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x25:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1789136316.414663:0:25418:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f1d20fab/0x559c8745c6de4911 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136316.414676:0:25418:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x25:0x0].0x0 since=764s v=(0 0) 00010000:00010000:0.0:1789136316.414681:0:25418:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x25:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789136316.414688:0:25418:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f1d20fab/0x559c8745c6de4911 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136316.414701:0:25418:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f1d20fab/0x559c8745c6de4911 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136316.414710:0:25418:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f1d20fab/0x559c8745c6de4911 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136316.414717:0:25418:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f1d20fab/0x559c8745c6de4911 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136316.416232:0:23320:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789136316.416246:0:23320:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f1d20fab/0x559c8745c6de4911 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136316.416258:0:23320:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a6c3caf800 already unused, calling callback (ffffffffc0dbf540) 00010000:00010000:1.0:1789136316.416263:0:23320:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f1d20fab/0x559c8745c6de4911 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136316.416273:0:23320:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f1d20fab/0x559c8745c6de4911 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136316.416309:0:23320:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f1d20fab/0x559c8745c6de4911 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136316.416950:0:25418:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1789136316.416958:0:25418:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f1d20fab/0x559c8745c6de4911 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136316.417089:0:23321:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1789136316.418068:0:25418:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x24:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1789136316.418078:0:25418:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c254fd19/0x559c8745c6de4918 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136316.418092:0:25418:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x24:0x0].0x0 since=764s v=(0 0) 00010000:00010000:0.0:1789136316.418097:0:25418:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x24:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789136316.418103:0:25418:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c254fd19/0x559c8745c6de4918 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136316.418116:0:25418:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c254fd19/0x559c8745c6de4918 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136316.418125:0:25418:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c254fd19/0x559c8745c6de4918 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136316.418132:0:25418:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c254fd19/0x559c8745c6de4918 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136316.418189:0:25418:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1789136316.419171:0:25418:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x23:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1789136316.419180:0:25418:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000167cce62/0x559c8745c6de491f lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136316.419199:0:25418:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x23:0x0].0x0 since=764s v=(0 0) 00010000:00010000:0.0:1789136316.419203:0:25418:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x23:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789136316.419208:0:25418:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000167cce62/0x559c8745c6de491f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136316.419219:0:25418:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000167cce62/0x559c8745c6de491f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136316.419228:0:25418:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000167cce62/0x559c8745c6de491f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136316.419235:0:25418:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000167cce62/0x559c8745c6de491f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136316.419302:0:23320:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1789136316.419308:0:23320:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c254fd19/0x559c8745c6de4918 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136316.419315:0:23320:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a6c3cafe00 already unused, calling callback (ffffffffc0dbf540) 00010000:00010000:2.0:1789136316.419318:0:23320:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c254fd19/0x559c8745c6de4918 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136316.419327:0:23320:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c254fd19/0x559c8745c6de4918 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136316.419343:0:23320:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c254fd19/0x559c8745c6de4918 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136316.419358:0:23320:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c254fd19/0x559c8745c6de4918 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136316.419377:0:23320:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789136316.419380:0:23320:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000167cce62/0x559c8745c6de491f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136316.419387:0:23320:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a6c3cae400 already unused, calling callback (ffffffffc0dbf540) 00010000:00010000:2.0:1789136316.419389:0:23320:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000167cce62/0x559c8745c6de491f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136316.419398:0:23320:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000167cce62/0x559c8745c6de491f lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136316.419408:0:23320:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000167cce62/0x559c8745c6de491f lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136316.419415:0:23320:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789136316.419417:0:23320:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789136316.421941:0:23321:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789136316.422098:0:25418:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1789136316.422109:0:25418:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000167cce62/0x559c8745c6de491f lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789136316.422648:0:25418:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x22:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1789136316.422656:0:25418:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c8d9075d/0x559c8745c6de4926 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136316.422669:0:25418:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=764s v=(0 0) 00010000:00010000:0.0:1789136316.422674:0:25418:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789136316.422680:0:25418:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c8d9075d/0x559c8745c6de4926 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136316.422706:0:25418:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c8d9075d/0x559c8745c6de4926 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136316.422717:0:25418:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c8d9075d/0x559c8745c6de4926 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136316.422723:0:25418:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c8d9075d/0x559c8745c6de4926 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136316.422733:0:25418:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00080000:0.0:1789136316.422965:0:25418:0:(ofd_dev.c:1532:ofd_orphans_destroy()) lustre-OST0001: after destroy: set last_id to 0x2c0000401:6 00010000:00010000:1.0:1789136316.423110:0:23321:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789136316.423117:0:23321:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c8d9075d/0x559c8745c6de4926 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136316.423126:0:23321:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a6c3caf600 already unused, calling callback (ffffffffc0dbf540) 00010000:00010000:1.0:1789136316.423131:0:23321:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c8d9075d/0x559c8745c6de4926 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136316.423140:0:23321:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c8d9075d/0x559c8745c6de4926 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136316.423157:0:23321:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c8d9075d/0x559c8745c6de4926 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136316.423164:0:23321:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c8d9075d/0x559c8745c6de4926 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136316.423182:0:23321:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789136316.423184:0:23321:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789136316.423186:0:23321:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789136316.423254:0:23320:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789136316.423390:0:25418:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7d55ade00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:23360:x1876044666929792:12345-0@lo:5:osp-pre-1-0.0 Request processed in 136248us (136681us total) trans 0 rc 0/0 00000100:00100000:0.0:1789136316.423400:0:25418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1789136316.427103:0:23360:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7d55ac000 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:23360:1876044666929792:0@lo:5:osp-pre-1-0.0 00000004:00080000:1.0:1789136316.427137:0:23360:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x2c0000401:0x41:0x0] from OST, last_created [0x2c0000401:0x41:0x0]last_used is [0x2c0000401:0x6:0x0] 00000100:00100000:1.0:1789136316.427190:0:23360:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7fa398b40 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:23360:1876044666930560:0@lo:5:osp-pre-1-0.0 00000100:00100000:1.0:1789136316.427251:0:23360:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789136316.427330:0:23360:0:(client.c:2715:ptlrpc_set_wait()) set ffff90a6c2d230c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789136316.429347:0:24845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666930560 00000100:00100000:2.0:1789136316.429360:0:24845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666930560 00000100:00100000:2.0:1789136316.433127:0:24847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1789136316.433145:0:24847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7fa39b840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:23360:x1876044666930560:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:2.0:1789136316.433211:0:24847:0:(ofd_dev.c:1761:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000401 at 66 00000100:00100000:2.0:1789136316.436313:0:24847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7fa39b840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:23360:x1876044666930560:12345-0@lo:5:osp-pre-1-0.0 Request processed in 3165us (9052us total) trans 12884901890 rc 0/0 00000100:00100000:2.0:1789136316.436325:0:24847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1789136316.438161:0:23360:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7fa398b40 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:23360:1876044666930560:0@lo:5:osp-pre-1-0.0 00000004:00080000:0.0:1789136316.438183:0:23360:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x2c0000401:0x41:0x0]-[0x2c0000401:0x61:0x0] 00010000:00010000:1.0:1789136317.161085:0:23321:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1789136317.423402:0:24094:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1789136318.184334:0:23320:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1789136318.784804:0:26020:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg131-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:1.0:1789136319.209132:0:23321:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:0.0:1789136319.984841:0:26072:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1789136319.985242:0:26072:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1789136320.232077:0:23320:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789136320.875416:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7fa39bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1876044666930688:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1789136320.875565:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789136320.875688:0:24849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666930688 00000100:00100000:1.0:1789136320.875707:0:24849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666930688 00000100:00100000:1.0:1789136320.875783:0:24849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1789136320.875795:0:24849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7fa39a580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1876044666930688:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1789136320.875836:0:24849:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3915853824 avail 3684331520 00000100:00100000:1.0:1789136320.875921:0:24849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7fa39a580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1876044666930688:12345-0@lo:13:osp-pre-0-1.0 Request processed in 129us (357us total) trans 0 rc 0/0 00000100:00100000:1.0:1789136320.875941:0:24849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00080000:1.0:1789136320.875977:0:23328:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789136320.876029:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7fa39bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1876044666930688:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1789136320.876463:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7fa39bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1876044666930816:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789136320.876509:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789136320.876568:0:24849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666930816 00000100:00100000:1.0:1789136320.876572:0:24849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666930816 00000100:00100000:1.0:1789136320.876627:0:24849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1789136320.876635:0:24849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c4762940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1876044666930816:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789136320.876648:0:24849:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3915853824 avail 3684331520 00000100:00080000:2.0:1789136320.876669:0:23328:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789136320.876710:0:24849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c4762940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1876044666930816:12345-0@lo:13:osp-pre-0-0.0 Request processed in 75us (199us total) trans 0 rc 0/0 00000100:00100000:1.0:1789136320.876731:0:24849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1789136320.876737:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7fa39bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1876044666930816:0@lo:13:osp-pre-0-0.0 00000020:00000004:3.0:1789136321.254220:0:26122:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1789136321.254554:0:26122:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1789136321.259643:0:23321:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789136321.388811:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c4762580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1876044666930944:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1789136321.388909:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789136321.388992:0:24849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666930944 00000100:00100000:2.0:1789136321.388999:0:24849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666930944 00000100:00100000:2.0:1789136321.389052:0:24849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1789136321.389062:0:24849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c3ce8b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1876044666930944:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1789136321.389090:0:24849:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923501056 avail 3691978752 00000100:00100000:2.0:1789136321.389131:0:24849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c3ce8b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1876044666930944:12345-0@lo:13:osp-pre-1-1.0 Request processed in 71us (222us total) trans 0 rc 0/0 00000100:00100000:2.0:1789136321.389138:0:24849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00080000:2.0:1789136321.389157:0:23328:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789136321.389188:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c4762580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1876044666930944:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1789136321.389551:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7d55ac3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b11da215-324d-4c8d-90a5-0b7f26186c4c:3638:1876044666931072:0@lo:400:kworker.0 00000100:00100000:0.0:1789136321.389588:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789136321.389612:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c3d91e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3638:1876044666931584:0@lo:400:kworker.0 00000100:00100000:0.0:1789136321.389636:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789136321.389653:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c3d930c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3638:1876044666932096:0@lo:400:kworker.0 00000100:00100000:0.0:1789136321.389697:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789136321.389715:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:0.0:1789136321.389720:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7d55ac000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1876044666931200:0@lo:400:kworker.0 00000100:00100000:0.0:1789136321.389742:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789136321.389759:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c3d93480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1876044666931712:0@lo:400:kworker.0 00000100:00100000:0.0:1789136321.389779:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789136321.389795:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c3d91680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3638:1876044666932224:0@lo:400:kworker.0 00000100:00100000:0.0:1789136321.389815:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789136321.389845:0:23327:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666931072 00000100:00100000:0.0:1789136321.389849:0:23327:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666931072 00000100:00100000:0.0:1789136321.389945:0:23327:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:0.0:1789136321.389953:0:23327:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7dd561450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b11da215-324d-4c8d-90a5-0b7f26186c4c+24:3638:x1876044666931072:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789136321.389991:0:23327:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7dd561450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b11da215-324d-4c8d-90a5-0b7f26186c4c+24:3638:x1876044666931072:12345-0@lo:400:kworker.0 Request processed in 38us (402us total) trans 0 rc 0/0 00000100:00100000:0.0:1789136321.389998:0:23327:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:0.0:1789136321.390026:0:23334:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666931584 00000100:00100000:0.0:1789136321.390030:0:23334:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666931584 00000100:00100000:0.0:1789136321.390048:0:23334:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666932096 00000100:00100000:0.0:1789136321.390051:0:23334:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666932096 00000100:00100000:0.0:1789136321.390068:0:23334:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666932224 00000100:00100000:0.0:1789136321.390071:0:23334:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666932224 00000100:00100000:0.0:1789136321.390083:0:23334:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1789136321.390088:0:23334:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c3d921c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1876044666931584:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789136321.390119:0:23334:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c3d921c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1876044666931584:12345-0@lo:400:kworker.0 Request processed in 31us (482us total) trans 0 rc 0/0 00000100:00100000:0.0:1789136321.390125:0:23334:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1789136321.390137:0:23334:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1789136321.390150:0:23334:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c3d92580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3638:x1876044666932096:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789136321.390178:0:23334:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c3d92580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3638:x1876044666932096:12345-0@lo:400:kworker.0 Request processed in 29us (480us total) trans 0 rc 0/0 00000100:00100000:0.0:1789136321.390184:0:23334:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1789136321.390196:0:23334:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1789136321.390202:0:23334:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c3d90000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3638:x1876044666932224:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789136321.390227:0:23334:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c3d90000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3638:x1876044666932224:12345-0@lo:400:kworker.0 Request processed in 25us (410us total) trans 0 rc 0/0 00000100:00100000:0.0:1789136321.390232:0:23334:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1789136321.390251:0:24077:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666931200 00000100:00100000:0.0:1789136321.390254:0:24077:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666931200 00000100:00100000:0.0:1789136321.390275:0:24077:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666931712 00000100:00100000:0.0:1789136321.390278:0:24077:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666931712 00000100:00100000:0.0:1789136321.390291:0:24077:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1789136321.390296:0:24077:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c3d93840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3638:x1876044666931200:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789136321.390326:0:24077:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c3d93840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3638:x1876044666931200:12345-0@lo:400:kworker.0 Request processed in 29us (583us total) trans 0 rc 0/0 00000100:00100000:0.0:1789136321.390332:0:24077:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1789136321.390343:0:24077:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1789136321.390349:0:24077:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c3d91a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3638:x1876044666931712:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789136321.390375:0:24077:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c3d91a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3638:x1876044666931712:12345-0@lo:400:kworker.0 Request processed in 26us (595us total) trans 0 rc 0/0 00000100:00100000:0.0:1789136321.390380:0:24077:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1789136321.390441:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7d55aed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1876044666931456:0@lo:400:kworker.0 00000100:00100000:0.0:1789136321.390470:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789136321.390490:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c3d93c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3641:1876044666931968:0@lo:400:kworker.0 00000100:00100000:0.0:1789136321.390519:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789136321.390534:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c3d90f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3641:1876044666932480:0@lo:400:kworker.0 00000100:00100000:0.0:1789136321.390554:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789136321.390569:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:0.0:1789136321.390575:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7d55af480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1876044666931328:0@lo:400:kworker.0 00000100:00100000:0.0:1789136321.390596:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789136321.390613:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c3d903c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1876044666931840:0@lo:400:kworker.0 00000100:00100000:0.0:1789136321.390635:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789136321.390651:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c3d912c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3641:1876044666932352:0@lo:400:kworker.0 00000100:00100000:0.0:1789136321.390672:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789136321.390710:0:24846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666931456 00000100:00100000:0.0:1789136321.390714:0:24846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666931456 00000100:00100000:0.0:1789136321.390741:0:24846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666931328 00000100:00100000:0.0:1789136321.390743:0:24846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666931328 00000100:00100000:0.0:1789136321.390755:0:24846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666931840 00000100:00100000:0.0:1789136321.390757:0:24846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666931840 00000100:00100000:0.0:1789136321.390768:0:24846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1789136321.390774:0:24846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c3d92940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3641:x1876044666931456:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789136321.390807:0:24846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c3d92940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3641:x1876044666931456:12345-0@lo:400:kworker.0 Request processed in 33us (335us total) trans 0 rc 0/0 00000100:00100000:0.0:1789136321.390813:0:24846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1789136321.390824:0:24846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1789136321.390830:0:24846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c3d92d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3641:x1876044666931328:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789136321.390880:0:24846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c3d92d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3641:x1876044666931328:12345-0@lo:400:kworker.0 Request processed in 50us (282us total) trans 0 rc 0/0 00000100:00100000:0.0:1789136321.390886:0:24846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1789136321.390918:0:24846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1789136321.390924:0:24846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c3ff7c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3641:x1876044666931840:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789136321.390953:0:24846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c3ff7c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3641:x1876044666931840:12345-0@lo:400:kworker.0 Request processed in 29us (317us total) trans 0 rc 0/0 00000100:00100000:0.0:1789136321.390960:0:24846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1789136321.390982:0:23332:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666931968 00000100:00100000:0.0:1789136321.390986:0:23332:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666931968 00000100:00100000:0.0:1789136321.391000:0:23332:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666932480 00000100:00100000:0.0:1789136321.391003:0:23332:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666932480 00000100:00100000:0.0:1789136321.391014:0:23332:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666932352 00000100:00100000:0.0:1789136321.391016:0:23332:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666932352 00000100:00100000:0.0:1789136321.391029:0:23332:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1789136321.391034:0:23332:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c3d90780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1876044666931968:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789136321.391065:0:23332:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c3d90780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1876044666931968:12345-0@lo:400:kworker.0 Request processed in 31us (546us total) trans 0 rc 0/0 00000100:00100000:0.0:1789136321.391071:0:23332:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1789136321.391083:0:23332:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1789136321.391089:0:23332:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c3d90b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3641:x1876044666932480:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789136321.391116:0:23332:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c3d90b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3641:x1876044666932480:12345-0@lo:400:kworker.0 Request processed in 28us (560us total) trans 0 rc 0/0 00000100:00100000:0.0:1789136321.391123:0:23332:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1789136321.391132:0:23332:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1789136321.391138:0:23332:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c3ff6580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3641:x1876044666932352:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789136321.391159:0:23332:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c3ff6580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3641:x1876044666932352:12345-0@lo:400:kworker.0 Request processed in 22us (487us total) trans 0 rc 0/0 00000100:00100000:0.0:1789136321.391164:0:23332:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1789136321.391194:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7d55ac000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1876044666931200:0@lo:400:kworker.0 00000100:00100000:0.0:1789136321.391213:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c3d93480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1876044666931712:0@lo:400:kworker.0 00010000:00080000:0.0:1789136321.391224:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90a6c3d91680 x1876044666932224/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789136337 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789136321.391233:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c3d91680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3638:1876044666932224:0@lo:400:kworker.0 00000100:00100000:0.0:1789136321.391241:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7d55ac3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b11da215-324d-4c8d-90a5-0b7f26186c4c:3638:1876044666931072:0@lo:400:kworker.0 00010000:00080000:0.0:1789136321.391250:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90a6c3d91e00 x1876044666931584/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789136337 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789136321.391258:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c3d91e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3638:1876044666931584:0@lo:400:kworker.0 00010000:00080000:0.0:1789136321.391266:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90a6c3d930c0 x1876044666932096/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789136337 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789136321.391273:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c3d930c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3638:1876044666932096:0@lo:400:kworker.0 00000100:00100000:0.0:1789136321.391305:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7d55af480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1876044666931328:0@lo:400:kworker.0 00000100:00100000:0.0:1789136321.391312:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c3d903c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1876044666931840:0@lo:400:kworker.0 00010000:00080000:0.0:1789136321.391320:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90a6c3d912c0 x1876044666932352/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789136337 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789136321.391328:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c3d912c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3641:1876044666932352:0@lo:400:kworker.0 00000100:00100000:0.0:1789136321.391338:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7d55aed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1876044666931456:0@lo:400:kworker.0 00010000:00080000:0.0:1789136321.391346:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90a6c3d93c00 x1876044666931968/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789136337 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789136321.391354:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c3d93c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3641:1876044666931968:0@lo:400:kworker.0 00010000:00080000:0.0:1789136321.391370:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90a6c3d90f00 x1876044666932480/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789136337 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789136321.391378:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c3d90f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3641:1876044666932480:0@lo:400:kworker.0 00000100:00100000:3.0:1789136321.392666:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789136321.392694:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c3fe30c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1876044666932608:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1789136321.392744:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789136321.392783:0:24077:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666932608 00000100:00100000:3.0:1789136321.392788:0:24077:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666932608 00000100:00100000:3.0:1789136321.392827:0:24077:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1789136321.392835:0:24077:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c3fe2d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3639:x1876044666932608:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1789136321.392881:0:24077:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446309888 avail 1300070400 00000100:00100000:3.0:1789136321.392921:0:24077:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c3fe2d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3639:x1876044666932608:12345-0@lo:41:osp-pre-0-1.0 Request processed in 87us (177us total) trans 0 rc 0/0 00000100:00100000:3.0:1789136321.392928:0:24077:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1789136321.392965:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c3fe30c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1876044666932608:0@lo:41:osp-pre-0-1.0 00000100:00080000:2.0:1789136321.393296:0:23328:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789136321.393303:0:23328:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1789136321.393306:0:23328:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789136321.393311:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789136321.393320:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c3cea580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1876044666932736:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789136321.393352:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789136321.393390:0:24849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666932736 00000100:00100000:2.0:1789136321.393394:0:24849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666932736 00000100:00100000:2.0:1789136321.393421:0:24849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1789136321.393439:0:24849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c3ce92c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3638:x1876044666932736:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789136321.393465:0:24849:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923501056 avail 3691978752 00000100:00100000:2.0:1789136321.393500:0:24849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c3ce92c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3638:x1876044666932736:12345-0@lo:13:osp-pre-1-0.0 Request processed in 61us (147us total) trans 0 rc 0/0 00000100:00100000:2.0:1789136321.393505:0:24849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1789136321.393540:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c3cea580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1876044666932736:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789136321.394647:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789136321.394660:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c3ff7840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1876044666932864:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1789136321.394711:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789136321.398958:0:23339:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666932864 00000100:00100000:0.0:1789136321.398975:0:23339:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666932864 00000100:00100000:0.0:1789136321.399088:0:23339:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1789136321.399099:0:23339:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c3ff43c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3641:x1876044666932864:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1789136321.399137:0:23339:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1789136321.399219:0:23339:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c3ff43c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3641:x1876044666932864:12345-0@lo:41:osp-pre-1-0.0 Request processed in 122us (4508us total) trans 0 rc 0/0 00000100:00100000:0.0:1789136321.399226:0:23339:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1789136321.399805:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c3ff7840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1876044666932864:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1789136321.672537:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:2.0:1789136321.672767:0:23325:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644770304 00000100:00100000:2.0:1789136321.672777:0:23325:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644770304 00000100:00100000:2.0:1789136321.672819:0:23325:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 114 00000100:00100000:2.0:1789136321.672825:0:23325:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7dd561850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0+-99:2388:x1876044644770304:12345-192.168.201.31@tcp:250:mount.lustre.0 00010000:00080000:2.0:1789136321.672894:0:23325:0:(ldlm_lib.c:1482:target_handle_connect()) MGS: connection from 27cf2c08-90ce-45f0-9821-89831e8ff070@192.168.201.31@tcp t0 exp 0000000000000000 cur 769 last 0 00000020:00000080:2.0:1789136321.672936:0:23325:0:(genops.c:1385:class_connect()) connect: client 27cf2c08-90ce-45f0-9821-89831e8ff070, cookie 0x559c8745c6de492d 00000100:00080000:2.0:1789136321.673059:0:23325:0:(import.c:65:import_set_state_nolock()) ffff90a6c44f0800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789136321.673110:0:23325:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7dd561850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:27cf2c08-90ce-45f0-9821-89831e8ff070+5:2388:x1876044644770304:12345-192.168.201.31@tcp:250:mount.lustre.0 Request processed in 284us (590us total) trans 0 rc 0/0 00000100:00100000:2.0:1789136321.673115:0:23325:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 114 00000100:00100000:0.0:1789136321.689403:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:2.0:1789136321.689841:0:23324:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644770432 00000100:00100000:2.0:1789136321.689870:0:23324:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644770432 00000100:00100000:2.0:1789136321.689947:0:23324:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 115 00000100:00100000:2.0:1789136321.689958:0:23324:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7dd560050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:27cf2c08-90ce-45f0-9821-89831e8ff070+5:18315:x1876044644770432:12345-192.168.201.31@tcp:101:mount.lustre.0 00010000:00010000:2.0:1789136321.689976:0:23324:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789136321.689995:0:23324:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90a7c0030400/0x559c8745c6de4934 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0xa7228e7a1ab08ed2 expref: -99 pid: 23324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136321.690044:0:23324:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90a7c0030400/0x559c8745c6de4934 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08ed2 expref: 6 pid: 23324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136321.690055:0:23324:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90a7c0030400/0x559c8745c6de4934 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08ed2 expref: 6 pid: 23324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136321.690065:0:23324:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a7c0030400, rc 0) 00000100:00100000:2.0:1789136321.690121:0:23324:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7dd560050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:27cf2c08-90ce-45f0-9821-89831e8ff070+6:18315:x1876044644770432:12345-192.168.201.31@tcp:101:mount.lustre.0 Request processed in 165us (727us total) trans 0 rc 0/0 00000100:00100000:2.0:1789136321.690128:0:23324:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 115 00000100:00100000:1.0:1789136321.698275:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:0.0:1789136321.698393:0:23327:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644770560 00000100:00100000:0.0:1789136321.698403:0:23327:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644770560 00000100:00100000:0.0:1789136321.698474:0:23327:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 116 00000100:00100000:0.0:1789136321.698486:0:23327:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7dd561c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:27cf2c08-90ce-45f0-9821-89831e8ff070+6:18315:x1876044644770560:12345-192.168.201.31@tcp:501:mount.lustre.0 00000100:00100000:0.0:1789136321.698636:0:23327:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7dd561c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:27cf2c08-90ce-45f0-9821-89831e8ff070+6:18315:x1876044644770560:12345-192.168.201.31@tcp:501:mount.lustre.0 Request processed in 151us (373us total) trans 0 rc -2/-2 00000100:00100000:0.0:1789136321.698644:0:23327:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 116 00000100:00100000:1.0:1789136321.708898:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:3.0:1789136321.709045:0:23325:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644770688 00000100:00100000:3.0:1789136321.709055:0:23325:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644770688 00000100:00100000:3.0:1789136321.709102:0:23325:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 117 00000100:00100000:3.0:1789136321.709113:0:23325:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7dd562450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:27cf2c08-90ce-45f0-9821-89831e8ff070+6:18315:x1876044644770688:12345-192.168.201.31@tcp:101:mount.lustre.0 00010000:00010000:3.0:1789136321.709141:0:23325:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789136321.709159:0:23325:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90a7e1c9ea00/0x559c8745c6de493b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: local remote: 0xa7228e7a1ab08ed9 expref: -99 pid: 23325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136321.709188:0:23325:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90a7e1c9ea00/0x559c8745c6de493b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000000 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08ed9 expref: 7 pid: 23325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136321.709198:0:23325:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90a7e1c9ea00/0x559c8745c6de493b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08ed9 expref: 7 pid: 23325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136321.709208:0:23325:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a7e1c9ea00, rc 0) 00000100:00100000:3.0:1789136321.709266:0:23325:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7dd562450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:27cf2c08-90ce-45f0-9821-89831e8ff070+7:18315:x1876044644770688:12345-192.168.201.31@tcp:101:mount.lustre.0 Request processed in 154us (422us total) trans 0 rc 0/0 00000100:00100000:3.0:1789136321.709273:0:23325:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 117 00000100:00100000:1.0:1789136321.714086:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:2.0:1789136321.714183:0:23324:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644770816 00000100:00100000:2.0:1789136321.714193:0:23324:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644770816 00000100:00100000:2.0:1789136321.714251:0:23324:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 118 00000100:00100000:2.0:1789136321.714260:0:23324:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7dd563c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:27cf2c08-90ce-45f0-9821-89831e8ff070+7:18315:x1876044644770816:12345-192.168.201.31@tcp:501:mount.lustre.0 00000100:00100000:2.0:1789136321.714427:0:23324:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7dd563c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:27cf2c08-90ce-45f0-9821-89831e8ff070+8:18315:x1876044644770816:12345-192.168.201.31@tcp:501:mount.lustre.0 Request processed in 168us (351us total) trans 0 rc 0/0 00000100:00100000:2.0:1789136321.714436:0:23324:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 118 00000100:00100000:1.0:1789136321.725300:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:0.0:1789136321.725417:0:23327:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644770944 00000100:00100000:0.0:1789136321.725427:0:23327:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644770944 00000100:00100000:0.0:1789136321.725509:0:23327:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 119 00000100:00100000:0.0:1789136321.725519:0:23327:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7dd561050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:27cf2c08-90ce-45f0-9821-89831e8ff070+8:18315:x1876044644770944:12345-192.168.201.31@tcp:503:mount.lustre.0 00000100:00100000:0.0:1789136321.725672:0:23327:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7dd561050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:27cf2c08-90ce-45f0-9821-89831e8ff070+8:18315:x1876044644770944:12345-192.168.201.31@tcp:503:mount.lustre.0 Request processed in 153us (382us total) trans 0 rc 0/0 00000100:00100000:0.0:1789136321.725690:0:23327:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 119 00000100:00100000:1.0:1789136321.736948:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:3.0:1789136321.737818:0:23325:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644771072 00000100:00100000:3.0:1789136321.737830:0:23325:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644771072 00000100:00100000:3.0:1789136321.737931:0:23325:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 120 00000100:00100000:3.0:1789136321.737942:0:23325:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7dd562c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:27cf2c08-90ce-45f0-9821-89831e8ff070+8:18333:x1876044644771072:12345-192.168.201.31@tcp:502:llog_process_th.0 00000100:00100000:3.0:1789136321.738109:0:23325:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7dd562c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:27cf2c08-90ce-45f0-9821-89831e8ff070+8:18333:x1876044644771072:12345-192.168.201.31@tcp:502:llog_process_th.0 Request processed in 168us (1171us total) trans 0 rc 0/0 00000100:00100000:3.0:1789136321.738117:0:23325:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 120 00000100:00100000:1.0:1789136321.818931:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:2.0:1789136321.819035:0:23324:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644771200 00000100:00100000:2.0:1789136321.819044:0:23324:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644771200 00000100:00100000:2.0:1789136321.819104:0:23324:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 121 00000100:00100000:2.0:1789136321.819114:0:23324:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7dd560850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:27cf2c08-90ce-45f0-9821-89831e8ff070+8:18333:x1876044644771200:12345-192.168.201.31@tcp:502:llog_process_th.0 00000100:00100000:2.0:1789136321.819265:0:23324:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7dd560850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:27cf2c08-90ce-45f0-9821-89831e8ff070+8:18333:x1876044644771200:12345-192.168.201.31@tcp:502:llog_process_th.0 Request processed in 152us (356us total) trans 0 rc 0/0 00000100:00100000:2.0:1789136321.819272:0:23324:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 121 00000100:00100000:1.0:1789136321.828012:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:0.0:1789136321.828522:0:23327:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644771328 00000100:00100000:0.0:1789136321.828644:0:23327:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644771328 00000100:00100000:0.0:1789136321.828722:0:23327:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 122 00000100:00100000:0.0:1789136321.828732:0:23327:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7dd563450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:27cf2c08-90ce-45f0-9821-89831e8ff070+8:18333:x1876044644771328:12345-192.168.201.31@tcp:502:llog_process_th.0 00000100:00100000:0.0:1789136321.828930:0:23327:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7dd563450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:27cf2c08-90ce-45f0-9821-89831e8ff070+8:18333:x1876044644771328:12345-192.168.201.31@tcp:502:llog_process_th.0 Request processed in 198us (927us total) trans 0 rc 0/0 00000100:00100000:0.0:1789136321.828938:0:23327:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 122 00000100:00100000:1.0:1789136321.836286:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:3.0:1789136321.836446:0:23325:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644771456 00000100:00100000:3.0:1789136321.836455:0:23325:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644771456 00000100:00100000:3.0:1789136321.836512:0:23325:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 123 00000100:00100000:3.0:1789136321.836523:0:23325:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7dd560450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:27cf2c08-90ce-45f0-9821-89831e8ff070+8:18315:x1876044644771456:12345-192.168.201.31@tcp:101:mount.lustre.0 00010000:00010000:3.0:1789136321.836548:0:23325:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789136321.836576:0:23325:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90a7e1c9e800/0x559c8745c6de4942 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xa7228e7a1ab08f0a expref: -99 pid: 23325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136321.836603:0:23325:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90a7e1c9e800/0x559c8745c6de4942 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08f0a expref: 9 pid: 23325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136321.836614:0:23325:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90a7e1c9e800/0x559c8745c6de4942 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08f0a expref: 9 pid: 23325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136321.836624:0:23325:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a7e1c9e800, rc 0) 00000100:00100000:3.0:1789136321.836689:0:23325:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7dd560450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:27cf2c08-90ce-45f0-9821-89831e8ff070+9:18315:x1876044644771456:12345-192.168.201.31@tcp:101:mount.lustre.0 Request processed in 167us (411us total) trans 0 rc 0/0 00000100:00100000:3.0:1789136321.836696:0:23325:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 123 00000100:00100000:1.0:1789136321.842352:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:2.0:1789136321.842455:0:23324:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644771584 00000100:00100000:2.0:1789136321.842481:0:23324:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644771584 00000100:00100000:2.0:1789136321.842650:0:23324:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 124 00000100:00100000:2.0:1789136321.842662:0:23324:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7dd560c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:27cf2c08-90ce-45f0-9821-89831e8ff070+9:18315:x1876044644771584:12345-192.168.201.31@tcp:256:mount.lustre.0 20000000:01000000:2.0:1789136321.842699:0:23324:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:2.0:1789136321.842716:0:23324:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:2.0:1789136321.842721:0:23324:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:2.0:1789136321.842724:0:23324:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:2.0:1789136321.842727:0:23324:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/256/255. 20000000:01000000:2.0:1789136321.842729:0:23324:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 14 00000100:00100000:3.0:1789136321.851405:0:23324:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7dd560c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:27cf2c08-90ce-45f0-9821-89831e8ff070+9:18315:x1876044644771584:12345-192.168.201.31@tcp:256:mount.lustre.0 Request processed in 8736us (9053us total) trans 0 rc 0/0 00000100:00100000:3.0:1789136321.851418:0:23324:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 124 00000100:00100000:1.0:1789136321.856319:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:0.0:1789136321.856436:0:23327:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644771712 00000100:00100000:0.0:1789136321.856446:0:23327:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644771712 00000100:00100000:0.0:1789136321.856565:0:23327:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 125 00000100:00100000:0.0:1789136321.856575:0:23327:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7dd563850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:27cf2c08-90ce-45f0-9821-89831e8ff070+9:18315:x1876044644771712:12345-192.168.201.31@tcp:101:mount.lustre.0 00010000:00010000:0.0:1789136321.856594:0:23327:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789136321.856611:0:23327:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90a6c3cae400/0x559c8745c6de4949 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xa7228e7a1ab08f11 expref: -99 pid: 23327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136321.856642:0:23327:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90a6c3cae400/0x559c8745c6de4949 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08f11 expref: 10 pid: 23327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136321.856654:0:23327:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90a6c3cae400/0x559c8745c6de4949 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08f11 expref: 10 pid: 23327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136321.856663:0:23327:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a6c3cae400, rc 0) 00000100:00100000:0.0:1789136321.856753:0:23327:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7dd563850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:27cf2c08-90ce-45f0-9821-89831e8ff070+10:18315:x1876044644771712:12345-192.168.201.31@tcp:101:mount.lustre.0 Request processed in 179us (445us total) trans 0 rc 0/0 00000100:00100000:0.0:1789136321.856760:0:23327:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 125 00000100:00100000:1.0:1789136321.859346:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:3.0:1789136321.859988:0:23324:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644771840 00000100:00100000:3.0:1789136321.859998:0:23324:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644771840 00000100:00100000:3.0:1789136321.860063:0:23324:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 126 00000100:00100000:3.0:1789136321.860074:0:23324:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7f6658450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:27cf2c08-90ce-45f0-9821-89831e8ff070+10:18315:x1876044644771840:12345-192.168.201.31@tcp:501:mount.lustre.0 00000100:00100000:3.0:1789136321.860232:0:23324:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7f6658450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:27cf2c08-90ce-45f0-9821-89831e8ff070+10:18315:x1876044644771840:12345-192.168.201.31@tcp:501:mount.lustre.0 Request processed in 159us (895us total) trans 0 rc 0/0 00000100:00100000:3.0:1789136321.860241:0:23324:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 126 00000100:00100000:2.0:1789136321.866173:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:0.0:1789136321.866257:0:23327:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644771968 00000100:00100000:0.0:1789136321.866266:0:23327:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644771968 00000100:00100000:0.0:1789136321.866324:0:23327:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 127 00000100:00100000:0.0:1789136321.866335:0:23327:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7f6659050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:27cf2c08-90ce-45f0-9821-89831e8ff070+10:18315:x1876044644771968:12345-192.168.201.31@tcp:503:mount.lustre.0 00000100:00100000:0.0:1789136321.866493:0:23327:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7f6659050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:27cf2c08-90ce-45f0-9821-89831e8ff070+10:18315:x1876044644771968:12345-192.168.201.31@tcp:503:mount.lustre.0 Request processed in 159us (330us total) trans 0 rc 0/0 00000100:00100000:0.0:1789136321.866501:0:23327:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 127 00000100:00100000:1.0:1789136321.872205:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:2.0:1789136321.872327:0:23325:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644772096 00000100:00100000:2.0:1789136321.872337:0:23325:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644772096 00000100:00100000:2.0:1789136321.872397:0:23325:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 128 00000100:00100000:2.0:1789136321.872408:0:23325:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7fb157450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:27cf2c08-90ce-45f0-9821-89831e8ff070+10:18337:x1876044644772096:12345-192.168.201.31@tcp:502:llog_process_th.0 00000100:00100000:2.0:1789136321.872605:0:23325:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7fb157450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:27cf2c08-90ce-45f0-9821-89831e8ff070+10:18337:x1876044644772096:12345-192.168.201.31@tcp:502:llog_process_th.0 Request processed in 197us (408us total) trans 0 rc 0/0 00000100:00100000:2.0:1789136321.872613:0:23325:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 128 00000100:00100000:1.0:1789136321.881655:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:3.0:1789136321.881752:0:23324:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644772224 00000100:00100000:3.0:1789136321.881761:0:23324:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644772224 00000100:00100000:3.0:1789136321.881817:0:23324:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 129 00000100:00100000:3.0:1789136321.881827:0:23324:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7fb154850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:27cf2c08-90ce-45f0-9821-89831e8ff070+10:18337:x1876044644772224:12345-192.168.201.31@tcp:502:llog_process_th.0 00000100:00100000:3.0:1789136321.882029:0:23324:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7fb154850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:27cf2c08-90ce-45f0-9821-89831e8ff070+10:18337:x1876044644772224:12345-192.168.201.31@tcp:502:llog_process_th.0 Request processed in 202us (383us total) trans 0 rc 0/0 00000100:00100000:3.0:1789136321.882037:0:23324:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 129 00000100:00100000:1.0:1789136321.891189:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:1.0:1789136321.891283:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:3.0:1789136321.891513:0:23334:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644772352 00000100:00100000:3.0:1789136321.891534:0:23334:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644772352 00000100:00100000:3.0:1789136321.891577:0:23334:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644772608 00000100:00100000:3.0:1789136321.891581:0:23334:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644772608 00000100:00100000:3.0:1789136321.891597:0:23334:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 7 00000100:00100000:3.0:1789136321.891605:0:23334:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7fa39a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2388:x1876044644772352:12345-192.168.201.31@tcp:38:mount.lustre.0 00010000:00080000:3.0:1789136321.891638:0:23334:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-MDT0000: connection from bb852e64-3f46-4395-9dea-0822b7213ac8@192.168.201.31@tcp t0 exp 0000000000000000 cur 770 last 0 00000020:00000080:3.0:1789136321.891698:0:23334:0:(genops.c:1385:class_connect()) connect: client bb852e64-3f46-4395-9dea-0822b7213ac8, cookie 0x559c8745c6de4950 00000004:00100000:3.0:1789136321.891722:0:23334:0:(mdt_handler.c:7302:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:3.0:1789136321.891978:0:23334:0:(import.c:65:import_set_state_nolock()) ffff90a7f02a7800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789136321.892042:0:23334:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7fa39a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bb852e64-3f46-4395-9dea-0822b7213ac8+6:2388:x1876044644772352:12345-192.168.201.31@tcp:38:mount.lustre.0 Request processed in 436us (862us total) trans 0 rc 0/0 00000100:00100000:3.0:1789136321.892052:0:23334:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 7 00000100:00100000:3.0:1789136321.892072:0:23334:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 8 00000100:00100000:3.0:1789136321.892077:0:23334:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7fa398780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2388:x1876044644772608:12345-192.168.201.31@tcp:38:mount.lustre.0 00010000:00080000:3.0:1789136321.892094:0:23334:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-MDT0001: connection from bb852e64-3f46-4395-9dea-0822b7213ac8@192.168.201.31@tcp t0 exp 0000000000000000 cur 770 last 0 00000020:00000080:3.0:1789136321.892122:0:23334:0:(genops.c:1385:class_connect()) connect: client bb852e64-3f46-4395-9dea-0822b7213ac8, cookie 0x559c8745c6de4957 00000004:00100000:3.0:1789136321.892136:0:23334:0:(mdt_handler.c:7302:mdt_connect_internal()) lustre-MDT0001: cli supports cksum type f7, return f7 00000100:00080000:3.0:1789136321.892272:0:23334:0:(import.c:65:import_set_state_nolock()) ffff90a7f02a5800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789136321.892300:0:23334:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7fa398780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bb852e64-3f46-4395-9dea-0822b7213ac8+6:2388:x1876044644772608:12345-192.168.201.31@tcp:38:mount.lustre.0 Request processed in 220us (1016us total) trans 0 rc 0/0 00000100:00100000:3.0:1789136321.892307:0:23334:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 8 00000100:00100000:3.0:1789136321.898238:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:3.0:1789136321.898286:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:0.0:1789136321.898708:0:23334:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644772736 00000100:00100000:0.0:1789136321.898720:0:23334:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644772736 00000100:00100000:0.0:1789136321.898791:0:23334:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644772480 00000100:00100000:0.0:1789136321.898795:0:23334:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644772480 00000100:00100000:0.0:1789136321.898815:0:23334:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 9 00000100:00100000:0.0:1789136321.898825:0:23334:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c3fe30c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bb852e64-3f46-4395-9dea-0822b7213ac8+6:0:x1876044644772736:12345-192.168.201.31@tcp:41:mount.lustre.0 00000004:00000024:0.0:1789136321.898882:0:23334:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1789136321.898976:0:23334:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c3fe30c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bb852e64-3f46-4395-9dea-0822b7213ac8+6:0:x1876044644772736:12345-192.168.201.31@tcp:41:mount.lustre.0 Request processed in 152us (748us total) trans 0 rc 0/0 00000100:00100000:0.0:1789136321.898984:0:23334:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 9 00000100:00100000:0.0:1789136321.899002:0:23334:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 10 00000100:00100000:0.0:1789136321.899008:0:23334:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c3fe1680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bb852e64-3f46-4395-9dea-0822b7213ac8+6:0:x1876044644772480:12345-192.168.201.31@tcp:41:mount.lustre.0 00000004:00000024:0.0:1789136321.899044:0:23334:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446309888 avail 1300070400 00000100:00100000:0.0:1789136321.899084:0:23334:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c3fe1680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bb852e64-3f46-4395-9dea-0822b7213ac8+6:0:x1876044644772480:12345-192.168.201.31@tcp:41:mount.lustre.0 Request processed in 76us (798us total) trans 0 rc 0/0 00000100:00100000:0.0:1789136321.899091:0:23334:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 10 00000100:00080000:3.0:1789136321.899695:0:23328:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789136321.899701:0:23328:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1789136321.904182:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000001:00080000:2.0:1789136321.904374:0:25663:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 12884901890 is committed 00000100:00100000:0.0:1789136321.904485:0:23334:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644772864 00000100:00100000:0.0:1789136321.904503:0:23334:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644772864 00000100:00100000:0.0:1789136321.904583:0:23334:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 11 00000100:00100000:0.0:1789136321.904595:0:23334:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7fa39b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bb852e64-3f46-4395-9dea-0822b7213ac8+6:18315:x1876044644772864:12345-192.168.201.31@tcp:41:mount.lustre.0 00000004:00000024:0.0:1789136321.904628:0:23334:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446309888 avail 1300070400 00000100:00100000:0.0:1789136321.904715:0:23334:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7fa39b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bb852e64-3f46-4395-9dea-0822b7213ac8+6:18315:x1876044644772864:12345-192.168.201.31@tcp:41:mount.lustre.0 Request processed in 122us (544us total) trans 0 rc 0/0 00000100:00100000:0.0:1789136321.904724:0:23334:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 11 00000100:00100000:0.0:1789136321.916977:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:2.0:1789136321.917050:0:23333:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644772992 00000100:00100000:2.0:1789136321.917062:0:23333:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644772992 00000100:00100000:2.0:1789136321.917127:0:23333:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 12 00000100:00100000:2.0:1789136321.917137:0:23333:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c3ff7840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bb852e64-3f46-4395-9dea-0822b7213ac8+6:18315:x1876044644772992:12345-192.168.201.31@tcp:40:mount.lustre.0 00000100:00100000:2.0:1789136321.917231:0:23333:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c3ff7840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bb852e64-3f46-4395-9dea-0822b7213ac8+6:18315:x1876044644772992:12345-192.168.201.31@tcp:40:mount.lustre.0 Request processed in 95us (265us total) trans 0 rc 0/0 00000100:00100000:2.0:1789136321.917239:0:23333:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 12 00000100:00100000:3.0:1789136321.921517:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:1.0:1789136321.921625:0:23344:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644773376 00000100:00100000:1.0:1789136321.921636:0:23344:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644773376 00000100:00100000:1.0:1789136321.921709:0:23344:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 3 00000100:00100000:1.0:1789136321.921719:0:23344:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c3fe0f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:bb852e64-3f46-4395-9dea-0822b7213ac8+6:18315:x1876044644773376:12345-192.168.201.31@tcp:900:mount.lustre.0 00000100:00100000:1.0:1789136321.921805:0:23344:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c3fe0f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:bb852e64-3f46-4395-9dea-0822b7213ac8+6:18315:x1876044644773376:12345-192.168.201.31@tcp:900:mount.lustre.0 Request processed in 88us (298us total) trans 0 rc 0/0 00000100:00100000:1.0:1789136321.921813:0:23344:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 3 00000100:00100000:1.0:1789136321.923024:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:1.0:1789136321.923067:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:2.0:1789136321.923169:0:25418:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644773120 00000100:00100000:2.0:1789136321.923177:0:25418:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644773120 00000100:00100000:2.0:1789136321.923222:0:25418:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644773248 00000100:00100000:2.0:1789136321.923226:0:25418:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644773248 00000100:00100000:2.0:1789136321.923254:0:25418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 19 00000100:00100000:2.0:1789136321.923262:0:25418:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7fa39bc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2388:x1876044644773120:12345-192.168.201.31@tcp:8:mount.lustre.0 00010000:00080000:2.0:1789136321.923293:0:25418:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-OST0000: connection from bb852e64-3f46-4395-9dea-0822b7213ac8@192.168.201.31@tcp t0 exp 0000000000000000 cur 770 last 0 00000020:00000080:2.0:1789136321.923324:0:25418:0:(genops.c:1385:class_connect()) connect: client bb852e64-3f46-4395-9dea-0822b7213ac8, cookie 0x559c8745c6de495e 00002000:00100000:2.0:1789136321.923336:0:25418:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli bb852e64-3f46-4395-9dea-0822b7213ac8/ffff90a6c44f1000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 211397f ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1789136321.923354:0:25418:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:2.0:1789136321.923557:0:25418:0:(ofd_obd.c:389:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1789136321.923599:0:25418:0:(import.c:65:import_set_state_nolock()) ffff90a6c44f5000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789136321.923655:0:25418:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7fa39bc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:bb852e64-3f46-4395-9dea-0822b7213ac8+6:2388:x1876044644773120:12345-192.168.201.31@tcp:8:mount.lustre.0 Request processed in 392us (635us total) trans 0 rc 0/0 00000100:00100000:2.0:1789136321.923663:0:25418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 19 00000100:00100000:2.0:1789136321.923692:0:25418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 20 00000100:00100000:2.0:1789136321.923697:0:25418:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c109b840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2388:x1876044644773248:12345-192.168.201.31@tcp:8:mount.lustre.0 00010000:00080000:2.0:1789136321.923714:0:25418:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-OST0001: connection from bb852e64-3f46-4395-9dea-0822b7213ac8@192.168.201.31@tcp t0 exp 0000000000000000 cur 770 last 0 00000020:00000080:2.0:1789136321.923730:0:25418:0:(genops.c:1385:class_connect()) connect: client bb852e64-3f46-4395-9dea-0822b7213ac8, cookie 0x559c8745c6de4965 00002000:00100000:2.0:1789136321.923736:0:25418:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli bb852e64-3f46-4395-9dea-0822b7213ac8/ffff90a6c44f4800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 211397f ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1789136321.923743:0:25418:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:2.0:1789136321.923956:0:25418:0:(ofd_obd.c:389:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1789136321.923972:0:25418:0:(import.c:65:import_set_state_nolock()) ffff90a6c44f5800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789136321.923999:0:25418:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c109b840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:bb852e64-3f46-4395-9dea-0822b7213ac8+6:2388:x1876044644773248:12345-192.168.201.31@tcp:8:mount.lustre.0 Request processed in 300us (931us total) trans 0 rc 0/0 00000100:00100000:2.0:1789136321.924005:0:25418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 20 00000100:00100000:3.0:1789136321.924789:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:2.0:1789136321.925095:0:23335:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644773504 00000100:00100000:2.0:1789136321.925102:0:23335:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644773504 00000100:00100000:2.0:1789136321.925148:0:23335:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 0 00000100:00100000:2.0:1789136321.925156:0:23335:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c3fe03c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bb852e64-3f46-4395-9dea-0822b7213ac8+6:18315:x1876044644773504:12345-192.168.201.31@tcp:33:mount.lustre.0 00000004:00080000:3.0:1789136321.931136:0:23335:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 5900us 00000004:00200000:3.0:1789136321.957691:0:23335:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:3.0:1789136321.957844:0:23335:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c3fe03c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bb852e64-3f46-4395-9dea-0822b7213ac8+6:18315:x1876044644773504:12345-192.168.201.31@tcp:33:mount.lustre.0 Request processed in 32672us (33040us total) trans 0 rc 0/0 00000100:00100000:3.0:1789136321.957885:0:23335:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 0 00010000:00010000:2.0:1789136322.285087:0:23320:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789136322.359710:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:0.0:1789136322.359837:0:23334:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644773632 00000100:00100000:0.0:1789136322.359849:0:23334:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644773632 00000100:00100000:0.0:1789136322.359996:0:23334:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 13 00000100:00100000:0.0:1789136322.360007:0:23334:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c3fe3c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bb852e64-3f46-4395-9dea-0822b7213ac8+6:18362:x1876044644773632:12345-192.168.201.31@tcp:101:mkdir.0 00010000:00010000:0.0:1789136322.360026:0:23334:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789136322.360051:0:23334:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3caf600/0x559c8745c6de496c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa7228e7a1ab08f42 expref: -99 pid: 23334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136322.360112:0:23334:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3caf800/0x559c8745c6de4973 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 23334 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136322.360125:0:23334:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3caf800/0x559c8745c6de4973 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 23334 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136322.360138:0:23334:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3caf800/0x559c8745c6de4973 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 23334 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789136322.360184:0:23334:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1789136322.360188:0:23334:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1789136322.360220:0:23334:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3caf800/0x559c8745c6de4973 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 23334 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136322.360269:0:23334:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3caf600/0x559c8745c6de496c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08f42 expref: 8 pid: 23334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136322.360286:0:23334:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3caf800/0x559c8745c6de4973 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08f42 expref: 7 pid: 23334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136322.360300:0:23334:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90a7fa5c0a00) 00010000:00010000:0.0:1789136322.360303:0:23334:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789136322.360307:0:23334:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a6c3caf800, rc 0) 00000100:00100000:0.0:1789136322.360387:0:23334:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c3fe3c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bb852e64-3f46-4395-9dea-0822b7213ac8+7:18362:x1876044644773632:12345-192.168.201.31@tcp:101:mkdir.0 Request processed in 381us (686us total) trans 0 rc 0/0 00000100:00100000:0.0:1789136322.360395:0:23334:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 13 00000040:00080000:2.0:1789136322.921210:0:23370:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1789136323.304057:0:23321:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789136324.328326:0:23320:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789136324.895150:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:2.0:1789136324.895256:0:23333:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644773760 00000100:00100000:2.0:1789136324.895266:0:23333:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644773760 00000100:00100000:2.0:1789136324.895356:0:23333:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 14 00000100:00100000:2.0:1789136324.895368:0:23333:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c1098b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bb852e64-3f46-4395-9dea-0822b7213ac8+7:18414:x1876044644773760:12345-192.168.201.31@tcp:41:lfs.0 00000004:00000024:2.0:1789136324.895418:0:23333:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446309888 avail 1300070400 00000100:00100000:2.0:1789136324.895513:0:23333:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c1098b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bb852e64-3f46-4395-9dea-0822b7213ac8+7:18414:x1876044644773760:12345-192.168.201.31@tcp:41:lfs.0 Request processed in 147us (372us total) trans 0 rc 0/0 00000100:00100000:2.0:1789136324.895521:0:23333:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 14 00000100:00080000:3.0:1789136324.896033:0:23328:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789136324.898239:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:0.0:1789136324.898400:0:23334:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644773888 00000100:00100000:0.0:1789136324.898410:0:23334:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644773888 00000100:00100000:0.0:1789136324.898480:0:23334:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 15 00000100:00100000:0.0:1789136324.898489:0:23334:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c1099680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bb852e64-3f46-4395-9dea-0822b7213ac8+6:18414:x1876044644773888:12345-192.168.201.31@tcp:41:lfs.0 00000004:00000024:0.0:1789136324.898524:0:23334:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1789136324.898615:0:23334:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c1099680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bb852e64-3f46-4395-9dea-0822b7213ac8+6:18414:x1876044644773888:12345-192.168.201.31@tcp:41:lfs.0 Request processed in 127us (384us total) trans 0 rc 0/0 00000100:00100000:0.0:1789136324.898631:0:23334:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 15 00000100:00080000:3.0:1789136324.899106:0:23328:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1789136324.903360:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:2.0:1789136324.903497:0:24849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644774016 00000100:00100000:2.0:1789136324.903506:0:24849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644774016 00000100:00100000:2.0:1789136324.903573:0:24849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 13 00000100:00100000:2.0:1789136324.903582:0:24849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c109a580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:bb852e64-3f46-4395-9dea-0822b7213ac8+6:18414:x1876044644774016:12345-192.168.201.31@tcp:13:lfs.0 00002000:00000024:2.0:1789136324.903631:0:24849:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3915853824 avail 3684331520 00000100:00100000:2.0:1789136324.903959:0:24849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c109a580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:bb852e64-3f46-4395-9dea-0822b7213ac8+6:18414:x1876044644774016:12345-192.168.201.31@tcp:13:lfs.0 Request processed in 377us (607us total) trans 0 rc 0/0 00000100:00100000:2.0:1789136324.903967:0:24849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 13 00000100:00080000:3.0:1789136324.904943:0:23328:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789136324.909830:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:2.0:1789136324.910129:0:24849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644774144 00000100:00100000:2.0:1789136324.910138:0:24849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644774144 00000100:00100000:2.0:1789136324.910261:0:24849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 14 00000100:00100000:2.0:1789136324.910272:0:24849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c3ff52c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:bb852e64-3f46-4395-9dea-0822b7213ac8+6:18414:x1876044644774144:12345-192.168.201.31@tcp:13:lfs.0 00002000:00000024:2.0:1789136324.910329:0:24849:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923501056 avail 3691978752 00000100:00100000:2.0:1789136324.910418:0:24849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c3ff52c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:bb852e64-3f46-4395-9dea-0822b7213ac8+6:18414:x1876044644774144:12345-192.168.201.31@tcp:13:lfs.0 Request processed in 147us (597us total) trans 0 rc 0/0 00000100:00100000:2.0:1789136324.910425:0:24849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 14 00000100:00080000:3.0:1789136324.911740:0:23328:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789136325.269188:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:0.0:1789136325.269432:0:23327:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644774272 00000100:00100000:0.0:1789136325.269443:0:23327:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644774272 00000100:00100000:0.0:1789136325.269507:0:23327:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 130 00000100:00100000:0.0:1789136325.269517:0:23327:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7fb156c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:27cf2c08-90ce-45f0-9821-89831e8ff070+10:18445:x1876044644774272:12345-192.168.201.31@tcp:101:mount.lustre.0 00010000:00010000:0.0:1789136325.269549:0:23327:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789136325.269567:0:23327:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90a6c3caea00/0x559c8745c6de497a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: local remote: 0xa7228e7a1ab08f49 expref: -99 pid: 23327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136325.269609:0:23327:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90a6c3caea00/0x559c8745c6de497a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000000 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08f49 expref: 11 pid: 23327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136325.269630:0:23327:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90a6c3caea00/0x559c8745c6de497a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08f49 expref: 11 pid: 23327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136325.269640:0:23327:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a6c3caea00, rc 0) 00000100:00100000:0.0:1789136325.269701:0:23327:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7fb156c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:27cf2c08-90ce-45f0-9821-89831e8ff070+11:18445:x1876044644774272:12345-192.168.201.31@tcp:101:mount.lustre.0 Request processed in 185us (522us total) trans 0 rc 0/0 00000100:00100000:0.0:1789136325.269709:0:23327:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 130 00000100:00100000:1.0:1789136325.304911:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:2.0:1789136325.305229:0:23325:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644774400 00000100:00100000:2.0:1789136325.305240:0:23325:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644774400 00000100:00100000:2.0:1789136325.305301:0:23325:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 131 00000100:00100000:2.0:1789136325.305310:0:23325:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7fb155050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:27cf2c08-90ce-45f0-9821-89831e8ff070+11:18445:x1876044644774400:12345-192.168.201.31@tcp:501:mount.lustre.0 00000100:00100000:2.0:1789136325.305484:0:23325:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7fb155050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:27cf2c08-90ce-45f0-9821-89831e8ff070+11:18445:x1876044644774400:12345-192.168.201.31@tcp:501:mount.lustre.0 Request processed in 174us (633us total) trans 0 rc 0/0 00000100:00100000:2.0:1789136325.305493:0:23325:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 131 00000100:00100000:1.0:1789136325.321140:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:3.0:1789136325.321288:0:23324:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644774528 00000100:00100000:3.0:1789136325.321306:0:23324:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644774528 00000100:00100000:3.0:1789136325.321370:0:23324:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 132 00000100:00100000:3.0:1789136325.321392:0:23324:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7fb157c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:27cf2c08-90ce-45f0-9821-89831e8ff070+11:18445:x1876044644774528:12345-192.168.201.31@tcp:503:mount.lustre.0 00000100:00100000:3.0:1789136325.321544:0:23324:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7fb157c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:27cf2c08-90ce-45f0-9821-89831e8ff070+11:18445:x1876044644774528:12345-192.168.201.31@tcp:503:mount.lustre.0 Request processed in 165us (415us total) trans 0 rc 0/0 00000100:00100000:3.0:1789136325.321552:0:23324:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 132 00000100:00100000:1.0:1789136325.349813:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:0.0:1789136325.350789:0:23327:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644774656 00000100:00100000:0.0:1789136325.350799:0:23327:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644774656 00000100:00100000:0.0:1789136325.351199:0:23327:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 133 00000100:00100000:0.0:1789136325.351211:0:23327:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7fb156450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:27cf2c08-90ce-45f0-9821-89831e8ff070+11:18453:x1876044644774656:12345-192.168.201.31@tcp:502:llog_process_th.0 00000100:00100000:0.0:1789136325.351403:0:23327:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7fb156450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:27cf2c08-90ce-45f0-9821-89831e8ff070+11:18453:x1876044644774656:12345-192.168.201.31@tcp:502:llog_process_th.0 Request processed in 193us (1599us total) trans 0 rc 0/0 00000100:00100000:0.0:1789136325.351411:0:23327:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 133 00010000:00010000:1.0:1789136325.353879:0:23321:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789136325.386263:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:2.0:1789136325.386378:0:23325:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644774784 00000100:00100000:2.0:1789136325.386388:0:23325:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644774784 00000100:00100000:2.0:1789136325.386454:0:23325:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 134 00000100:00100000:2.0:1789136325.386464:0:23325:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7fb155c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:27cf2c08-90ce-45f0-9821-89831e8ff070+11:18453:x1876044644774784:12345-192.168.201.31@tcp:502:llog_process_th.0 00000100:00100000:2.0:1789136325.386618:0:23325:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7fb155c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:27cf2c08-90ce-45f0-9821-89831e8ff070+11:18453:x1876044644774784:12345-192.168.201.31@tcp:502:llog_process_th.0 Request processed in 147us (357us total) trans 0 rc 0/0 00000100:00100000:2.0:1789136325.386626:0:23325:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 134 00000100:00100000:1.0:1789136325.397710:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:0.0:1789136325.397821:0:23327:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644774912 00000100:00100000:0.0:1789136325.397832:0:23327:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644774912 00000100:00100000:0.0:1789136325.397939:0:23327:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 135 00000100:00100000:0.0:1789136325.397950:0:23327:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7fb154050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:27cf2c08-90ce-45f0-9821-89831e8ff070+11:18453:x1876044644774912:12345-192.168.201.31@tcp:502:llog_process_th.0 00000100:00100000:0.0:1789136325.398116:0:23327:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7fb154050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:27cf2c08-90ce-45f0-9821-89831e8ff070+11:18453:x1876044644774912:12345-192.168.201.31@tcp:502:llog_process_th.0 Request processed in 166us (414us total) trans 0 rc 0/0 00000100:00100000:0.0:1789136325.398131:0:23327:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 135 00000100:00100000:1.0:1789136325.407814:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:3.0:1789136325.411389:0:23324:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644775040 00000100:00100000:3.0:1789136325.411442:0:23324:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644775040 00000100:00100000:3.0:1789136325.411520:0:23324:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 136 00000100:00100000:3.0:1789136325.411530:0:23324:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7fb155850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:27cf2c08-90ce-45f0-9821-89831e8ff070+11:18445:x1876044644775040:12345-192.168.201.31@tcp:101:mount.lustre.0 00010000:00010000:3.0:1789136325.411564:0:23324:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789136325.411582:0:23324:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90a7e1c9ee00/0x559c8745c6de4981 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xa7228e7a1ab08f7a expref: -99 pid: 23324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136325.411644:0:23324:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90a7e1c9ee00/0x559c8745c6de4981 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08f7a expref: 12 pid: 23324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136325.411656:0:23324:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90a7e1c9ee00/0x559c8745c6de4981 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08f7a expref: 12 pid: 23324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136325.411665:0:23324:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a7e1c9ee00, rc 0) 00000100:00100000:3.0:1789136325.411741:0:23324:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7fb155850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:27cf2c08-90ce-45f0-9821-89831e8ff070+12:18445:x1876044644775040:12345-192.168.201.31@tcp:101:mount.lustre.0 Request processed in 212us (3938us total) trans 0 rc 0/0 00000100:00100000:3.0:1789136325.411748:0:23324:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 136 00000100:00100000:1.0:1789136325.424553:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:2.0:1789136325.426637:0:23325:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644775168 00000100:00100000:2.0:1789136325.426652:0:23325:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644775168 00000100:00100000:2.0:1789136325.426787:0:23325:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 137 00000100:00100000:2.0:1789136325.426798:0:23325:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7fb155450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:27cf2c08-90ce-45f0-9821-89831e8ff070+12:18445:x1876044644775168:12345-192.168.201.31@tcp:256:mount.lustre.0 20000000:01000000:2.0:1789136325.426825:0:23325:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:2.0:1789136325.426897:0:23325:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:2.0:1789136325.426902:0:23325:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:2.0:1789136325.426911:0:23325:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:2.0:1789136325.426915:0:23325:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/256/255. 20000000:01000000:2.0:1789136325.426917:0:23325:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 14 00000100:00100000:3.0:1789136325.439775:0:23325:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7fb155450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:27cf2c08-90ce-45f0-9821-89831e8ff070+12:18445:x1876044644775168:12345-192.168.201.31@tcp:256:mount.lustre.0 Request processed in 12968us (15219us total) trans 0 rc 0/0 00000100:00100000:3.0:1789136325.439790:0:23325:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 137 00000100:00100000:1.0:1789136325.451308:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:0.0:1789136325.452232:0:23327:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644775296 00000100:00100000:0.0:1789136325.452247:0:23327:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644775296 00000100:00100000:3.0:1789136325.452959:0:23324:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 138 00000100:00100000:3.0:1789136325.452976:0:23324:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7fb156850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:27cf2c08-90ce-45f0-9821-89831e8ff070+12:18445:x1876044644775296:12345-192.168.201.31@tcp:101:mount.lustre.0 00010000:00010000:3.0:1789136325.453007:0:23324:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789136325.453240:0:23324:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90a7e1c9e200/0x559c8745c6de4988 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xa7228e7a1ab08f81 expref: -99 pid: 23324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136325.453324:0:23324:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90a7e1c9e200/0x559c8745c6de4988 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08f81 expref: 13 pid: 23324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136325.453339:0:23324:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90a7e1c9e200/0x559c8745c6de4988 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08f81 expref: 13 pid: 23324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136325.453369:0:23324:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a7e1c9e200, rc 0) 00000100:00100000:3.0:1789136325.453559:0:23324:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7fb156850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:27cf2c08-90ce-45f0-9821-89831e8ff070+13:18445:x1876044644775296:12345-192.168.201.31@tcp:101:mount.lustre.0 Request processed in 588us (2265us total) trans 0 rc 0/0 00000100:00100000:3.0:1789136325.453567:0:23324:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 138 00000100:00100000:1.0:1789136325.458353:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:3.0:1789136325.458624:0:23325:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644775424 00000100:00100000:3.0:1789136325.458637:0:23325:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644775424 00000100:00100000:3.0:1789136325.458716:0:23325:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 139 00000100:00100000:3.0:1789136325.458729:0:23325:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7fb156050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:27cf2c08-90ce-45f0-9821-89831e8ff070+13:18445:x1876044644775424:12345-192.168.201.31@tcp:501:mount.lustre.0 00000100:00100000:3.0:1789136325.458973:0:23325:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7fb156050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:27cf2c08-90ce-45f0-9821-89831e8ff070+13:18445:x1876044644775424:12345-192.168.201.31@tcp:501:mount.lustre.0 Request processed in 246us (635us total) trans 0 rc 0/0 00000100:00100000:3.0:1789136325.458982:0:23325:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 139 00000100:00100000:2.0:1789136325.463785:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:3.0:1789136325.464662:0:23324:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644775552 00000100:00100000:3.0:1789136325.464679:0:23324:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644775552 00000100:00100000:3.0:1789136325.464767:0:23324:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 140 00000100:00100000:3.0:1789136325.464782:0:23324:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7fb157050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:27cf2c08-90ce-45f0-9821-89831e8ff070+13:18445:x1876044644775552:12345-192.168.201.31@tcp:503:mount.lustre.0 00000100:00100000:3.0:1789136325.465069:0:23324:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7fb157050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:27cf2c08-90ce-45f0-9821-89831e8ff070+13:18445:x1876044644775552:12345-192.168.201.31@tcp:503:mount.lustre.0 Request processed in 289us (1299us total) trans 0 rc 0/0 00000100:00100000:3.0:1789136325.465078:0:23324:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 140 00000100:00100000:1.0:1789136325.473078:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:0.0:1789136325.473727:0:23327:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644775680 00000100:00100000:0.0:1789136325.473741:0:23327:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644775680 00000100:00100000:0.0:1789136325.473814:0:23327:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 141 00000100:00100000:0.0:1789136325.473827:0:23327:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7fb157850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:27cf2c08-90ce-45f0-9821-89831e8ff070+13:18456:x1876044644775680:12345-192.168.201.31@tcp:502:llog_process_th.0 00000100:00100000:0.0:1789136325.474094:0:23327:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7fb157850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:27cf2c08-90ce-45f0-9821-89831e8ff070+13:18456:x1876044644775680:12345-192.168.201.31@tcp:502:llog_process_th.0 Request processed in 268us (1030us total) trans 0 rc 0/0 00000100:00100000:0.0:1789136325.474104:0:23327:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 141 00000100:00100000:1.0:1789136325.507906:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:2.0:1789136325.510480:0:23325:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644775808 00000100:00100000:2.0:1789136325.510500:0:23325:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644775808 00000100:00100000:2.0:1789136325.510602:0:23325:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 142 00000100:00100000:2.0:1789136325.510627:0:23325:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7fb158c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:27cf2c08-90ce-45f0-9821-89831e8ff070+13:18456:x1876044644775808:12345-192.168.201.31@tcp:502:llog_process_th.0 00000100:00100000:2.0:1789136325.510894:0:23325:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7fb158c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:27cf2c08-90ce-45f0-9821-89831e8ff070+13:18456:x1876044644775808:12345-192.168.201.31@tcp:502:llog_process_th.0 Request processed in 269us (3002us total) trans 0 rc 0/0 00000100:00100000:2.0:1789136325.510904:0:23325:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 142 00000100:00100000:2.0:1789136325.525659:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:0.0:1789136325.527993:0:23332:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644775936 00000100:00100000:0.0:1789136325.528015:0:23332:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644775936 00000100:00100000:0.0:1789136325.528114:0:23332:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 16 00000100:00100000:0.0:1789136325.528123:0:23332:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c3cea580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2388:x1876044644775936:12345-192.168.201.31@tcp:38:mount.lustre.0 00010000:00080000:0.0:1789136325.528163:0:23332:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-MDT0000: connection from a4039233-0823-4bef-b733-24ab7c889e38@192.168.201.31@tcp t0 exp 0000000000000000 cur 773 last 0 00000020:00000080:0.0:1789136325.528217:0:23332:0:(genops.c:1385:class_connect()) connect: client a4039233-0823-4bef-b733-24ab7c889e38, cookie 0x559c8745c6de498f 00000004:00100000:0.0:1789136325.528251:0:23332:0:(mdt_handler.c:7302:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:0.0:1789136325.528386:0:23332:0:(import.c:65:import_set_state_nolock()) ffff90a6c3dd4800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789136325.528498:0:23332:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c3cea580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a4039233-0823-4bef-b733-24ab7c889e38+6:2388:x1876044644775936:12345-192.168.201.31@tcp:38:mount.lustre.0 Request processed in 374us (2852us total) trans 0 rc 0/0 00000100:00100000:0.0:1789136325.528508:0:23332:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 16 00000100:00100000:1.0:1789136325.549299:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:1.0:1789136325.549362:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:1.0:1789136325.549383:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:1.0:1789136325.549431:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:1.0:1789136325.549458:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:1.0:1789136325.550184:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:3.0:1789136325.550392:0:23334:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644776192 00000100:00100000:3.0:1789136325.550405:0:23334:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644776192 00000100:00100000:3.0:1789136325.550469:0:23334:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644776320 00000100:00100000:3.0:1789136325.550472:0:23334:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644776320 00000100:00100000:3.0:1789136325.550485:0:23334:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644776064 00000100:00100000:3.0:1789136325.550487:0:23334:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644776064 00000100:00100000:3.0:1789136325.550524:0:23334:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644776960 00000100:00100000:3.0:1789136325.550542:0:23334:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644776960 00000100:00100000:3.0:1789136325.550560:0:23334:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 38 00000100:00100000:3.0:1789136325.550570:0:23334:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c1099a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bb852e64-3f46-4395-9dea-0822b7213ac8+7:2389:x1876044644776192:12345-192.168.201.31@tcp:400:kworker.0 00000100:00100000:3.0:1789136325.550677:0:23334:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c1099a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bb852e64-3f46-4395-9dea-0822b7213ac8+7:2389:x1876044644776192:12345-192.168.201.31@tcp:400:kworker.0 Request processed in 108us (1393us total) trans 0 rc 0/0 00000100:00100000:3.0:1789136325.550685:0:23334:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 38 00000100:00100000:3.0:1789136325.550704:0:23334:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 39 00000100:00100000:3.0:1789136325.550711:0:23334:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c10992c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bb852e64-3f46-4395-9dea-0822b7213ac8+6:2389:x1876044644776320:12345-192.168.201.31@tcp:400:kworker.0 00000100:00100000:3.0:1789136325.550738:0:23334:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c10992c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bb852e64-3f46-4395-9dea-0822b7213ac8+6:2389:x1876044644776320:12345-192.168.201.31@tcp:400:kworker.0 Request processed in 28us (1354us total) trans 0 rc 0/0 00000100:00100000:3.0:1789136325.550744:0:23334:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 39 00000100:00100000:3.0:1789136325.550759:0:23334:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 17 00000100:00100000:3.0:1789136325.550765:0:23334:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c109bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a4039233-0823-4bef-b733-24ab7c889e38+7:0:x1876044644776064:12345-192.168.201.31@tcp:41:mount.lustre.0 00000004:00000024:3.0:1789136325.550791:0:23334:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446309888 avail 1300070400 00000100:00100000:3.0:1789136325.550828:0:23334:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c109bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a4039233-0823-4bef-b733-24ab7c889e38+7:0:x1876044644776064:12345-192.168.201.31@tcp:41:mount.lustre.0 Request processed in 63us (1369us total) trans 0 rc 0/0 00000100:00100000:3.0:1789136325.550835:0:23334:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 17 00000100:00100000:0.0:1789136325.552000:0:24846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644776448 00000100:00100000:0.0:1789136325.552013:0:24846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644776448 00000100:00100000:0.0:1789136325.552073:0:24846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644776576 00000100:00100000:0.0:1789136325.552077:0:24846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644776576 00000100:00100000:0.0:1789136325.552110:0:24846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 7 00000100:00100000:0.0:1789136325.552134:0:24846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c1098f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bb852e64-3f46-4395-9dea-0822b7213ac8+6:2389:x1876044644776448:12345-192.168.201.31@tcp:400:kworker.0 00000100:00100000:0.0:1789136325.552192:0:24846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c1098f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bb852e64-3f46-4395-9dea-0822b7213ac8+6:2389:x1876044644776448:12345-192.168.201.31@tcp:400:kworker.0 Request processed in 61us (2830us total) trans 0 rc 0/0 00000100:00100000:0.0:1789136325.552199:0:24846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 7 00000100:00100000:0.0:1789136325.552219:0:24846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 8 00000100:00100000:0.0:1789136325.552226:0:24846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c1099e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bb852e64-3f46-4395-9dea-0822b7213ac8+6:2389:x1876044644776576:12345-192.168.201.31@tcp:400:kworker.0 00000100:00100000:0.0:1789136325.552250:0:24846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c1099e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bb852e64-3f46-4395-9dea-0822b7213ac8+6:2389:x1876044644776576:12345-192.168.201.31@tcp:400:kworker.0 Request processed in 25us (2818us total) trans 0 rc 0/0 00000100:00100000:0.0:1789136325.552257:0:24846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 8 00000100:00100000:0.0:1789136325.552286:0:23332:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 18 00000100:00100000:0.0:1789136325.552295:0:23332:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7f662e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a4039233-0823-4bef-b733-24ab7c889e38+6:18445:x1876044644776960:12345-192.168.201.31@tcp:41:mount.lustre.0 00000004:00000024:0.0:1789136325.552317:0:23332:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446309888 avail 1300070400 00000100:00100000:0.0:1789136325.552350:0:23332:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7f662e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a4039233-0823-4bef-b733-24ab7c889e38+6:18445:x1876044644776960:12345-192.168.201.31@tcp:41:mount.lustre.0 Request processed in 57us (2169us total) trans 0 rc 0/0 00000100:00100000:0.0:1789136325.552357:0:23332:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 18 00000100:00080000:1.0:1789136325.553503:0:23328:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789136325.558586:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:0.0:1789136325.560602:0:23333:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644776704 00000100:00100000:0.0:1789136325.560633:0:23333:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644776704 00000100:00100000:0.0:1789136325.560715:0:23333:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 19 00000100:00100000:0.0:1789136325.560726:0:23333:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c3fe0780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2388:x1876044644776704:12345-192.168.201.31@tcp:38:mount.lustre.0 00010000:00080000:0.0:1789136325.560772:0:23333:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-MDT0001: connection from a4039233-0823-4bef-b733-24ab7c889e38@192.168.201.31@tcp t0 exp 0000000000000000 cur 773 last 0 00000020:00000080:0.0:1789136325.560825:0:23333:0:(genops.c:1385:class_connect()) connect: client a4039233-0823-4bef-b733-24ab7c889e38, cookie 0x559c8745c6de4996 00000004:00100000:0.0:1789136325.560915:0:23333:0:(mdt_handler.c:7302:mdt_connect_internal()) lustre-MDT0001: cli supports cksum type f7, return f7 00000100:00080000:0.0:1789136325.561075:0:23333:0:(import.c:65:import_set_state_nolock()) ffff90a7f0967000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789136325.573305:0:23333:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c3fe0780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a4039233-0823-4bef-b733-24ab7c889e38+6:2388:x1876044644776704:12345-192.168.201.31@tcp:38:mount.lustre.0 Request processed in 12558us (14714us total) trans 0 rc 0/0 00000100:00100000:0.0:1789136325.573351:0:23333:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 19 00000100:00100000:2.0:1789136325.576450:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:3.0:1789136325.578160:0:23332:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644777088 00000100:00100000:3.0:1789136325.578179:0:23332:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644777088 00000100:00100000:3.0:1789136325.578283:0:23332:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 20 00000100:00100000:3.0:1789136325.578297:0:23332:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c3ceb0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a4039233-0823-4bef-b733-24ab7c889e38+6:18445:x1876044644777088:12345-192.168.201.31@tcp:40:mount.lustre.0 00000100:00100000:3.0:1789136325.578450:0:23332:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c3ceb0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a4039233-0823-4bef-b733-24ab7c889e38+6:18445:x1876044644777088:12345-192.168.201.31@tcp:40:mount.lustre.0 Request processed in 156us (2028us total) trans 0 rc 0/0 00000100:00100000:3.0:1789136325.578484:0:23332:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 20 00000100:00100000:1.0:1789136325.584358:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:0.0:1789136325.584877:0:23333:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644776832 00000100:00100000:0.0:1789136325.584893:0:23333:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644776832 00000100:00080000:3.0:1789136325.585281:0:23328:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1789136325.585480:0:23333:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 21 00000100:00100000:0.0:1789136325.585493:0:23333:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c47e5680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a4039233-0823-4bef-b733-24ab7c889e38+6:0:x1876044644776832:12345-192.168.201.31@tcp:41:mount.lustre.0 00000004:00000024:0.0:1789136325.585538:0:23333:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1789136325.591340:0:23333:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c47e5680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a4039233-0823-4bef-b733-24ab7c889e38+6:0:x1876044644776832:12345-192.168.201.31@tcp:41:mount.lustre.0 Request processed in 5828us (6976us total) trans 0 rc 0/0 00000100:00100000:0.0:1789136325.591361:0:23333:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 21 00000100:00100000:1.0:1789136325.591870:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:1.0:1789136325.592182:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:1.0:1789136325.592220:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:2.0:1789136325.592280:0:24846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644777216 00000100:00100000:2.0:1789136325.592293:0:24846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644777216 00000100:00100000:2.0:1789136325.592330:0:24846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644777344 00000100:00100000:2.0:1789136325.592332:0:24846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644777344 00000100:00100000:2.0:1789136325.592351:0:24846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 21 00000100:00100000:2.0:1789136325.592359:0:24846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c47e5e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2388:x1876044644777216:12345-192.168.201.31@tcp:8:mount.lustre.0 00010000:00080000:2.0:1789136325.592420:0:24846:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-OST0000: connection from a4039233-0823-4bef-b733-24ab7c889e38@192.168.201.31@tcp t0 exp 0000000000000000 cur 773 last 0 00000020:00000080:2.0:1789136325.592471:0:24846:0:(genops.c:1385:class_connect()) connect: client a4039233-0823-4bef-b733-24ab7c889e38, cookie 0x559c8745c6de499d 00002000:00100000:2.0:1789136325.592487:0:24846:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli a4039233-0823-4bef-b733-24ab7c889e38/ffff90a6c2b9f000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 211397f ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1789136325.592500:0:24846:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:2.0:1789136325.592586:0:24846:0:(ofd_obd.c:389:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1789136325.592639:0:24846:0:(import.c:65:import_set_state_nolock()) ffff90a6c2b99800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789136325.592930:0:23344:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644777472 00000100:00100000:0.0:1789136325.592936:0:23344:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644777472 00000100:00100000:0.0:1789136325.593645:0:23344:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 4 00000100:00100000:0.0:1789136325.593665:0:23344:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c47e7c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:a4039233-0823-4bef-b733-24ab7c889e38+6:18445:x1876044644777472:12345-192.168.201.31@tcp:900:mount.lustre.0 00000100:00100000:2.0:1789136325.594366:0:24846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c47e5e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a4039233-0823-4bef-b733-24ab7c889e38+6:2388:x1876044644777216:12345-192.168.201.31@tcp:8:mount.lustre.0 Request processed in 1999us (2177us total) trans 0 rc 0/0 00000100:00100000:0.0:1789136325.594641:0:23344:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c47e7c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:a4039233-0823-4bef-b733-24ab7c889e38+6:18445:x1876044644777472:12345-192.168.201.31@tcp:900:mount.lustre.0 Request processed in 983us (2787us total) trans 0 rc 0/0 00000100:00100000:0.0:1789136325.594653:0:23344:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 4 00000100:00100000:2.0:1789136325.595404:0:24846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 21 00000100:00100000:2.0:1789136325.595453:0:24846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 22 00000100:00100000:2.0:1789136325.595461:0:24846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c47e4780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2388:x1876044644777344:12345-192.168.201.31@tcp:8:mount.lustre.0 00010000:00080000:2.0:1789136325.595503:0:24846:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-OST0001: connection from a4039233-0823-4bef-b733-24ab7c889e38@192.168.201.31@tcp t0 exp 0000000000000000 cur 773 last 0 00000020:00000080:2.0:1789136325.595561:0:24846:0:(genops.c:1385:class_connect()) connect: client a4039233-0823-4bef-b733-24ab7c889e38, cookie 0x559c8745c6de49a4 00002000:00100000:2.0:1789136325.595580:0:24846:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli a4039233-0823-4bef-b733-24ab7c889e38/ffff90a6c2b9d000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 211397f ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1789136325.595593:0:24846:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:2.0:1789136325.595681:0:24846:0:(ofd_obd.c:389:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1789136325.595723:0:24846:0:(import.c:65:import_set_state_nolock()) ffff90a6c2b98000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789136325.595794:0:24846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c47e4780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a4039233-0823-4bef-b733-24ab7c889e38+6:2388:x1876044644777344:12345-192.168.201.31@tcp:8:mount.lustre.0 Request processed in 332us (3572us total) trans 0 rc 0/0 00000100:00100000:2.0:1789136325.595802:0:24846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 22 00000100:00100000:0.0:1789136325.600416:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:2.0:1789136325.601161:0:23336:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644777600 00000100:00100000:2.0:1789136325.601175:0:23336:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644777600 00000100:00100000:2.0:1789136325.601290:0:23336:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 1 00000100:00100000:2.0:1789136325.601303:0:23336:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c3ff70c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a4039233-0823-4bef-b733-24ab7c889e38+6:18445:x1876044644777600:12345-192.168.201.31@tcp:33:mount.lustre.0 00000004:00200000:2.0:1789136325.602241:0:23336:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:2.0:1789136325.602369:0:23336:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c3ff70c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a4039233-0823-4bef-b733-24ab7c889e38+6:18445:x1876044644777600:12345-192.168.201.31@tcp:33:mount.lustre.0 Request processed in 1066us (1968us total) trans 0 rc 0/0 00000100:00100000:2.0:1789136325.602378:0:23336:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 1 00000100:00100000:0.0:1789136325.874824:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:2.0:1789136325.875057:0:23334:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644777728 00000100:00100000:2.0:1789136325.875071:0:23334:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644777728 00000100:00100000:2.0:1789136325.875160:0:23334:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 22 00000100:00100000:2.0:1789136325.875173:0:23334:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c3ff6940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a4039233-0823-4bef-b733-24ab7c889e38+6:18481:x1876044644777728:12345-192.168.201.31@tcp:101:mkdir.0 00010000:00010000:2.0:1789136325.875221:0:23334:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789136325.875255:0:23334:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c0031800/0x559c8745c6de49ab lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa7228e7a1ab08fb2 expref: -99 pid: 23334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136325.875342:0:23334:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c0031400/0x559c8745c6de49b2 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 23334 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136325.875359:0:23334:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c0031400/0x559c8745c6de49b2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 23334 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136325.875373:0:23334:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c0031400/0x559c8745c6de49b2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 23334 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789136325.875432:0:23334:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1789136325.875437:0:23334:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1789136325.875464:0:23334:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c0031400/0x559c8745c6de49b2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 23334 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136325.875497:0:23334:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c0031800/0x559c8745c6de49ab lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08fb2 expref: 8 pid: 23334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136325.875523:0:23334:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c0031400/0x559c8745c6de49b2 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08fb2 expref: 7 pid: 23334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136325.875534:0:23334:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90a7fa5c0a00) 00010000:00010000:2.0:1789136325.875536:0:23334:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789136325.875541:0:23334:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a7c0031400, rc 0) 00000100:00100000:2.0:1789136325.875636:0:23334:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c3ff6940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a4039233-0823-4bef-b733-24ab7c889e38+7:18481:x1876044644777728:12345-192.168.201.31@tcp:101:mkdir.0 Request processed in 465us (828us total) trans 0 rc 0/0 00000100:00100000:2.0:1789136325.875644:0:23334:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 22 00000100:00100000:3.0:1789136325.992712:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789136325.992747:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c47e5a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1876044666932992:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789136325.992893:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789136325.993163:0:24849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666932992 00000100:00100000:1.0:1789136325.993182:0:24849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666932992 00000100:00100000:1.0:1789136325.993266:0:24849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1789136325.993278:0:24849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7fa3be580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1876044666932992:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789136325.993310:0:24849:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3915853824 avail 3684331520 00000100:00100000:1.0:1789136325.993371:0:24849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7fa3be580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1876044666932992:12345-0@lo:13:osp-pre-0-0.0 Request processed in 95us (478us total) trans 0 rc 0/0 00000100:00100000:1.0:1789136325.993391:0:24849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1789136325.993451:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c47e5a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1876044666932992:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1789136325.993625:0:23328:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789136325.993762:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c3cebc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1876044666933120:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1789136325.993802:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789136325.993991:0:24849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666933120 00000100:00100000:1.0:1789136325.993997:0:24849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666933120 00000100:00100000:1.0:1789136325.994046:0:24849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1789136325.994054:0:24849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c3ff6d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1876044666933120:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1789136325.994069:0:24849:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3915853824 avail 3684331520 00000100:00080000:3.0:1789136325.994352:0:23328:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789136325.994654:0:24849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c3ff6d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1876044666933120:12345-0@lo:13:osp-pre-0-1.0 Request processed in 599us (849us total) trans 0 rc 0/0 00000100:00100000:1.0:1789136325.994664:0:24849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1789136325.994766:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c3cebc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1876044666933120:0@lo:13:osp-pre-0-1.0 00010000:00010000:2.0:1789136326.377246:0:23320:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789136326.504496:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789136326.504530:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7fa3bd2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1876044666933248:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1789136326.504650:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789136326.504889:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789136326.504903:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c47e5a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1876044666933376:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789136326.504940:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789136326.504996:0:24848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666933376 00000100:00100000:1.0:1789136326.505005:0:24848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666933376 00000100:00100000:1.0:1789136326.505074:0:24848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1789136326.505086:0:24848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c47e7840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1876044666933376:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789136326.505116:0:24848:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923501056 avail 3691978752 00000100:00100000:1.0:1789136326.505169:0:24848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c47e7840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1876044666933376:12345-0@lo:13:osp-pre-1-0.0 Request processed in 86us (228us total) trans 0 rc 0/0 00000100:00100000:1.0:1789136326.505177:0:24848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1789136326.505260:0:3641:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 12884901890 gen 2 00000100:00100000:1.0:1789136326.505287:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c47e5a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1876044666933376:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789136326.505706:0:23338:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666933248 00000100:00100000:3.0:1789136326.505714:0:23338:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666933248 00000100:00100000:3.0:1789136326.505750:0:23338:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1789136326.505758:0:23338:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c3cea940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3638:x1876044666933248:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1789136326.505792:0:23338:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446309888 avail 1300070400 00000100:00100000:3.0:1789136326.505885:0:23338:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c3cea940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3638:x1876044666933248:12345-0@lo:41:osp-pre-0-1.0 Request processed in 128us (1235us total) trans 0 rc 0/0 00000100:00100000:3.0:1789136326.505892:0:23338:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1789136326.505936:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7fa3bd2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1876044666933248:0@lo:41:osp-pre-0-1.0 00000100:00080000:3.0:1789136326.505959:0:23328:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789136326.506377:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c3ce8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b11da215-324d-4c8d-90a5-0b7f26186c4c:3638:1876044666933632:0@lo:400:kworker.0 00000100:00100000:0.0:1789136326.506441:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789136326.506529:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7c69ead00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1876044666933504:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1789136326.506567:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789136326.506614:0:24848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666933504 00000100:00100000:1.0:1789136326.506618:0:24848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666933504 00000100:00100000:1.0:1789136326.506663:0:24848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1789136326.506670:0:24848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c47e5a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1876044666933504:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1789136326.506687:0:24848:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923501056 avail 3691978752 00000100:00100000:1.0:1789136326.506725:0:24848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c47e5a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1876044666933504:12345-0@lo:13:osp-pre-1-1.0 Request processed in 55us (157us total) trans 0 rc 0/0 00000100:00100000:1.0:1789136326.506731:0:24848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1789136326.506766:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7c69ead00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1876044666933504:0@lo:13:osp-pre-1-1.0 00000100:00080000:1.0:1789136326.506788:0:23328:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789136326.507705:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c3ce9680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1876044666933760:0@lo:400:kworker.0 00000100:00100000:1.0:1789136326.507765:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789136326.507874:0:23339:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666933760 00000100:00100000:1.0:1789136326.507882:0:23339:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666933760 00000100:00100000:1.0:1789136326.507928:0:23339:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1789136326.507936:0:23339:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c47e6580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3639:x1876044666933760:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789136326.508005:0:23339:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c47e6580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3639:x1876044666933760:12345-0@lo:400:kworker.0 Request processed in 69us (239us total) trans 0 rc 0/0 00000100:00100000:1.0:1789136326.508014:0:23339:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1789136326.508054:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c3ce9680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1876044666933760:0@lo:400:kworker.0 00000100:00100000:3.0:1789136326.508663:0:23324:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666933632 00000100:00100000:3.0:1789136326.508669:0:23324:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666933632 00000100:00100000:3.0:1789136326.508716:0:23324:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:3.0:1789136326.508724:0:23324:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7fb158450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b11da215-324d-4c8d-90a5-0b7f26186c4c+24:3638:x1876044666933632:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789136326.508890:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789136326.508922:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7c69e8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1876044666933888:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1789136326.508962:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789136326.509027:0:24077:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666933888 00000100:00100000:1.0:1789136326.509032:0:24077:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666933888 00000100:00100000:1.0:1789136326.509063:0:24077:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1789136326.509070:0:24077:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c47e52c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3641:x1876044666933888:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1789136326.509103:0:24077:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1789136326.509143:0:24077:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c47e52c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3641:x1876044666933888:12345-0@lo:41:osp-pre-1-0.0 Request processed in 73us (180us total) trans 0 rc 0/0 00000100:00100000:1.0:1789136326.509149:0:24077:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1789136326.509204:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7c69e8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1876044666933888:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1789136326.520113:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c3cebc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3639:1876044666934272:0@lo:400:kworker.0 00000100:00100000:2.0:1789136326.520222:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789136326.520669:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c4762580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3640:1876044666934400:0@lo:400:kworker.0 00000100:00100000:1.0:1789136326.520889:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c3ce83c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3641:1876044666934016:0@lo:400:kworker.0 00000100:00100000:2.0:1789136326.521159:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:2.0:1789136326.521167:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c3ce9680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3639:1876044666934144:0@lo:400:kworker.0 00000100:00100000:2.0:1789136326.521197:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789136326.521219:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7c14b52c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3639:1876044666934656:0@lo:400:kworker.0 00000100:00100000:1.0:1789136326.521401:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789136326.521467:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789136326.521483:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7c14b6940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3641:1876044666934528:0@lo:400:kworker.0 00000100:00100000:1.0:1789136326.521509:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789136326.521550:0:23333:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666934272 00000100:00100000:1.0:1789136326.521560:0:23333:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666934272 00000100:00100000:1.0:1789136326.521634:0:23333:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666934144 00000100:00100000:1.0:1789136326.521638:0:23333:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666934144 00000100:00100000:1.0:1789136326.521655:0:23333:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666934400 00000100:00100000:1.0:1789136326.521657:0:23333:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666934400 00000100:00100000:1.0:1789136326.521670:0:23333:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666934016 00000100:00100000:1.0:1789136326.521673:0:23333:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666934016 00000100:00100000:1.0:1789136326.521683:0:23333:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666934528 00000100:00100000:1.0:1789136326.521686:0:23333:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666934528 00000100:00100000:1.0:1789136326.521706:0:23333:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1789136326.521736:0:23333:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7c14b6580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3639:x1876044666934272:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789136326.521804:0:23333:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7c14b6580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3639:x1876044666934272:12345-0@lo:400:kworker.0 Request processed in 70us (1582us total) trans 0 rc 0/0 00000100:00100000:1.0:1789136326.521812:0:23333:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1789136326.521850:0:23333:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1789136326.521882:0:23333:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7c14b7840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3639:x1876044666934144:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789136326.521909:0:23333:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7c14b7840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3639:x1876044666934144:12345-0@lo:400:kworker.0 Request processed in 53us (712us total) trans 0 rc 0/0 00000100:00100000:1.0:1789136326.521916:0:23333:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1789136326.521928:0:23333:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1789136326.521934:0:23333:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c47e4f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3640:x1876044666934400:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789136326.521968:0:23333:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c47e4f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3640:x1876044666934400:12345-0@lo:400:kworker.0 Request processed in 34us (567us total) trans 0 rc 0/0 00000100:00100000:1.0:1789136326.521987:0:23333:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1789136326.522000:0:23333:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1789136326.522006:0:23333:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c47e6d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1876044666934016:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789136326.522038:0:23333:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c47e6d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1876044666934016:12345-0@lo:400:kworker.0 Request processed in 33us (570us total) trans 0 rc 0/0 00000100:00100000:1.0:1789136326.522044:0:23333:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1789136326.522056:0:23333:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1789136326.522062:0:23333:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c47e7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3641:x1876044666934528:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789136326.522090:0:23333:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c47e7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3641:x1876044666934528:12345-0@lo:400:kworker.0 Request processed in 28us (580us total) trans 0 rc 0/0 00000100:00100000:1.0:1789136326.522096:0:23333:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00010000:00080000:1.0:1789136326.522135:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90a6c4762580 x1876044666934400/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789136342 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789136326.522163:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c4762580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3640:1876044666934400:0@lo:400:kworker.0 00000100:00100000:1.0:1789136326.522204:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c3ce83c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3641:1876044666934016:0@lo:400:kworker.0 00000100:00100000:1.0:1789136326.522217:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7c14b6940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3641:1876044666934528:0@lo:400:kworker.0 00000100:00080000:1.0:1789136326.522250:0:23328:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1789136326.522255:0:23328:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789136326.522850:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789136326.522916:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c3cebc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3639:1876044666934272:0@lo:400:kworker.0 00000100:00100000:2.0:1789136326.522942:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c3ce9680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3639:1876044666934144:0@lo:400:kworker.0 00000100:00100000:3.0:1789136326.523451:0:23324:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7fb158450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b11da215-324d-4c8d-90a5-0b7f26186c4c+24:3638:x1876044666933632:12345-0@lo:400:kworker.0 Request processed in 14722us (17004us total) trans 0 rc 0/0 00000100:00100000:3.0:1789136326.523464:0:23324:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:1.0:1789136326.523901:0:23333:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666934656 00000100:00100000:1.0:1789136326.523910:0:23333:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666934656 00000100:00100000:1.0:1789136326.524106:0:23333:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1789136326.524116:0:23333:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7c14b4f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3639:x1876044666934656:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789136326.524198:0:23333:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7c14b4f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3639:x1876044666934656:12345-0@lo:400:kworker.0 Request processed in 84us (1351us total) trans 0 rc 0/0 00000100:00100000:1.0:1789136326.524205:0:23333:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00010000:00080000:2.0:1789136326.524903:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90a7c14b52c0 x1876044666934656/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789136342 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789136326.524923:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7c14b52c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3639:1876044666934656:0@lo:400:kworker.0 00000100:00080000:2.0:1789136326.524961:0:23328:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1789136326.532955:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c3ce8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b11da215-324d-4c8d-90a5-0b7f26186c4c:3638:1876044666933632:0@lo:400:kworker.0 00010000:00010000:1.0:1789136327.402697:0:23321:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1789136327.671881:0:24094:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000001:00100000:1.0:1789136328.055331:0:25663:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of a4039233-0823-4bef-b733-24ab7c889e38 00000001:00100000:1.0:1789136328.055348:0:25663:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of bb852e64-3f46-4395-9dea-0822b7213ac8 00000001:00100000:2.0:1789136328.056327:0:23312:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of a4039233-0823-4bef-b733-24ab7c889e38 00000001:00100000:2.0:1789136328.056344:0:23312:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of bb852e64-3f46-4395-9dea-0822b7213ac8 00000001:00100000:2.0:1789136328.056371:0:24069:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of a4039233-0823-4bef-b733-24ab7c889e38 00000001:00100000:2.0:1789136328.056378:0:24069:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of bb852e64-3f46-4395-9dea-0822b7213ac8 00000001:00100000:0.0:1789136328.071412:0:24841:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of a4039233-0823-4bef-b733-24ab7c889e38 00000001:00100000:0.0:1789136328.072531:0:24841:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of bb852e64-3f46-4395-9dea-0822b7213ac8 00010000:00010000:2.0:1789136328.429968:0:23320:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789136329.451105:0:23321:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1789136329.819680:0:26220:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00010000:00010000:0.0:1789136330.478770:0:23320:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789136330.748146:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:0.0:1789136330.748205:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:0.0:1789136330.748240:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:0.0:1789136330.748279:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:0.0:1789136330.748297:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:0.0:1789136330.748316:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:0.0:1789136330.748339:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:0.0:1789136330.748357:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:0.0:1789136330.748378:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:0.0:1789136330.748409:0:23334:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644778112 00000100:00100000:0.0:1789136330.748419:0:23334:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644778112 00000100:00100000:0.0:1789136330.748472:0:23334:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644778624 00000100:00100000:0.0:1789136330.748475:0:23334:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644778624 00000100:00100000:0.0:1789136330.748488:0:23334:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644777984 00000100:00100000:0.0:1789136330.748491:0:23334:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644777984 00000100:00100000:0.0:1789136330.748504:0:23334:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644778496 00000100:00100000:0.0:1789136330.748506:0:23334:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644778496 00000100:00100000:0.0:1789136330.748538:0:23334:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 46 00000100:00100000:0.0:1789136330.748547:0:23334:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c3ff7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bb852e64-3f46-4395-9dea-0822b7213ac8+5:2390:x1876044644778112:12345-192.168.201.31@tcp:400:kworker.0 00000100:00100000:0.0:1789136330.748625:0:23334:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c3ff7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bb852e64-3f46-4395-9dea-0822b7213ac8+5:2390:x1876044644778112:12345-192.168.201.31@tcp:400:kworker.0 Request processed in 78us (418us total) trans 0 rc 0/0 00000100:00100000:0.0:1789136330.748632:0:23334:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 46 00000100:00100000:0.0:1789136330.748649:0:23334:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 47 00000100:00100000:0.0:1789136330.748656:0:23334:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c3ff4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a4039233-0823-4bef-b733-24ab7c889e38+5:2390:x1876044644778624:12345-192.168.201.31@tcp:400:kworker.0 00000100:00100000:0.0:1789136330.748700:0:23334:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c3ff4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a4039233-0823-4bef-b733-24ab7c889e38+5:2390:x1876044644778624:12345-192.168.201.31@tcp:400:kworker.0 Request processed in 45us (421us total) trans 0 rc 0/0 00000100:00100000:0.0:1789136330.748707:0:23334:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 47 00000100:00100000:0.0:1789136330.748720:0:23334:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 48 00000100:00100000:0.0:1789136330.748726:0:23334:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c3ff5a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bb852e64-3f46-4395-9dea-0822b7213ac8+6:2390:x1876044644777984:12345-192.168.201.31@tcp:400:kworker.0 00000100:00100000:0.0:1789136330.748751:0:23334:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c3ff5a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bb852e64-3f46-4395-9dea-0822b7213ac8+6:2390:x1876044644777984:12345-192.168.201.31@tcp:400:kworker.0 Request processed in 25us (433us total) trans 0 rc 0/0 00000100:00100000:0.0:1789136330.748756:0:23334:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 48 00000100:00100000:0.0:1789136330.748768:0:23334:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 49 00000100:00100000:0.0:1789136330.748773:0:23334:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c3ff61c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a4039233-0823-4bef-b733-24ab7c889e38+6:2390:x1876044644778496:12345-192.168.201.31@tcp:400:kworker.0 00000100:00100000:0.0:1789136330.748812:0:23334:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c3ff61c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a4039233-0823-4bef-b733-24ab7c889e38+6:2390:x1876044644778496:12345-192.168.201.31@tcp:400:kworker.0 Request processed in 39us (455us total) trans 0 rc 0/0 00000100:00100000:0.0:1789136330.748820:0:23334:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 49 00000100:00100000:0.0:1789136330.748839:0:24847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644778368 00000100:00100000:0.0:1789136330.748843:0:24847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644778368 00000100:00100000:0.0:1789136330.748898:0:24847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644778880 00000100:00100000:0.0:1789136330.748901:0:24847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644778880 00000100:00100000:0.0:1789136330.748912:0:24847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644778240 00000100:00100000:0.0:1789136330.748914:0:24847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644778240 00000100:00100000:0.0:1789136330.748927:0:24847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644778752 00000100:00100000:0.0:1789136330.748929:0:24847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644778752 00000100:00100000:0.0:1789136330.748941:0:24847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 9 00000100:00100000:0.0:1789136330.748948:0:24847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c3ff5680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:bb852e64-3f46-4395-9dea-0822b7213ac8+5:2390:x1876044644778368:12345-192.168.201.31@tcp:400:kworker.0 00000100:00100000:0.0:1789136330.748974:0:24847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c3ff5680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:bb852e64-3f46-4395-9dea-0822b7213ac8+5:2390:x1876044644778368:12345-192.168.201.31@tcp:400:kworker.0 Request processed in 27us (733us total) trans 0 rc 0/0 00000100:00100000:0.0:1789136330.748989:0:24847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 9 00000100:00100000:0.0:1789136330.749000:0:24847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 10 00000100:00100000:0.0:1789136330.749006:0:24847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c3ff5e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a4039233-0823-4bef-b733-24ab7c889e38+5:2390:x1876044644778880:12345-192.168.201.31@tcp:400:kworker.0 00000100:00100000:0.0:1789136330.749031:0:24847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c3ff5e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a4039233-0823-4bef-b733-24ab7c889e38+5:2390:x1876044644778880:12345-192.168.201.31@tcp:400:kworker.0 Request processed in 25us (733us total) trans 0 rc 0/0 00000100:00100000:0.0:1789136330.749037:0:24847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 10 00000100:00100000:0.0:1789136330.749047:0:24847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 11 00000100:00100000:0.0:1789136330.749053:0:24847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c3ff4f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:bb852e64-3f46-4395-9dea-0822b7213ac8+5:2390:x1876044644778240:12345-192.168.201.31@tcp:400:kworker.0 00000100:00100000:0.0:1789136330.749072:0:24847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c3ff4f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:bb852e64-3f46-4395-9dea-0822b7213ac8+5:2390:x1876044644778240:12345-192.168.201.31@tcp:400:kworker.0 Request processed in 20us (733us total) trans 0 rc 0/0 00000100:00100000:0.0:1789136330.749077:0:24847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 11 00000100:00100000:0.0:1789136330.749085:0:24847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 12 00000100:00100000:0.0:1789136330.749090:0:24847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c3ff4780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a4039233-0823-4bef-b733-24ab7c889e38+5:2390:x1876044644778752:12345-192.168.201.31@tcp:400:kworker.0 00000100:00100000:0.0:1789136330.749106:0:24847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c3ff4780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a4039233-0823-4bef-b733-24ab7c889e38+5:2390:x1876044644778752:12345-192.168.201.31@tcp:400:kworker.0 Request processed in 16us (729us total) trans 0 rc 0/0 00000100:00100000:0.0:1789136330.749112:0:24847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 12 00000100:00100000:2.0:1789136330.754430:0:23325:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644777856 00000100:00100000:2.0:1789136330.754447:0:23325:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644777856 00000100:00100000:2.0:1789136330.754530:0:23325:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 144 00000100:00100000:2.0:1789136330.754558:0:23325:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7fb15b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:27cf2c08-90ce-45f0-9821-89831e8ff070+13:2390:x1876044644777856:12345-192.168.201.31@tcp:400:kworker.0 00000100:00080000:1.0:1789136330.754623:0:23328:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789136330.754631:0:23328:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789136330.754635:0:23328:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789136330.754639:0:23328:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1789136330.754665:0:23325:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7fb15b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:27cf2c08-90ce-45f0-9821-89831e8ff070+13:2390:x1876044644777856:12345-192.168.201.31@tcp:400:kworker.0 Request processed in 110us (6528us total) trans 0 rc 0/0 00000100:00100000:2.0:1789136330.754674:0:23325:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 144 00000100:00100000:2.0:1789136331.112430:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7c69e8780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1876044666934784:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789136331.112548:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789136331.112812:0:24848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666934784 00000100:00100000:1.0:1789136331.112821:0:24848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666934784 00000100:00080000:2.0:1789136331.112950:0:23328:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789136331.113758:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789136331.113773:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7c14b6d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1876044666934912:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1789136331.113832:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789136331.114257:0:24849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666934912 00000100:00100000:2.0:1789136331.114263:0:24849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666934912 00000100:00100000:2.0:1789136331.114315:0:24849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1789136331.114324:0:24849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c47e61c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1876044666934912:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1789136331.114353:0:24849:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3915853824 avail 3684331520 00000100:00100000:2.0:1789136331.114410:0:24849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c47e61c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1876044666934912:12345-0@lo:13:osp-pre-0-1.0 Request processed in 86us (576us total) trans 0 rc 0/0 00000100:00100000:2.0:1789136331.114418:0:24849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00080000:1.0:1789136331.114466:0:23328:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789136331.114526:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7c14b6d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1876044666934912:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1789136331.116322:0:24848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1789136331.116341:0:24848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7c14b52c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3639:x1876044666934784:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789136331.116378:0:24848:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3915853824 avail 3684331520 00000100:00100000:3.0:1789136331.116455:0:24848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7c14b52c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3639:x1876044666934784:12345-0@lo:13:osp-pre-0-0.0 Request processed in 122us (3907us total) trans 0 rc 0/0 00000100:00100000:3.0:1789136331.116463:0:24848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1789136331.117838:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7c69e8780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1876044666934784:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1789136331.497023:0:23321:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789136331.624740:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c3ff4b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1876044666935040:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1789136331.624818:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789136331.624922:0:23338:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666935040 00000100:00100000:0.0:1789136331.624930:0:23338:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666935040 00000100:00100000:0.0:1789136331.624985:0:23338:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1789136331.624994:0:23338:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c3d90f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3641:x1876044666935040:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1789136331.625029:0:23338:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446309888 avail 1300070400 00000100:00100000:0.0:1789136331.625077:0:23338:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c3d90f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3641:x1876044666935040:12345-0@lo:41:osp-pre-0-1.0 Request processed in 84us (259us total) trans 0 rc 0/0 00000100:00100000:0.0:1789136331.625084:0:23338:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1789136331.625132:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c3ff4b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1876044666935040:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1789136331.628299:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7c14b6d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b11da215-324d-4c8d-90a5-0b7f26186c4c:3638:1876044666935168:0@lo:400:kworker.0 00000100:00100000:0.0:1789136331.628377:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789136331.628437:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7fe5ec000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1876044666935680:0@lo:400:kworker.0 00000100:00100000:0.0:1789136331.628464:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789136331.628483:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7fe5ede00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3638:1876044666936192:0@lo:400:kworker.0 00000100:00100000:0.0:1789136331.628515:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789136331.628541:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:0.0:1789136331.628549:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7c14b6940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1876044666935296:0@lo:400:kworker.0 00000100:00100000:0.0:1789136331.628573:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789136331.628591:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7fe5ecb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3638:1876044666935808:0@lo:400:kworker.0 00000100:00100000:0.0:1789136331.628613:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789136331.628630:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7fe5ee940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3638:1876044666936320:0@lo:400:kworker.0 00000100:00100000:0.0:1789136331.628649:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789136331.628684:0:23324:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666935168 00000100:00100000:0.0:1789136331.628691:0:23324:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666935168 00000100:00100000:0.0:1789136331.628735:0:23324:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:0.0:1789136331.628744:0:23324:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7fb158850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b11da215-324d-4c8d-90a5-0b7f26186c4c+24:3638:x1876044666935168:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789136331.628795:0:23324:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7fb158850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b11da215-324d-4c8d-90a5-0b7f26186c4c+24:3638:x1876044666935168:12345-0@lo:400:kworker.0 Request processed in 51us (417us total) trans 0 rc 0/0 00000100:00100000:0.0:1789136331.628810:0:23324:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:0.0:1789136331.628844:0:24847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666935680 00000100:00100000:0.0:1789136331.628848:0:24847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666935680 00000100:00100000:0.0:1789136331.628896:0:24847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1789136331.628903:0:24847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c3d93c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3638:x1876044666935680:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789136331.628935:0:24847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c3d93c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3638:x1876044666935680:12345-0@lo:400:kworker.0 Request processed in 33us (470us total) trans 0 rc 0/0 00000100:00100000:0.0:1789136331.628942:0:24847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1789136331.628959:0:23334:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666936192 00000100:00100000:0.0:1789136331.628963:0:23334:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666936192 00000100:00100000:0.0:1789136331.628981:0:23334:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666935808 00000100:00100000:0.0:1789136331.628984:0:23334:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666935808 00000100:00100000:0.0:1789136331.628993:0:23334:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666936320 00000100:00100000:0.0:1789136331.628996:0:23334:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666936320 00000100:00100000:0.0:1789136331.629007:0:23334:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1789136331.629013:0:23334:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c3d912c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3638:x1876044666936192:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789136331.629044:0:23334:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c3d912c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3638:x1876044666936192:12345-0@lo:400:kworker.0 Request processed in 31us (528us total) trans 0 rc 0/0 00000100:00100000:0.0:1789136331.629051:0:23334:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1789136331.629063:0:23334:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1789136331.629068:0:23334:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c3d930c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3638:x1876044666935808:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789136331.629093:0:23334:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c3d930c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3638:x1876044666935808:12345-0@lo:400:kworker.0 Request processed in 25us (479us total) trans 0 rc 0/0 00000100:00100000:0.0:1789136331.629098:0:23334:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1789136331.629109:0:23334:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1789136331.629115:0:23334:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c3d91e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3638:x1876044666936320:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789136331.629238:0:23334:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c3d91e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3638:x1876044666936320:12345-0@lo:400:kworker.0 Request processed in 41us (506us total) trans 0 rc 0/0 00000100:00100000:0.0:1789136331.629248:0:23334:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1789136331.629271:0:23339:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666935296 00000100:00100000:0.0:1789136331.629275:0:23339:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666935296 00000100:00100000:0.0:1789136331.629299:0:23339:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1789136331.629305:0:23339:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c3d903c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3638:x1876044666935296:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789136331.629337:0:23339:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c3d903c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3638:x1876044666935296:12345-0@lo:400:kworker.0 Request processed in 32us (762us total) trans 0 rc 0/0 00000100:00100000:0.0:1789136331.629343:0:23339:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00080000:0.0:1789136331.629366:0:23328:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1789136331.629370:0:23328:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789136331.629372:0:23328:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789136331.629387:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7fe5ee580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1876044666935424:0@lo:400:kworker.0 00000100:00100000:0.0:1789136331.629413:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789136331.629435:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7fe5ed680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3640:1876044666935936:0@lo:400:kworker.0 00000100:00100000:0.0:1789136331.629456:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789136331.629475:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1789136331.629482:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7fe5ed2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3640:1876044666935552:0@lo:400:kworker.0 00000100:00100000:0.0:1789136331.629514:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789136331.629532:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7fe5eed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3640:1876044666936064:0@lo:400:kworker.0 00000100:00100000:0.0:1789136331.629555:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789136331.629579:0:24845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666935424 00000100:00100000:0.0:1789136331.629583:0:24845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666935424 00000100:00100000:0.0:1789136331.629612:0:24845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1789136331.629618:0:24845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c3d91680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3640:x1876044666935424:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789136331.629655:0:24845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c3d91680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3640:x1876044666935424:12345-0@lo:400:kworker.0 Request processed in 38us (241us total) trans 0 rc 0/0 00000100:00100000:0.0:1789136331.629661:0:24845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1789136331.629680:0:23333:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666935936 00000100:00100000:0.0:1789136331.629682:0:23333:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666935936 00000100:00100000:0.0:1789136331.629696:0:23333:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666935552 00000100:00100000:0.0:1789136331.629698:0:23333:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666935552 00000100:00100000:0.0:1789136331.629706:0:23333:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666936064 00000100:00100000:0.0:1789136331.629708:0:23333:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666936064 00000100:00100000:0.0:1789136331.629718:0:23333:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1789136331.629723:0:23333:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c3d93480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3640:x1876044666935936:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789136331.629748:0:23333:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c3d93480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3640:x1876044666935936:12345-0@lo:400:kworker.0 Request processed in 24us (291us total) trans 0 rc 0/0 00000100:00100000:0.0:1789136331.629753:0:23333:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1789136331.629762:0:23333:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1789136331.629767:0:23333:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c3ff4b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1876044666935552:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789136331.629785:0:23333:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c3ff4b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1876044666935552:12345-0@lo:400:kworker.0 Request processed in 18us (271us total) trans 0 rc 0/0 00000100:00100000:0.0:1789136331.629790:0:23333:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1789136331.629798:0:23333:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1789136331.629803:0:23333:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7d55acf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3640:x1876044666936064:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789136331.629821:0:23333:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7d55acf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3640:x1876044666936064:12345-0@lo:400:kworker.0 Request processed in 18us (265us total) trans 0 rc 0/0 00000100:00100000:0.0:1789136331.629826:0:23333:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00080000:0.0:1789136331.629837:0:23328:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1789136331.629839:0:23328:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789136331.629840:0:23328:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789136331.629891:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7fe5ed2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3640:1876044666935552:0@lo:400:kworker.0 00010000:00080000:0.0:1789136331.629905:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90a7fe5eed00 x1876044666936064/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789136347 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789136331.629915:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7fe5eed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3640:1876044666936064:0@lo:400:kworker.0 00000100:00100000:0.0:1789136331.629923:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7fe5ee580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1876044666935424:0@lo:400:kworker.0 00000100:00100000:0.0:1789136331.629930:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7fe5ed680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3640:1876044666935936:0@lo:400:kworker.0 00000100:00100000:0.0:1789136331.629967:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7c14b6940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1876044666935296:0@lo:400:kworker.0 00000100:00100000:0.0:1789136331.629976:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7fe5ecb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3638:1876044666935808:0@lo:400:kworker.0 00010000:00080000:0.0:1789136331.629985:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90a7fe5ee940 x1876044666936320/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789136347 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789136331.629993:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7fe5ee940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3638:1876044666936320:0@lo:400:kworker.0 00000100:00100000:0.0:1789136331.630001:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7c14b6d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b11da215-324d-4c8d-90a5-0b7f26186c4c:3638:1876044666935168:0@lo:400:kworker.0 00000100:00100000:0.0:1789136331.630009:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7fe5ec000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1876044666935680:0@lo:400:kworker.0 00000100:00100000:0.0:1789136331.630018:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7fe5ede00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3638:1876044666936192:0@lo:400:kworker.0 00000100:00100000:3.0:1789136331.631944:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789136331.631965:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7c69e92c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1876044666936704:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1789136331.632030:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789136331.632069:0:24848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666936704 00000100:00100000:3.0:1789136331.632076:0:24848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666936704 00000100:00100000:3.0:1789136331.632122:0:24848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1789136331.632130:0:24848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7c69ea1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1876044666936704:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1789136331.632435:0:24848:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923501056 avail 3691978752 00000100:00100000:3.0:1789136331.632487:0:24848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7c69ea1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1876044666936704:12345-0@lo:13:osp-pre-1-1.0 Request processed in 357us (456us total) trans 0 rc 0/0 00000100:00100000:3.0:1789136331.632495:0:24848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1789136331.632558:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7c69e92c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1876044666936704:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1789136331.632666:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7fe5ecf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1876044666936576:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1789136331.632698:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789136331.632728:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789136331.632744:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c47e43c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1876044666936448:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789136331.632782:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789136331.633228:0:24077:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666936576 00000100:00100000:3.0:1789136331.633235:0:24077:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666936576 00000100:00100000:3.0:1789136331.633272:0:24077:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1789136331.633280:0:24077:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7d55aed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3641:x1876044666936576:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1789136331.633310:0:24077:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:3.0:1789136331.633354:0:24077:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7d55aed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3641:x1876044666936576:12345-0@lo:41:osp-pre-1-0.0 Request processed in 75us (654us total) trans 0 rc 0/0 00000100:00100000:3.0:1789136331.633360:0:24077:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1789136331.633380:0:24848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666936448 00000100:00100000:3.0:1789136331.633383:0:24848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666936448 00000100:00100000:3.0:1789136331.633415:0:24848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1789136331.633421:0:24848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7d55af480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1876044666936448:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789136331.633432:0:24848:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923501056 avail 3691978752 00000100:00100000:3.0:1789136331.633460:0:24848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7d55af480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1876044666936448:12345-0@lo:13:osp-pre-1-0.0 Request processed in 40us (678us total) trans 0 rc 0/0 00000100:00100000:3.0:1789136331.633466:0:24848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1789136331.633511:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c47e43c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1876044666936448:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789136331.633526:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7fe5ecf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1876044666936576:0@lo:41:osp-pre-1-0.0 00000040:00080000:2.0:1789136332.136498:0:23370:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1789136332.520123:0:23320:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789136333.555077:0:23321:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1789136334.156076:0:26368:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffcca9d22d0 20000000:00000080:3.0:1789136334.156100:0:26368:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff90a7f028a800 uarg=0000000000000000 20000000:01000000:3.0:1789136334.156145:0:26368:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:3.0:1789136334.156151:0:26368:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:3.0:1789136334.156156:0:26368:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:1.0:1789136334.157265:0:26369:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 19 20000000:00000400:3.0:1789136334.157401:0:26368:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:3.0:1789136334.171888:0:26368:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:2.0:1789136334.174481:0:26368:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff90a7c0031000/0x559c8745c6de49b9 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136334.174506:0:26368:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90a7e1c9fe00/0x559c8745c6de4616 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x559c8745c6de460f expref: 23 pid: 23324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136334.174514:0:26368:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90a6c3cafa00/0x559c8745c6de4624 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x559c8745c6de461d expref: 23 pid: 23327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136334.174520:0:26368:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90a6c3caf400/0x559c8745c6de4663 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x559c8745c6de465c expref: 23 pid: 23325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136334.174547:0:26368:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90a7c0030a00/0x559c8745c6de47dd lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x559c8745c6de47d6 expref: 23 pid: 23327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136334.174558:0:26368:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90a6c3cae400/0x559c8745c6de4949 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08f11 expref: 12 pid: 23327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136334.174568:0:26368:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90a7e1c9e200/0x559c8745c6de4988 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08f81 expref: 12 pid: 23324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136334.174577:0:26368:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff90a7c0031000/0x559c8745c6de49b9 lrc: 9/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 26368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136334.174640:0:26368:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90a7e1c9e200/0x559c8745c6de4988 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08f81 expref: 12 pid: 23324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136334.174657:0:26368:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff90a7e1c9e200/0x559c8745c6de4988 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08f81 expref: 12 pid: 23324 timeout: 882 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789136334.174673:0:26368:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7fe5eda40 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:26368:1876044666936832:192.168.201.31@tcp:104: 00010000:00010000:2.0:1789136334.174778:0:26368:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90a6c3cae400/0x559c8745c6de4949 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08f11 expref: 12 pid: 23327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136334.174786:0:26368:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff90a6c3cae400/0x559c8745c6de4949 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08f11 expref: 12 pid: 23327 timeout: 882 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789136334.174795:0:26368:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7fe5ec780 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:26368:1876044666936960:192.168.201.31@tcp:104: 00010000:00010000:2.0:1789136334.174822:0:26368:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90a7c0030a00/0x559c8745c6de47dd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x559c8745c6de47d6 expref: 23 pid: 23327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136334.174842:0:26368:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff90a7c0030a00/0x559c8745c6de47dd lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x559c8745c6de47d6 expref: 23 pid: 23327 timeout: 882 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789136334.174923:0:26368:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7fe5efc00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:26368:1876044666937088:0@lo:104: 00000100:00100000:2.0:1789136334.174967:0:26368:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789136334.175007:0:23315:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666937088 00000100:00100000:1.0:1789136334.175014:0:23315:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666937088 00010000:00010000:2.0:1789136334.175015:0:26368:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90a6c3caf400/0x559c8745c6de4663 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x559c8745c6de465c expref: 23 pid: 23325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136334.175022:0:26368:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff90a6c3caf400/0x559c8745c6de4663 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x559c8745c6de465c expref: 23 pid: 23325 timeout: 882 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789136334.175030:0:26368:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7fe5ec3c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:26368:1876044666937216:0@lo:104: 00000100:00100000:2.0:1789136334.175051:0:26368:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1789136334.176287:0:26368:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90a6c3cafa00/0x559c8745c6de4624 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x559c8745c6de461d expref: 23 pid: 23327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136334.176300:0:26368:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff90a6c3cafa00/0x559c8745c6de4624 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x559c8745c6de461d expref: 23 pid: 23327 timeout: 882 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789136334.176314:0:26368:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7fe5ef840 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:26368:1876044666937344:0@lo:104: 00000100:00100000:2.0:1789136334.176348:0:26368:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789136334.178054:0:23315:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666937216 00000100:00100000:1.0:1789136334.178069:0:23315:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666937216 00000100:00100000:1.0:1789136334.178128:0:23315:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1789136334.178139:0:23315:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7fe5ee1c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:b11da215-324d-4c8d-90a5-0b7f26186c4c+4:26368:x1876044666937088:12345-0@lo:104: 00010000:00010000:1.0:1789136334.178158:0:23315:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.131@tcp lock: ffff90a7e1c9fc00/0x559c8745c6de47d6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x559c8745c6de47dd expref: -99 pid: 25662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136334.178236:0:23315:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1789136334.178243:0:23315:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7fe5ee1c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:b11da215-324d-4c8d-90a5-0b7f26186c4c+4:26368:x1876044666937088:12345-0@lo:104: Request processed in 107us (3276us total) trans 0 rc 0/0 00000100:00100000:1.0:1789136334.178250:0:23315:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1789136334.178271:0:23315:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1789136334.178277:0:23315:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7fe5ef480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:b11da215-324d-4c8d-90a5-0b7f26186c4c+3:26368:x1876044666937216:12345-0@lo:104: 00010000:00010000:1.0:1789136334.178285:0:23315:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.131@tcp lock: ffff90a7c167ce00/0x559c8745c6de465c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x559c8745c6de4663 expref: -99 pid: 24840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136334.178318:0:23315:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1789136334.178323:0:23315:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7fe5ef480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:b11da215-324d-4c8d-90a5-0b7f26186c4c+3:26368:x1876044666937216:12345-0@lo:104: Request processed in 47us (3272us total) trans 0 rc 0/0 00000100:00100000:1.0:1789136334.178701:0:23315:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00010000:0.0:1789136334.181399:0:23320:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1789136334.181414:0:23320:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.131@tcp lock: ffff90a7e1c9fc00/0x559c8745c6de47d6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x559c8745c6de47dd expref: -99 pid: 25662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136334.181425:0:23320:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a7e1c9fc00 already unused, calling callback (ffffffffc13bbc20) 10000000:00010000:0.0:1789136334.181430:0:23320:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.131@tcp lock: ffff90a7e1c9fc00/0x559c8745c6de47d6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x559c8745c6de47dd expref: -99 pid: 25662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136334.181440:0:23320:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.131@tcp lock: ffff90a7e1c9fc00/0x559c8745c6de47d6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x559c8745c6de47dd expref: -99 pid: 25662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789136334.181447:0:23320:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.131@tcp lock: ffff90a7e1c9fc00/0x559c8745c6de47d6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x559c8745c6de47dd expref: -99 pid: 25662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789136334.181461:0:23320:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1789136334.181515:0:23320:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.131@tcp lock: ffff90a7e1c9fc00/0x559c8745c6de47d6 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x559c8745c6de47dd expref: -99 pid: 25662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136334.181522:0:23320:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789136334.181552:0:23320:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.131@tcp lock: ffff90a7e1c9fc00/0x559c8745c6de47d6 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x559c8745c6de47dd expref: -99 pid: 25662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136334.181560:0:23320:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.131@tcp lock: ffff90a7e1c9fc00/0x559c8745c6de47d6 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x559c8745c6de47dd expref: -99 pid: 25662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136334.181577:0:23320:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789136334.181580:0:23320:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.131@tcp lock: ffff90a7c167ce00/0x559c8745c6de465c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x559c8745c6de4663 expref: -99 pid: 24840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136334.181586:0:23320:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a7c167ce00 already unused, calling callback (ffffffffc13bbc20) 10000000:00010000:0.0:1789136334.181589:0:23320:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.131@tcp lock: ffff90a7c167ce00/0x559c8745c6de465c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x559c8745c6de4663 expref: -99 pid: 24840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136334.181609:0:23320:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.131@tcp lock: ffff90a7c167ce00/0x559c8745c6de465c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x559c8745c6de4663 expref: -99 pid: 24840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789136334.181626:0:23320:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.131@tcp lock: ffff90a7c167ce00/0x559c8745c6de465c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x559c8745c6de4663 expref: -99 pid: 24840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789136334.181631:0:23320:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1789136334.181643:0:23320:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.131@tcp lock: ffff90a7c167ce00/0x559c8745c6de465c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x559c8745c6de4663 expref: -99 pid: 24840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136334.181649:0:23320:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789136334.181662:0:23320:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.131@tcp lock: ffff90a7c167ce00/0x559c8745c6de465c lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x559c8745c6de4663 expref: -99 pid: 24840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136334.181668:0:23320:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.131@tcp lock: ffff90a7c167ce00/0x559c8745c6de465c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x559c8745c6de4663 expref: -99 pid: 24840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136334.181677:0:23320:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789136334.181678:0:23320:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789136334.181680:0:23320:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789136334.181807:0:23321:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789136334.181817:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789136334.181839:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7d55ac3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b11da215-324d-4c8d-90a5-0b7f26186c4c:3638:1876044666937472:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789136334.181944:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789136334.182002:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7d55ac000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b11da215-324d-4c8d-90a5-0b7f26186c4c:3640:1876044666937600:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789136334.182025:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789136334.182050:0:23317:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666937472 00000100:00100000:0.0:1789136334.182053:0:23318:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666937600 00000100:00100000:1.0:1789136334.182058:0:23317:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666937472 00000100:00100000:0.0:1789136334.182058:0:23318:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666937600 00010000:00010000:1.0:1789136334.182083:0:23317:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90a7c0030a00/0x559c8745c6de47dd lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x559c8745c6de47d6 expref: 25 pid: 23327 timeout: 882 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136334.182086:0:23318:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90a6c3caf400/0x559c8745c6de4663 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x559c8745c6de465c expref: 25 pid: 23325 timeout: 882 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136334.182329:0:26368:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90a7e1c9fe00/0x559c8745c6de4616 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x559c8745c6de460f expref: 25 pid: 23324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136334.182343:0:26368:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff90a7e1c9fe00/0x559c8745c6de4616 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x559c8745c6de460f expref: 25 pid: 23324 timeout: 882 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789136334.182354:0:26368:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7fe5ede00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:26368:1876044666937728:0@lo:104: 00000100:00100000:2.0:1789136334.182388:0:26368:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789136334.182399:0:26368:0:(client.c:2715:ptlrpc_set_wait()) set ffff90a7f6886840 going to sleep for 11 seconds 00000100:00100000:2.0:1789136334.182419:0:26368:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7fe5efc00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:26368:1876044666937088:0@lo:104: 00000100:00100000:2.0:1789136334.182427:0:26368:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7fe5ec3c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:26368:1876044666937216:0@lo:104: 00000100:00100000:3.0:1789136334.182749:0:23316:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666937344 00000100:00100000:3.0:1789136334.182754:0:23316:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666937344 00000100:00100000:3.0:1789136334.182803:0:23316:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666937728 00000100:00100000:3.0:1789136334.182806:0:23316:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666937728 00000100:00100000:3.0:1789136334.182819:0:23316:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1789136334.182827:0:23316:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7fe5ecf00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:b11da215-324d-4c8d-90a5-0b7f26186c4c+4:26368:x1876044666937344:12345-0@lo:104: 00010000:00010000:3.0:1789136334.182839:0:23316:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.131@tcp lock: ffff90a7d1878e00/0x559c8745c6de461d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x559c8745c6de4624 expref: -99 pid: 23329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136334.183081:0:23316:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1789136334.183088:0:23316:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7fe5ecf00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:b11da215-324d-4c8d-90a5-0b7f26186c4c+4:26368:x1876044666937344:12345-0@lo:104: Request processed in 261us (6739us total) trans 0 rc 0/0 00000100:00100000:3.0:1789136334.183095:0:23316:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1789136334.183120:0:23316:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1789136334.183126:0:23316:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7fe5ec000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:b11da215-324d-4c8d-90a5-0b7f26186c4c+3:26368:x1876044666937728:12345-0@lo:104: 00010000:00010000:3.0:1789136334.183134:0:23316:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.131@tcp lock: ffff90a7c167d600/0x559c8745c6de460f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x559c8745c6de4616 expref: -99 pid: 23329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136334.183168:0:23316:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1789136334.183173:0:23316:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7fe5ec000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:b11da215-324d-4c8d-90a5-0b7f26186c4c+3:26368:x1876044666937728:12345-0@lo:104: Request processed in 47us (785us total) trans 0 rc 0/0 00000100:00100000:3.0:1789136334.183178:0:23316:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1789136334.183261:0:26368:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7fe5ef840 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:26368:1876044666937344:0@lo:104: 00000100:00100000:1.0:1789136334.183261:0:23317:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1789136334.183268:0:26368:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7fe5ede00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:26368:1876044666937728:0@lo:104: 00000100:00100000:1.0:1789136334.183269:0:23317:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7c14b6940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b11da215-324d-4c8d-90a5-0b7f26186c4c+25:3640:x1876044666937600:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789136334.183281:0:23317:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789136334.183287:0:23317:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90a6c3caf400/0x559c8745c6de4663 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x559c8745c6de465c expref: 25 pid: 23325 timeout: 882 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136334.183297:0:23317:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90a6c3caf400/0x559c8745c6de4663 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x559c8745c6de465c expref: 25 pid: 23325 timeout: 882 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136334.183314:0:23317:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90a6c3caf400/0x559c8745c6de4663 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x559c8745c6de465c expref: 25 pid: 23325 timeout: 882 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136334.183395:0:23317:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789136334.183441:0:23317:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7c14b6940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b11da215-324d-4c8d-90a5-0b7f26186c4c+24:3640:x1876044666937600:12345-0@lo:103:ldlm_bl.0 Request processed in 173us (1414us total) trans 0 rc 0/0 00000100:00100000:1.0:1789136334.183448:0:23317:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1789136334.183474:0:23317:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1789136334.183480:0:23317:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7c14b6d00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b11da215-324d-4c8d-90a5-0b7f26186c4c+23:3638:x1876044666937472:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789136334.183488:0:23317:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789136334.183493:0:23317:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90a7c0030a00/0x559c8745c6de47dd lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x559c8745c6de47d6 expref: 23 pid: 23327 timeout: 882 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136334.183500:0:23317:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90a7c0030a00/0x559c8745c6de47dd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x559c8745c6de47d6 expref: 23 pid: 23327 timeout: 882 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136334.183510:0:23317:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90a7c0030a00/0x559c8745c6de47dd lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x559c8745c6de47d6 expref: 23 pid: 23327 timeout: 882 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136334.183529:0:23317:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789136334.183561:0:23317:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7c14b6d00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b11da215-324d-4c8d-90a5-0b7f26186c4c+22:3638:x1876044666937472:12345-0@lo:103:ldlm_bl.0 Request processed in 81us (1618us total) trans 0 rc 0/0 00000100:00100000:1.0:1789136334.183567:0:23317:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1789136334.183578:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7d55ac3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b11da215-324d-4c8d-90a5-0b7f26186c4c:3638:1876044666937472:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789136334.183635:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7d55ac000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b11da215-324d-4c8d-90a5-0b7f26186c4c:3640:1876044666937600:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789136334.183933:0:23320:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1789136334.183940:0:23320:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.131@tcp lock: ffff90a7d1878e00/0x559c8745c6de461d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x559c8745c6de4624 expref: -99 pid: 23329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136334.183948:0:23320:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a7d1878e00 already unused, calling callback (ffffffffc13bbc20) 10000000:00010000:2.0:1789136334.183952:0:23320:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.131@tcp lock: ffff90a7d1878e00/0x559c8745c6de461d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x559c8745c6de4624 expref: -99 pid: 23329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136334.183959:0:23320:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.131@tcp lock: ffff90a7d1878e00/0x559c8745c6de461d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x559c8745c6de4624 expref: -99 pid: 23329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789136334.183966:0:23320:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.131@tcp lock: ffff90a7d1878e00/0x559c8745c6de461d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x559c8745c6de4624 expref: -99 pid: 23329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789136334.183983:0:23320:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1789136334.184022:0:23320:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.131@tcp lock: ffff90a7d1878e00/0x559c8745c6de461d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x559c8745c6de4624 expref: -99 pid: 23329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136334.184029:0:23320:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789136334.184045:0:23320:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.131@tcp lock: ffff90a7d1878e00/0x559c8745c6de461d lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x559c8745c6de4624 expref: -99 pid: 23329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136334.184060:0:23320:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.131@tcp lock: ffff90a7d1878e00/0x559c8745c6de461d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x559c8745c6de4624 expref: -99 pid: 23329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136334.184070:0:23320:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789136334.184073:0:23320:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.131@tcp lock: ffff90a7c167d600/0x559c8745c6de460f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x559c8745c6de4616 expref: -99 pid: 23329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136334.184078:0:23320:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a7c167d600 already unused, calling callback (ffffffffc13bbc20) 10000000:00010000:2.0:1789136334.184081:0:23320:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.131@tcp lock: ffff90a7c167d600/0x559c8745c6de460f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x559c8745c6de4616 expref: -99 pid: 23329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136334.184088:0:23320:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.131@tcp lock: ffff90a7c167d600/0x559c8745c6de460f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x559c8745c6de4616 expref: -99 pid: 23329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789136334.184094:0:23320:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.131@tcp lock: ffff90a7c167d600/0x559c8745c6de460f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x559c8745c6de4616 expref: -99 pid: 23329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789136334.184099:0:23320:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1789136334.184109:0:23320:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.131@tcp lock: ffff90a7c167d600/0x559c8745c6de460f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x559c8745c6de4616 expref: -99 pid: 23329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136334.184114:0:23320:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789136334.184122:0:23320:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.131@tcp lock: ffff90a7c167d600/0x559c8745c6de460f lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x559c8745c6de4616 expref: -99 pid: 23329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136334.184127:0:23320:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.131@tcp lock: ffff90a7c167d600/0x559c8745c6de460f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x559c8745c6de4616 expref: -99 pid: 23329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136334.184140:0:23320:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789136334.184145:0:23320:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789136334.184146:0:23320:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789136334.184152:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789136334.184161:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7fe5ee940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b11da215-324d-4c8d-90a5-0b7f26186c4c:3640:1876044666937856:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789136334.184191:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789136334.184369:0:23317:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666937856 00000100:00100000:1.0:1789136334.184374:0:23317:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666937856 00010000:00010000:1.0:1789136334.184392:0:23317:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90a6c3cafa00/0x559c8745c6de4624 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x559c8745c6de461d expref: 22 pid: 23327 timeout: 882 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789136334.184408:0:23317:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1789136334.184413:0:23317:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7fe5ed680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b11da215-324d-4c8d-90a5-0b7f26186c4c+22:3640:x1876044666937856:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789136334.184420:0:23317:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789136334.184424:0:23317:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90a6c3cafa00/0x559c8745c6de4624 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x559c8745c6de461d expref: 22 pid: 23327 timeout: 882 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136334.184432:0:23317:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90a6c3cafa00/0x559c8745c6de4624 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x559c8745c6de461d expref: 22 pid: 23327 timeout: 882 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136334.184443:0:23317:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90a6c3cafa00/0x559c8745c6de4624 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x559c8745c6de461d expref: 22 pid: 23327 timeout: 882 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136334.184463:0:23317:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789136334.184489:0:23317:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7fe5ed680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b11da215-324d-4c8d-90a5-0b7f26186c4c+21:3640:x1876044666937856:12345-0@lo:103:ldlm_bl.0 Request processed in 76us (298us total) trans 0 rc 0/0 00000100:00100000:1.0:1789136334.184496:0:23317:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1789136334.184517:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7fe5ee940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b11da215-324d-4c8d-90a5-0b7f26186c4c:3640:1876044666937856:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789136334.185760:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789136334.185779:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7fe5ecb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b11da215-324d-4c8d-90a5-0b7f26186c4c:3639:1876044666937984:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789136334.185825:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789136334.185952:0:23317:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666937984 00000100:00100000:1.0:1789136334.185968:0:23317:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666937984 00010000:00010000:1.0:1789136334.186081:0:23317:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90a7e1c9fe00/0x559c8745c6de4616 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x559c8745c6de460f expref: 21 pid: 23324 timeout: 882 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789136334.186104:0:23317:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1789136334.186110:0:23317:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7c69e9e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b11da215-324d-4c8d-90a5-0b7f26186c4c+21:3639:x1876044666937984:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789136334.186121:0:23317:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789136334.186126:0:23317:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90a7e1c9fe00/0x559c8745c6de4616 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x559c8745c6de460f expref: 21 pid: 23324 timeout: 882 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136334.186134:0:23317:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90a7e1c9fe00/0x559c8745c6de4616 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x559c8745c6de460f expref: 21 pid: 23324 timeout: 882 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136334.186149:0:23317:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90a7e1c9fe00/0x559c8745c6de4616 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x559c8745c6de460f expref: 21 pid: 23324 timeout: 882 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136334.186161:0:23317:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789136334.186198:0:23317:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7c69e9e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b11da215-324d-4c8d-90a5-0b7f26186c4c+20:3639:x1876044666937984:12345-0@lo:103:ldlm_bl.0 Request processed in 87us (372us total) trans 0 rc 0/0 00000100:00100000:1.0:1789136334.186204:0:23317:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1789136334.186287:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7fe5ecb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b11da215-324d-4c8d-90a5-0b7f26186c4c:3639:1876044666937984:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789136334.187574:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:0.0:1789136334.187670:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00010000:00010000:0.0:1789136334.187707:0:23321:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789136334.187728:0:23319:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644779008 00000100:00100000:3.0:1789136334.187737:0:23319:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644779008 00010000:00010000:3.0:1789136334.187767:0:23319:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90a7e1c9e200/0x559c8745c6de4988 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08f81 expref: 13 pid: 23324 timeout: 882 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789136334.187806:0:23319:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644779136 00000100:00100000:3.0:1789136334.187809:0:23319:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644779136 00010000:00010000:3.0:1789136334.187824:0:23319:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90a6c3cae400/0x559c8745c6de4949 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08f11 expref: 14 pid: 23327 timeout: 882 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789136334.187836:0:23317:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 13 00000100:00100000:1.0:1789136334.187847:0:23317:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7d0414450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:27cf2c08-90ce-45f0-9821-89831e8ff070+14:2392:x1876044644779008:12345-192.168.201.31@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789136334.187886:0:23317:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789136334.187892:0:23317:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90a7e1c9e200/0x559c8745c6de4988 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08f81 expref: 14 pid: 23324 timeout: 882 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136334.187905:0:23317:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90a7e1c9e200/0x559c8745c6de4988 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08f81 expref: 14 pid: 23324 timeout: 882 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789136334.187917:0:26368:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7fe5eda40 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:26368:1876044666936832:192.168.201.31@tcp:104: 00000100:00100000:2.0:1789136334.187929:0:26368:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7fe5ec780 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:26368:1876044666936960:192.168.201.31@tcp:104: 00010000:00010000:1.0:1789136334.187936:0:23317:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90a7e1c9e200/0x559c8745c6de4988 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08f81 expref: 14 pid: 23324 timeout: 882 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136334.187948:0:23317:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789136334.187961:0:26368:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff90a7c0031000/0x559c8745c6de49b9 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 26368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789136334.188134:0:23317:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7d0414450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:27cf2c08-90ce-45f0-9821-89831e8ff070+13:2392:x1876044644779008:12345-192.168.201.31@tcp:103:ldlm_bl.0 Request processed in 288us (565us total) trans 0 rc 0/0 00000100:00100000:3.0:1789136334.189447:0:23319:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:3.0:1789136334.189470:0:23319:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_003' 00000100:00100000:2.0:1789136334.189749:0:23319:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 14 00000100:00100000:2.0:1789136334.189764:0:23319:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7c86dcb40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:27cf2c08-90ce-45f0-9821-89831e8ff070+13:2389:x1876044644779136:12345-192.168.201.31@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789136334.189779:0:23319:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789136334.189787:0:23319:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90a6c3cae400/0x559c8745c6de4949 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08f11 expref: 13 pid: 23327 timeout: 882 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136334.189801:0:23319:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90a6c3cae400/0x559c8745c6de4949 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08f11 expref: 13 pid: 23327 timeout: 882 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136334.189819:0:23319:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90a6c3cae400/0x559c8745c6de4949 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08f11 expref: 13 pid: 23327 timeout: 882 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136334.189833:0:23319:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff90a7c0031000/0x559c8745c6de49b9 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 26368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136334.189842:0:23319:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90a7c0031000/0x559c8745c6de49b9 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 26368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136334.189876:0:23319:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff90a7c0031000/0x559c8745c6de49b9 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 26368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136334.189891:0:23319:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff90a7c0031000/0x559c8745c6de49b9 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 26368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136334.189899:0:23319:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff90a7c0031000/0x559c8745c6de49b9 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 26368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136334.189918:0:23319:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff90a7c0031000/0x559c8745c6de49b9 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 26368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136334.189924:0:23319:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a7c0031000 already unused, calling callback (ffffffffc0dbf540) 00010000:00010000:2.0:1789136334.189929:0:23319:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff90a7c0031000/0x559c8745c6de49b9 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 26368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136334.189938:0:23319:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff90a7c0031000/0x559c8745c6de49b9 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 26368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136334.189961:0:23319:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff90a7c0031000/0x559c8745c6de49b9 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 26368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136334.189972:0:23319:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789136334.190023:0:23319:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7c86dcb40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:27cf2c08-90ce-45f0-9821-89831e8ff070+12:2389:x1876044644779136:12345-192.168.201.31@tcp:103:ldlm_bl.0 Request processed in 264us (2351us total) trans 0 rc 0/0 00000100:00100000:2.0:1789136334.190032:0:23319:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 14 00010000:00010000:3.0:1789136334.190045:0:26368:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff90a7c0031000/0x559c8745c6de49b9 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 26368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136334.190079:0:26368:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff90a7c0031000/0x559c8745c6de49b9 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 26368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136334.190086:0:26368:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90a7c0031000/0x559c8745c6de49b9 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 26368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789136334.195132:0:23317:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 13 00010000:00010000:2.0:1789136334.568250:0:23320:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1789136335.464633:0:23329:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1789136335.464641:0:23329:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff90a7f08de000 from 19 10000000:01000000:3.0:1789136335.464647:0:23329:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1789136335.464711:0:23329:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.131@tcp lock: ffff90a7ff5f4800/0x559c8745c6de49c0 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 23329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136335.464723:0:23329:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.131@tcp lock: ffff90a7ff5f4800/0x559c8745c6de49c0 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 23329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136335.464735:0:23329:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.131@tcp lock: ffff90a7ff5f4800/0x559c8745c6de49c0 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 23329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789136335.464761:0:23329:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7c69eb480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b11da215-324d-4c8d-90a5-0b7f26186c4c:23329:1876044666938112:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1789136335.464905:0:23329:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789136335.465606:0:23329:0:(client.c:2715:ptlrpc_set_wait()) set ffff90a7c864f0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789136335.469603:0:23325:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666938112 00000100:00100000:2.0:1789136335.469621:0:23325:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666938112 00000100:00100000:2.0:1789136335.470167:0:23325:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:2.0:1789136335.470177:0:23325:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7fb15ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b11da215-324d-4c8d-90a5-0b7f26186c4c+20:23329:x1876044666938112:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789136335.470195:0:23325:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789136335.470240:0:23325:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90a7c0030800/0x559c8745c6de49c7 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x559c8745c6de49c0 expref: -99 pid: 23325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136335.470270:0:23325:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90a7c0030800/0x559c8745c6de49c7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x559c8745c6de49c0 expref: 21 pid: 23325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136335.470281:0:23325:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90a7c0030800/0x559c8745c6de49c7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x559c8745c6de49c0 expref: 21 pid: 23325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136335.470291:0:23325:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a7c0030800, rc 0) 00000100:00100000:2.0:1789136335.470380:0:23325:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7fb15ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b11da215-324d-4c8d-90a5-0b7f26186c4c+21:23329:x1876044666938112:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 204us (5474us total) trans 0 rc 0/0 00000100:00100000:2.0:1789136335.470386:0:23325:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:3.0:1789136335.470506:0:23329:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7c69eb480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b11da215-324d-4c8d-90a5-0b7f26186c4c:23329:1876044666938112:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789136335.470524:0:23329:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.131@tcp lock: ffff90a7ff5f4800/0x559c8745c6de49c0 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x559c8745c6de49c7 expref: -99 pid: 23329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136335.470534:0:23329:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.131@tcp lock: ffff90a7ff5f4800/0x559c8745c6de49c0 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x559c8745c6de49c7 expref: -99 pid: 23329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789136335.470606:0:23329:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7c69eb480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b11da215-324d-4c8d-90a5-0b7f26186c4c:23329:1876044666938240:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789136335.470643:0:23329:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789136335.470814:0:23329:0:(client.c:2715:ptlrpc_set_wait()) set ffff90a7c864f0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789136335.473654:0:23324:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666938240 00000100:00100000:0.0:1789136335.473675:0:23324:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666938240 00000100:00100000:0.0:1789136335.473736:0:23324:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:0.0:1789136335.473744:0:23324:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7fb159050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b11da215-324d-4c8d-90a5-0b7f26186c4c+21:23329:x1876044666938240:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789136335.473923:0:23324:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7fb159050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b11da215-324d-4c8d-90a5-0b7f26186c4c+21:23329:x1876044666938240:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 179us (3279us total) trans 0 rc 0/0 00000100:00100000:0.0:1789136335.473931:0:23324:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:3.0:1789136335.474683:0:23329:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7c69eb480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b11da215-324d-4c8d-90a5-0b7f26186c4c:23329:1876044666938240:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789136335.474735:0:23329:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7c69eb480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b11da215-324d-4c8d-90a5-0b7f26186c4c:23329:1876044666938368:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789136335.474787:0:23329:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789136335.474830:0:23329:0:(client.c:2715:ptlrpc_set_wait()) set ffff90a7c864f0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789136335.475008:0:23324:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666938368 00000100:00100000:0.0:1789136335.475013:0:23324:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666938368 00000100:00100000:0.0:1789136335.475046:0:23324:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:0.0:1789136335.475052:0:23324:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7fb15bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b11da215-324d-4c8d-90a5-0b7f26186c4c+21:23329:x1876044666938368:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789136335.475162:0:23324:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7fb15bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b11da215-324d-4c8d-90a5-0b7f26186c4c+21:23329:x1876044666938368:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 109us (374us total) trans 0 rc 0/0 00000100:00100000:0.0:1789136335.475170:0:23324:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:3.0:1789136335.475347:0:23329:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7c69eb480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b11da215-324d-4c8d-90a5-0b7f26186c4c:23329:1876044666938368:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1789136335.476549:0:26382:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 19 00000020:01000000:3.0:1789136335.478335:0:23329:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 19-18 (rc=0) 10000000:01000000:3.0:1789136335.478373:0:23329:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.131@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1789136335.478384:0:23329:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.131@tcp lock: ffff90a7ff5f4800/0x559c8745c6de49c0 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x559c8745c6de49c7 expref: -99 pid: 23329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136335.478396:0:23329:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.131@tcp lock: ffff90a7ff5f4800/0x559c8745c6de49c0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x559c8745c6de49c7 expref: -99 pid: 23329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789136335.478408:0:23329:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1789136335.478485:0:23329:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff90a7ff56c800 from 19 10000000:01000000:3.0:1789136335.478489:0:23329:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1789136335.478534:0:23329:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.131@tcp lock: ffff90a7ff5f4200/0x559c8745c6de49ce lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 23329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136335.478541:0:23329:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.131@tcp lock: ffff90a7ff5f4200/0x559c8745c6de49ce lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 23329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136335.478553:0:23329:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.131@tcp lock: ffff90a7ff5f4200/0x559c8745c6de49ce lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 23329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789136335.478580:0:23329:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7c69eb480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b11da215-324d-4c8d-90a5-0b7f26186c4c:23329:1876044666938496:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1789136335.479109:0:23329:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789136335.479150:0:23329:0:(client.c:2715:ptlrpc_set_wait()) set ffff90a7c864f0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789136335.479907:0:23324:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666938496 00000100:00100000:0.0:1789136335.479915:0:23324:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666938496 00000100:00100000:0.0:1789136335.479964:0:23324:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:0.0:1789136335.479981:0:23324:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7fb15a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b11da215-324d-4c8d-90a5-0b7f26186c4c+21:23329:x1876044666938496:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789136335.479997:0:23324:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789136335.480012:0:23324:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90a6c3caf600/0x559c8745c6de49d5 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x559c8745c6de49ce expref: -99 pid: 23324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136335.480052:0:23324:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90a6c3caf600/0x559c8745c6de49d5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x559c8745c6de49ce expref: 22 pid: 23324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136335.480063:0:23324:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90a6c3caf600/0x559c8745c6de49d5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x559c8745c6de49ce expref: 22 pid: 23324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136335.480072:0:23324:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a6c3caf600, rc 0) 00000100:00100000:0.0:1789136335.480124:0:23324:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7fb15a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b11da215-324d-4c8d-90a5-0b7f26186c4c+22:23329:x1876044666938496:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 152us (1017us total) trans 0 rc 0/0 00000100:00100000:0.0:1789136335.480130:0:23324:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:3.0:1789136335.480783:0:23329:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7c69eb480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b11da215-324d-4c8d-90a5-0b7f26186c4c:23329:1876044666938496:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789136335.480804:0:23329:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.131@tcp lock: ffff90a7ff5f4200/0x559c8745c6de49ce lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x559c8745c6de49d5 expref: -99 pid: 23329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136335.480813:0:23329:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.131@tcp lock: ffff90a7ff5f4200/0x559c8745c6de49ce lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x559c8745c6de49d5 expref: -99 pid: 23329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789136335.480926:0:23329:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7c69eb480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b11da215-324d-4c8d-90a5-0b7f26186c4c:23329:1876044666938624:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789136335.480960:0:23329:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789136335.481103:0:23329:0:(client.c:2715:ptlrpc_set_wait()) set ffff90a7c864f0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789136335.481214:0:23324:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666938624 00000100:00100000:0.0:1789136335.481219:0:23324:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666938624 00000100:00100000:0.0:1789136335.481259:0:23324:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:0.0:1789136335.481266:0:23324:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7fb159c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b11da215-324d-4c8d-90a5-0b7f26186c4c+22:23329:x1876044666938624:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789136335.481383:0:23324:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7fb159c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b11da215-324d-4c8d-90a5-0b7f26186c4c+22:23329:x1876044666938624:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 116us (420us total) trans 0 rc 0/0 00000100:00100000:0.0:1789136335.481390:0:23324:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:3.0:1789136335.481621:0:23329:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7c69eb480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b11da215-324d-4c8d-90a5-0b7f26186c4c:23329:1876044666938624:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789136335.481651:0:23329:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7c69eb480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b11da215-324d-4c8d-90a5-0b7f26186c4c:23329:1876044666938752:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789136335.481707:0:23329:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789136335.481736:0:23329:0:(client.c:2715:ptlrpc_set_wait()) set ffff90a7c864f0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789136335.481782:0:23327:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666938752 00000100:00100000:1.0:1789136335.481787:0:23327:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666938752 00000100:00100000:1.0:1789136335.481817:0:23327:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:1.0:1789136335.481824:0:23327:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7fb158050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b11da215-324d-4c8d-90a5-0b7f26186c4c+22:23329:x1876044666938752:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789136335.482158:0:23327:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7fb158050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b11da215-324d-4c8d-90a5-0b7f26186c4c+22:23329:x1876044666938752:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 334us (451us total) trans 0 rc 0/0 00000100:00100000:1.0:1789136335.482165:0:23327:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:2.0:1789136335.482236:0:23329:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7c69eb480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b11da215-324d-4c8d-90a5-0b7f26186c4c:23329:1876044666938752:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1789136335.483408:0:26383:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 19 00000020:01000000:2.0:1789136335.483781:0:23329:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 19-18 (rc=0) 10000000:01000000:2.0:1789136335.483808:0:23329:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.131@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1789136335.483818:0:23329:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.131@tcp lock: ffff90a7ff5f4200/0x559c8745c6de49ce lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x559c8745c6de49d5 expref: -99 pid: 23329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136335.483831:0:23329:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.131@tcp lock: ffff90a7ff5f4200/0x559c8745c6de49ce lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x559c8745c6de49d5 expref: -99 pid: 23329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789136335.483842:0:23329:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1789136335.483844:0:23329:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff90a6c3ba1800 from 19 10000000:01000000:2.0:1789136335.483847:0:23329:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1789136335.483917:0:23329:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.131@tcp lock: ffff90a7c0031600/0x559c8745c6de49dc lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 23329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136335.483925:0:23329:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.131@tcp lock: ffff90a7c0031600/0x559c8745c6de49dc lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 23329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136335.483950:0:23329:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.131@tcp lock: ffff90a7c0031600/0x559c8745c6de49dc lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 23329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789136335.483970:0:23329:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7fe5ec780 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b11da215-324d-4c8d-90a5-0b7f26186c4c:23329:1876044666938880:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789136335.484132:0:23329:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789136335.484173:0:23329:0:(client.c:2715:ptlrpc_set_wait()) set ffff90a7f6886900 going to sleep for 11 seconds 00000100:00100000:0.0:1789136335.484307:0:23325:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666938880 00000100:00100000:0.0:1789136335.484313:0:23325:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666938880 00000100:00100000:0.0:1789136335.484348:0:23325:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:0.0:1789136335.484355:0:23325:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7fb159850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b11da215-324d-4c8d-90a5-0b7f26186c4c+22:23329:x1876044666938880:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789136335.484366:0:23325:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789136335.484378:0:23325:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90a6c3cafe00/0x559c8745c6de49e3 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x559c8745c6de49dc expref: -99 pid: 23325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136335.484398:0:23325:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90a6c3cafe00/0x559c8745c6de49e3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x559c8745c6de49dc expref: 23 pid: 23325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136335.484530:0:23325:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90a6c3cafe00/0x559c8745c6de49e3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x559c8745c6de49dc expref: 23 pid: 23325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136335.484541:0:23325:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a6c3cafe00, rc 0) 00000100:00100000:0.0:1789136335.484582:0:23325:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7fb159850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b11da215-324d-4c8d-90a5-0b7f26186c4c+23:23329:x1876044666938880:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 227us (450us total) trans 0 rc 0/0 00000100:00100000:0.0:1789136335.484590:0:23325:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:2.0:1789136335.484763:0:23329:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7fe5ec780 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b11da215-324d-4c8d-90a5-0b7f26186c4c:23329:1876044666938880:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789136335.484776:0:23329:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.131@tcp lock: ffff90a7c0031600/0x559c8745c6de49dc lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x559c8745c6de49e3 expref: -99 pid: 23329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136335.484785:0:23329:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.131@tcp lock: ffff90a7c0031600/0x559c8745c6de49dc lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x559c8745c6de49e3 expref: -99 pid: 23329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789136335.484840:0:23329:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7fe5ec780 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b11da215-324d-4c8d-90a5-0b7f26186c4c:23329:1876044666939008:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789136335.485049:0:23329:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789136335.485073:0:23329:0:(client.c:2715:ptlrpc_set_wait()) set ffff90a7f6886900 going to sleep for 11 seconds 00000100:00100000:0.0:1789136335.485147:0:23324:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666939008 00000100:00100000:0.0:1789136335.485152:0:23324:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666939008 00000100:00100000:0.0:1789136335.485183:0:23324:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:0.0:1789136335.485190:0:23324:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7fb159450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b11da215-324d-4c8d-90a5-0b7f26186c4c+23:23329:x1876044666939008:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789136335.485357:0:23324:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7fb159450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b11da215-324d-4c8d-90a5-0b7f26186c4c+23:23329:x1876044666939008:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 167us (307us total) trans 0 rc 0/0 00000100:00100000:0.0:1789136335.485364:0:23324:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:3.0:1789136335.487754:0:23329:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7fe5ec780 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b11da215-324d-4c8d-90a5-0b7f26186c4c:23329:1876044666939008:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789136335.487833:0:23329:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7c69eb0c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b11da215-324d-4c8d-90a5-0b7f26186c4c:23329:1876044666939136:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789136335.492224:0:23329:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789136335.492405:0:23329:0:(client.c:2715:ptlrpc_set_wait()) set ffff90a7c864f480 going to sleep for 11 seconds 00000100:00100000:2.0:1789136335.492531:0:23327:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666939136 00000100:00100000:2.0:1789136335.492540:0:23327:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666939136 00000100:00100000:2.0:1789136335.492634:0:23327:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:2.0:1789136335.492645:0:23327:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7fb15a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b11da215-324d-4c8d-90a5-0b7f26186c4c+23:23329:x1876044666939136:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789136335.492793:0:23327:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7fb15a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b11da215-324d-4c8d-90a5-0b7f26186c4c+23:23329:x1876044666939136:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 149us (576us total) trans 0 rc 0/0 00000100:00100000:2.0:1789136335.492800:0:23327:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:3.0:1789136335.492903:0:23329:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7c69eb0c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b11da215-324d-4c8d-90a5-0b7f26186c4c:23329:1876044666939136:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1789136335.497817:0:26384:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 19 00000020:01000000:1.0:1789136335.499052:0:23329:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 19-18 (rc=0) 10000000:01000000:1.0:1789136335.499080:0:23329:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.131@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1789136335.499092:0:23329:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.131@tcp lock: ffff90a7c0031600/0x559c8745c6de49dc lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x559c8745c6de49e3 expref: -99 pid: 23329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136335.499106:0:23329:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.131@tcp lock: ffff90a7c0031600/0x559c8745c6de49dc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x559c8745c6de49e3 expref: -99 pid: 23329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789136335.499115:0:23329:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1789136335.499117:0:23329:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff90a7fa55b800 from 19 10000000:01000000:1.0:1789136335.499119:0:23329:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1789136335.499161:0:23329:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.131@tcp lock: ffff90a6c3b4da00/0x559c8745c6de49ea lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 23329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136335.499182:0:23329:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.131@tcp lock: ffff90a6c3b4da00/0x559c8745c6de49ea lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 23329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136335.499195:0:23329:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.131@tcp lock: ffff90a6c3b4da00/0x559c8745c6de49ea lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 23329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789136335.499218:0:23329:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c47e4b40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b11da215-324d-4c8d-90a5-0b7f26186c4c:23329:1876044666939264:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1789136335.499277:0:23329:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789136335.499319:0:23324:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666939264 00000100:00100000:1.0:1789136335.499321:0:23329:0:(client.c:2715:ptlrpc_set_wait()) set ffff90a7d1b6a240 going to sleep for 11 seconds 00000100:00100000:0.0:1789136335.499326:0:23324:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666939264 00000100:00100000:0.0:1789136335.499385:0:23324:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:0.0:1789136335.499395:0:23324:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7fb15a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b11da215-324d-4c8d-90a5-0b7f26186c4c+23:23329:x1876044666939264:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789136335.499410:0:23324:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789136335.499425:0:23324:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90a6c3cae400/0x559c8745c6de49f1 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x559c8745c6de49ea expref: -99 pid: 23324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136335.499459:0:23324:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90a6c3cae400/0x559c8745c6de49f1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x559c8745c6de49ea expref: 24 pid: 23324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136335.499470:0:23324:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90a6c3cae400/0x559c8745c6de49f1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x559c8745c6de49ea expref: 24 pid: 23324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136335.499491:0:23324:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a6c3cae400, rc 0) 00000100:00100000:0.0:1789136335.499547:0:23324:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7fb15a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b11da215-324d-4c8d-90a5-0b7f26186c4c+24:23329:x1876044666939264:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 153us (268us total) trans 0 rc 0/0 00000100:00100000:0.0:1789136335.499553:0:23324:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:1.0:1789136335.500544:0:23329:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c47e4b40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b11da215-324d-4c8d-90a5-0b7f26186c4c:23329:1876044666939264:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789136335.500567:0:23329:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.131@tcp lock: ffff90a6c3b4da00/0x559c8745c6de49ea lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x559c8745c6de49f1 expref: -99 pid: 23329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136335.500577:0:23329:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.131@tcp lock: ffff90a6c3b4da00/0x559c8745c6de49ea lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x559c8745c6de49f1 expref: -99 pid: 23329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789136335.500661:0:23329:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c47e4b40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b11da215-324d-4c8d-90a5-0b7f26186c4c:23329:1876044666939392:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789136335.500700:0:23329:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789136335.500737:0:23329:0:(client.c:2715:ptlrpc_set_wait()) set ffff90a7d1b6a240 going to sleep for 11 seconds 00000100:00100000:2.0:1789136335.500747:0:23327:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666939392 00000100:00100000:2.0:1789136335.500753:0:23327:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666939392 00000100:00100000:2.0:1789136335.500798:0:23327:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:2.0:1789136335.500816:0:23327:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7fb15b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b11da215-324d-4c8d-90a5-0b7f26186c4c+24:23329:x1876044666939392:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789136335.500983:0:23327:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7fb15b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b11da215-324d-4c8d-90a5-0b7f26186c4c+24:23329:x1876044666939392:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 158us (272us total) trans 0 rc 0/0 00000100:00100000:2.0:1789136335.500990:0:23327:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:1.0:1789136335.501251:0:23329:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c47e4b40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b11da215-324d-4c8d-90a5-0b7f26186c4c:23329:1876044666939392:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789136335.501282:0:23329:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c47e4b40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b11da215-324d-4c8d-90a5-0b7f26186c4c:23329:1876044666939520:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789136335.501322:0:23329:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789136335.501352:0:23329:0:(client.c:2715:ptlrpc_set_wait()) set ffff90a7d1b6a240 going to sleep for 11 seconds 00000100:00100000:0.0:1789136335.501439:0:23324:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666939520 00000100:00100000:0.0:1789136335.501445:0:23324:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666939520 00000100:00100000:0.0:1789136335.501475:0:23324:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:0.0:1789136335.501483:0:23324:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7fb15b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b11da215-324d-4c8d-90a5-0b7f26186c4c+24:23329:x1876044666939520:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789136335.501567:0:23324:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7fb15b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b11da215-324d-4c8d-90a5-0b7f26186c4c+24:23329:x1876044666939520:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 85us (244us total) trans 0 rc 0/0 00000100:00100000:0.0:1789136335.501574:0:23324:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:1.0:1789136335.502150:0:23329:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c47e4b40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b11da215-324d-4c8d-90a5-0b7f26186c4c:23329:1876044666939520:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1789136335.505395:0:26385:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 19 00000020:01000000:1.0:1789136335.505992:0:23329:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 19-18 (rc=0) 10000000:01000000:1.0:1789136335.506024:0:23329:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.131@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1789136335.506034:0:23329:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.131@tcp lock: ffff90a6c3b4da00/0x559c8745c6de49ea lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x559c8745c6de49f1 expref: -99 pid: 23329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136335.506043:0:23329:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.131@tcp lock: ffff90a6c3b4da00/0x559c8745c6de49ea lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x559c8745c6de49f1 expref: -99 pid: 23329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136335.592116:0:23321:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789136335.798602:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:2.0:1789136335.798715:0:23325:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644779264 00000100:00100000:2.0:1789136335.798725:0:23325:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644779264 00000100:00100000:2.0:1789136335.798823:0:23325:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 158 00000100:00100000:2.0:1789136335.798834:0:23325:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7c4fff450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:27cf2c08-90ce-45f0-9821-89831e8ff070+11:18329:x1876044644779264:12345-192.168.201.31@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789136335.798895:0:23325:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789136335.798916:0:23325:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90a7c0031a00/0x559c8745c6de49f8 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xa7228e7a1ab08fb9 expref: -99 pid: 23325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136335.798948:0:23325:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90a7c0031a00/0x559c8745c6de49f8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08fb9 expref: 12 pid: 23325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136335.798961:0:23325:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90a7c0031a00/0x559c8745c6de49f8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08fb9 expref: 12 pid: 23325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136335.798981:0:23325:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a7c0031a00, rc 0) 00000100:00100000:2.0:1789136335.799616:0:23325:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7c4fff450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:27cf2c08-90ce-45f0-9821-89831e8ff070+12:18329:x1876044644779264:12345-192.168.201.31@tcp:101:ll_cfg_requeue.0 Request processed in 781us (1023us total) trans 0 rc 0/0 00000100:00100000:2.0:1789136335.799623:0:23325:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 158 00000100:00100000:3.0:1789136335.801417:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:0.0:1789136335.805979:0:23324:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644779392 00000100:00100000:0.0:1789136335.805993:0:23324:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644779392 00000100:00100000:0.0:1789136335.806185:0:23324:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 159 00000100:00100000:0.0:1789136335.806195:0:23324:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7c4ffc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:27cf2c08-90ce-45f0-9821-89831e8ff070+12:18329:x1876044644779392:12345-192.168.201.31@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789136335.806360:0:23324:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7c4ffc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:27cf2c08-90ce-45f0-9821-89831e8ff070+12:18329:x1876044644779392:12345-192.168.201.31@tcp:501:ll_cfg_requeue.0 Request processed in 165us (4952us total) trans 0 rc 0/0 00000100:00100000:0.0:1789136335.806367:0:23324:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 159 00000100:00100000:1.0:1789136335.811784:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:0.0:1789136335.812133:0:23324:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644779520 00000100:00100000:0.0:1789136335.812144:0:23324:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644779520 00000100:00100000:0.0:1789136335.812289:0:23324:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 160 00000100:00100000:0.0:1789136335.812300:0:23324:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7c4ffc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:27cf2c08-90ce-45f0-9821-89831e8ff070+12:18329:x1876044644779520:12345-192.168.201.31@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789136335.812456:0:23324:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7c4ffc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:27cf2c08-90ce-45f0-9821-89831e8ff070+12:18329:x1876044644779520:12345-192.168.201.31@tcp:503:ll_cfg_requeue.0 Request processed in 157us (692us total) trans 0 rc 0/0 00000100:00100000:0.0:1789136335.812470:0:23324:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 160 00000100:00100000:3.0:1789136335.829047:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:1.0:1789136335.831601:0:23327:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644779648 00000100:00100000:1.0:1789136335.831614:0:23327:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644779648 00000100:00100000:1.0:1789136335.831678:0:23327:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 161 00000100:00100000:1.0:1789136335.831685:0:23327:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7c4ffd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:27cf2c08-90ce-45f0-9821-89831e8ff070+12:18329:x1876044644779648:12345-192.168.201.31@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789136335.831700:0:23327:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789136335.831716:0:23327:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90a6c3b4ce00/0x559c8745c6de49ff lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xa7228e7a1ab08fc0 expref: -99 pid: 23327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136335.831741:0:23327:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90a6c3b4ce00/0x559c8745c6de49ff lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08fc0 expref: 13 pid: 23327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136335.831750:0:23327:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90a6c3b4ce00/0x559c8745c6de49ff lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08fc0 expref: 13 pid: 23327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136335.831757:0:23327:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a6c3b4ce00, rc 0) 00000100:00100000:1.0:1789136335.831837:0:23327:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7c4ffd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:27cf2c08-90ce-45f0-9821-89831e8ff070+13:18329:x1876044644779648:12345-192.168.201.31@tcp:101:ll_cfg_requeue.0 Request processed in 151us (2812us total) trans 0 rc 0/0 00000100:00100000:1.0:1789136335.831845:0:23327:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 161 00000100:00100000:3.0:1789136335.847444:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:0.0:1789136335.847738:0:23324:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644779776 00000100:00100000:0.0:1789136335.847749:0:23324:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644779776 00000100:00100000:0.0:1789136335.848041:0:23324:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 162 00000100:00100000:0.0:1789136335.848053:0:23324:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7c4fffc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:27cf2c08-90ce-45f0-9821-89831e8ff070+13:18329:x1876044644779776:12345-192.168.201.31@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789136335.848192:0:23324:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7c4fffc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:27cf2c08-90ce-45f0-9821-89831e8ff070+13:18329:x1876044644779776:12345-192.168.201.31@tcp:501:ll_cfg_requeue.0 Request processed in 142us (769us total) trans 0 rc 0/0 00000100:00100000:0.0:1789136335.849527:0:23324:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 162 00000100:00100000:3.0:1789136335.855250:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:0.0:1789136335.856798:0:23324:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644779904 00000100:00100000:0.0:1789136335.856811:0:23324:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644779904 00000100:00100000:0.0:1789136335.856887:0:23324:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 163 00000100:00100000:0.0:1789136335.856897:0:23324:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7c4ffe450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:27cf2c08-90ce-45f0-9821-89831e8ff070+13:18329:x1876044644779904:12345-192.168.201.31@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789136335.857240:0:23324:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7c4ffe450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:27cf2c08-90ce-45f0-9821-89831e8ff070+13:18329:x1876044644779904:12345-192.168.201.31@tcp:503:ll_cfg_requeue.0 Request processed in 342us (1999us total) trans 0 rc 0/0 00000100:00100000:0.0:1789136335.857249:0:23324:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 163 00000100:00100000:3.0:1789136335.863053:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:3.0:1789136335.863556:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:3.0:1789136335.863601:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:3.0:1789136335.863633:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:0.0:1789136335.863763:0:23333:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644780160 00000100:00100000:0.0:1789136335.863781:0:23333:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644780160 00000100:00100000:0.0:1789136335.863835:0:23333:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644780672 00000100:00100000:0.0:1789136335.863837:0:23333:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644780672 00000100:00100000:0.0:1789136335.863875:0:23333:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 56 00000100:00100000:0.0:1789136335.863885:0:23333:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7c69eb0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bb852e64-3f46-4395-9dea-0822b7213ac8+5:2389:x1876044644780160:12345-192.168.201.31@tcp:400:kworker.0 00000100:00100000:0.0:1789136335.863952:0:23333:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7c69eb0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bb852e64-3f46-4395-9dea-0822b7213ac8+5:2389:x1876044644780160:12345-192.168.201.31@tcp:400:kworker.0 Request processed in 69us (910us total) trans 0 rc 0/0 00000100:00100000:0.0:1789136335.863960:0:23333:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 56 00000100:00100000:0.0:1789136335.863976:0:23333:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 57 00000100:00100000:0.0:1789136335.863995:0:23333:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7c69ebc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a4039233-0823-4bef-b733-24ab7c889e38+5:2389:x1876044644780672:12345-192.168.201.31@tcp:400:kworker.0 00000100:00100000:0.0:1789136335.864019:0:23333:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7c69ebc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a4039233-0823-4bef-b733-24ab7c889e38+5:2389:x1876044644780672:12345-192.168.201.31@tcp:400:kworker.0 Request processed in 25us (418us total) trans 0 rc 0/0 00000100:00100000:0.0:1789136335.864026:0:23333:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 57 00000100:00080000:0.0:1789136335.864045:0:23328:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1789136335.864099:0:24846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644780416 00000100:00100000:0.0:1789136335.864103:0:24846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644780416 00000100:00100000:3.0:1789136335.864264:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:3.0:1789136335.864324:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:3.0:1789136335.864389:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:3.0:1789136335.864408:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:3.0:1789136335.864432:0:25418:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644780928 00000100:00100000:3.0:1789136335.864436:0:25418:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644780928 00000100:00100000:3.0:1789136335.864454:0:25418:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644780288 00000100:00100000:3.0:1789136335.864456:0:25418:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644780288 00000100:00100000:3.0:1789136335.864465:0:25418:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644780800 00000100:00100000:3.0:1789136335.864467:0:25418:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644780800 00000100:00100000:3.0:1789136335.864478:0:25418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 15 00000100:00100000:3.0:1789136335.864484:0:25418:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7c69eb840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:bb852e64-3f46-4395-9dea-0822b7213ac8+5:2389:x1876044644780416:12345-192.168.201.31@tcp:400:kworker.0 00000100:00100000:3.0:1789136335.864512:0:25418:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7c69eb840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:bb852e64-3f46-4395-9dea-0822b7213ac8+5:2389:x1876044644780416:12345-192.168.201.31@tcp:400:kworker.0 Request processed in 29us (958us total) trans 0 rc 0/0 00000100:00100000:3.0:1789136335.864518:0:25418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 15 00000100:00100000:3.0:1789136335.864528:0:25418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 16 00000100:00100000:3.0:1789136335.864533:0:25418:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7c69ea580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a4039233-0823-4bef-b733-24ab7c889e38+5:2389:x1876044644780928:12345-192.168.201.31@tcp:400:kworker.0 00000100:00100000:3.0:1789136335.864550:0:25418:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7c69ea580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a4039233-0823-4bef-b733-24ab7c889e38+5:2389:x1876044644780928:12345-192.168.201.31@tcp:400:kworker.0 Request processed in 17us (917us total) trans 0 rc 0/0 00000100:00100000:3.0:1789136335.864556:0:25418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 16 00000100:00100000:3.0:1789136335.864564:0:25418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 17 00000100:00100000:3.0:1789136335.864576:0:25418:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7c69e9a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:bb852e64-3f46-4395-9dea-0822b7213ac8+5:2389:x1876044644780288:12345-192.168.201.31@tcp:400:kworker.0 00000100:00100000:3.0:1789136335.864596:0:25418:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7c69e9a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:bb852e64-3f46-4395-9dea-0822b7213ac8+5:2389:x1876044644780288:12345-192.168.201.31@tcp:400:kworker.0 Request processed in 21us (272us total) trans 0 rc 0/0 00000100:00100000:3.0:1789136335.864601:0:25418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 17 00000100:00100000:3.0:1789136335.864611:0:25418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 18 00000100:00100000:3.0:1789136335.864616:0:25418:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7c69e83c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a4039233-0823-4bef-b733-24ab7c889e38+5:2389:x1876044644780800:12345-192.168.201.31@tcp:400:kworker.0 00000100:00100000:3.0:1789136335.864632:0:25418:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7c69e83c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a4039233-0823-4bef-b733-24ab7c889e38+5:2389:x1876044644780800:12345-192.168.201.31@tcp:400:kworker.0 Request processed in 16us (223us total) trans 0 rc 0/0 00000100:00100000:3.0:1789136335.864637:0:25418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 18 00000100:00100000:3.0:1789136335.864650:0:23334:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644780032 00000100:00100000:3.0:1789136335.864660:0:23334:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644780032 00000100:00100000:3.0:1789136335.864677:0:23334:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644780544 00000100:00100000:3.0:1789136335.864679:0:23334:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644780544 00000100:00100000:3.0:1789136335.864689:0:23334:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 58 00000100:00100000:3.0:1789136335.864694:0:23334:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7c69ea940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bb852e64-3f46-4395-9dea-0822b7213ac8+6:2389:x1876044644780032:12345-192.168.201.31@tcp:400:kworker.0 00000100:00100000:3.0:1789136335.864716:0:23334:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7c69ea940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bb852e64-3f46-4395-9dea-0822b7213ac8+6:2389:x1876044644780032:12345-192.168.201.31@tcp:400:kworker.0 Request processed in 21us (453us total) trans 0 rc 0/0 00000100:00100000:3.0:1789136335.864721:0:23334:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 58 00000100:00100000:3.0:1789136335.864731:0:23334:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 59 00000100:00100000:3.0:1789136335.864736:0:23334:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7c69e8f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a4039233-0823-4bef-b733-24ab7c889e38+6:2389:x1876044644780544:12345-192.168.201.31@tcp:400:kworker.0 00000100:00100000:3.0:1789136335.864754:0:23334:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7c69e8f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a4039233-0823-4bef-b733-24ab7c889e38+6:2389:x1876044644780544:12345-192.168.201.31@tcp:400:kworker.0 Request processed in 19us (365us total) trans 0 rc 0/0 00000100:00100000:3.0:1789136335.864760:0:23334:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 59 00000100:00080000:0.0:1789136335.864843:0:23328:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789136335.864847:0:23328:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789136335.864849:0:23328:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789136336.232529:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7fe5eda40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1876044666939648:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1789136336.232648:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789136336.232786:0:24848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666939648 00000100:00100000:2.0:1789136336.232794:0:24848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666939648 00000100:00100000:2.0:1789136336.232897:0:24848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1789136336.232909:0:24848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7c86dfc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1876044666939648:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1789136336.232962:0:24848:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3915853824 avail 3684331520 00000100:00100000:2.0:1789136336.233012:0:24848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7c86dfc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1876044666939648:12345-0@lo:13:osp-pre-0-1.0 Request processed in 106us (364us total) trans 0 rc 0/0 00000100:00100000:2.0:1789136336.233358:0:24848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1789136336.233461:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7fe5eda40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1876044666939648:0@lo:13:osp-pre-0-1.0 00000100:00080000:0.0:1789136336.233485:0:23328:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789136336.233702:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7c69eb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1876044666939776:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789136336.233738:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789136336.233808:0:24849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666939776 00000100:00100000:2.0:1789136336.233813:0:24849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666939776 00000100:00100000:2.0:1789136336.233867:0:24849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1789136336.233875:0:24849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c47e4b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1876044666939776:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789136336.233885:0:24849:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3915853824 avail 3684331520 00000100:00080000:0.0:1789136336.233948:0:23328:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789136336.234213:0:24849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c47e4b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1876044666939776:12345-0@lo:13:osp-pre-0-0.0 Request processed in 338us (472us total) trans 0 rc 0/0 00000100:00100000:2.0:1789136336.234221:0:24849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1789136336.234545:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7c69eb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1876044666939776:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789136336.287323:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:0.0:1789136336.287928:0:23334:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644781056 00000100:00100000:0.0:1789136336.287945:0:23334:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644781056 00000100:00100000:0.0:1789136336.288375:0:23334:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 23 00000100:00100000:0.0:1789136336.288391:0:23334:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7c69e9e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bb852e64-3f46-4395-9dea-0822b7213ac8+6:18953:x1876044644781056:12345-192.168.201.31@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789136336.289387:0:23334:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789136336.289959:0:23334:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3caf400/0x559c8745c6de4a06 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa7228e7a1ab08fc7 expref: -99 pid: 23334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136336.293935:0:23334:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3cafa00/0x559c8745c6de4a0d lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 23334 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136336.293961:0:23334:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3cafa00/0x559c8745c6de4a0d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 23334 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136336.293997:0:23334:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3cafa00/0x559c8745c6de4a0d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 23334 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136336.294017:0:23334:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7e1c9e200/0x559c8745c6de4a14 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 23334 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136336.294024:0:23334:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a7e1c9e200/0x559c8745c6de4a14 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 23334 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136336.294030:0:23334:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a7e1c9e200/0x559c8745c6de4a14 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 23334 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136336.294167:0:23334:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7e1c9fe00/0x559c8745c6de4a1b lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 23334 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136336.294173:0:23334:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a7e1c9fe00/0x559c8745c6de4a1b lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 23334 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136336.294178:0:23334:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a7e1c9fe00/0x559c8745c6de4a1b lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 23334 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789136336.294204:0:23334:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1789136336.294207:0:23334:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1789136336.294239:0:23334:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90a7e1c9fe00/0x559c8745c6de4a1b lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 23334 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136336.294246:0:23334:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3cafa00/0x559c8745c6de4a0d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 23334 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136336.294251:0:23334:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3cafa00/0x559c8745c6de4a0d lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 23334 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136336.294263:0:23334:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3cafa00/0x559c8745c6de4a0d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 23334 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136336.294269:0:23334:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a6c3cafa00 already unused, calling callback (ffffffffc19cc4f0) 00010000:00010000:0.0:1789136336.294273:0:23334:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3cafa00/0x559c8745c6de4a0d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 23334 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136336.294281:0:23334:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3cafa00/0x559c8745c6de4a0d lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 23334 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136336.294295:0:23334:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90a7fa5c0a00) 00010000:00010000:0.0:1789136336.294298:0:23334:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789136336.294302:0:23334:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3cafa00/0x559c8745c6de4a0d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 23334 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136336.294308:0:23334:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3cafa00/0x559c8745c6de4a0d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 23334 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136336.294324:0:23334:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7e1c9e200/0x559c8745c6de4a14 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 23334 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136336.294331:0:23334:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a7e1c9e200/0x559c8745c6de4a14 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 23334 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136336.294334:0:23334:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a7e1c9e200/0x559c8745c6de4a14 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 23334 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136336.294337:0:23334:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a7e1c9e200 already unused, calling callback (ffffffffc19cc4f0) 00010000:00010000:0.0:1789136336.294339:0:23334:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a7e1c9e200/0x559c8745c6de4a14 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 23334 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136336.294350:0:23334:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a7e1c9e200/0x559c8745c6de4a14 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 23334 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136336.294356:0:23334:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff90a7fa5c0900) 00010000:00010000:0.0:1789136336.294357:0:23334:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789136336.294359:0:23334:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a7e1c9e200/0x559c8745c6de4a14 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 23334 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136336.294365:0:23334:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a7e1c9e200/0x559c8745c6de4a14 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 23334 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136336.294409:0:23334:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3caf400/0x559c8745c6de4a06 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08fc7 expref: 8 pid: 23334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136336.294437:0:23334:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7e1c9fe00/0x559c8745c6de4a1b lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08fc7 expref: 7 pid: 23334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136336.294444:0:23334:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff90a7fa5c0e00) 00010000:00010000:0.0:1789136336.294446:0:23334:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789136336.294449:0:23334:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a7e1c9fe00, rc 0) 00000100:00100000:0.0:1789136336.294531:0:23334:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7c69e9e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bb852e64-3f46-4395-9dea-0822b7213ac8+7:18953:x1876044644781056:12345-192.168.201.31@tcp:101:lhsmtool_posix.0 Request processed in 6145us (7223us total) trans 0 rc 0/0 00000100:00100000:0.0:1789136336.294538:0:23334:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 23 00000100:00100000:0.0:1789136336.298003:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:2.0:1789136336.298264:0:23345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644781184 00000100:00100000:2.0:1789136336.298281:0:23345:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644781184 00000100:00100000:2.0:1789136336.298360:0:23345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 5 00000100:00100000:2.0:1789136336.298372:0:23345:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7c86df480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:bb852e64-3f46-4395-9dea-0822b7213ac8+7:18953:x1876044644781184:12345-192.168.201.31@tcp:900:lhsmtool_posix.0 00000100:00100000:2.0:1789136336.298503:0:23345:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7c86df480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:bb852e64-3f46-4395-9dea-0822b7213ac8+7:18953:x1876044644781184:12345-192.168.201.31@tcp:900:lhsmtool_posix.0 Request processed in 133us (508us total) trans 0 rc 0/0 00000100:00100000:2.0:1789136336.298511:0:23345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 5 00000100:00100000:3.0:1789136336.306341:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:0.0:1789136336.306478:0:23333:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644781440 00000100:00100000:0.0:1789136336.306492:0:23333:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644781440 00000100:00100000:0.0:1789136336.306915:0:23333:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 24 00000100:00100000:0.0:1789136336.306930:0:23333:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7c69e92c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bb852e64-3f46-4395-9dea-0822b7213ac8+7:18953:x1876044644781440:12345-192.168.201.31@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789136336.306966:0:23333:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789136336.306990:0:23333:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a7e1c9e200/0x559c8745c6de4a22 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa7228e7a1ab08fce expref: -99 pid: 23333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136336.307087:0:23333:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7e1c9fc00/0x559c8745c6de4a29 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 23333 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136336.307102:0:23333:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a7e1c9fc00/0x559c8745c6de4a29 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 23333 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136336.307115:0:23333:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a7e1c9fc00/0x559c8745c6de4a29 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 23333 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136336.307131:0:23333:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3caf400/0x559c8745c6de4a30 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 23333 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136336.307138:0:23333:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3caf400/0x559c8745c6de4a30 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 23333 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136336.307144:0:23333:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3caf400/0x559c8745c6de4a30 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 23333 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136336.307251:0:23333:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3cafa00/0x559c8745c6de4a37 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 23333 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136336.307260:0:23333:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3cafa00/0x559c8745c6de4a37 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 23333 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136336.307403:0:23333:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3cafa00/0x559c8745c6de4a37 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 23333 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789136336.307423:0:23333:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 4096 00010000:00010000:2.0:1789136336.308471:0:23333:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7e1c9fc00/0x559c8745c6de4a29 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 23333 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136336.308489:0:23333:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a7e1c9fc00/0x559c8745c6de4a29 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 23333 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136336.308496:0:23333:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a7e1c9fc00/0x559c8745c6de4a29 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 23333 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136336.308519:0:23333:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a7e1c9fc00 already unused, calling callback (ffffffffc19cc4f0) 00010000:00010000:2.0:1789136336.308524:0:23333:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a7e1c9fc00/0x559c8745c6de4a29 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 23333 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136336.308532:0:23333:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a7e1c9fc00/0x559c8745c6de4a29 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 23333 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136336.308551:0:23333:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff90a7fa5c0e00) 00010000:00010000:2.0:1789136336.308554:0:23333:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789136336.308559:0:23333:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a7e1c9fc00/0x559c8745c6de4a29 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 23333 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136336.308565:0:23333:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a7e1c9fc00/0x559c8745c6de4a29 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 23333 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136336.308585:0:23333:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3caf400/0x559c8745c6de4a30 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 23333 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136336.308591:0:23333:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3caf400/0x559c8745c6de4a30 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 23333 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136336.308596:0:23333:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3caf400/0x559c8745c6de4a30 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 23333 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136336.308601:0:23333:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a6c3caf400 already unused, calling callback (ffffffffc19cc4f0) 00010000:00010000:2.0:1789136336.308604:0:23333:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3caf400/0x559c8745c6de4a30 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 23333 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136336.308609:0:23333:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3caf400/0x559c8745c6de4a30 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 23333 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136336.308626:0:23333:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff90a7fa5c0900) 00010000:00010000:2.0:1789136336.308628:0:23333:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789136336.308631:0:23333:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3caf400/0x559c8745c6de4a30 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 23333 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136336.308637:0:23333:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3caf400/0x559c8745c6de4a30 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 23333 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136336.322510:0:23333:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a7e1c9e200/0x559c8745c6de4a22 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08fce expref: 10 pid: 23333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136336.322538:0:23333:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3cafa00/0x559c8745c6de4a37 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08fce expref: 9 pid: 23333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136336.322548:0:23333:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff90a7fa5c0b00) 00010000:00010000:2.0:1789136336.322551:0:23333:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789136336.322556:0:23333:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a6c3cafa00, rc 0) 00000100:00100000:2.0:1789136336.322642:0:23333:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7c69e92c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bb852e64-3f46-4395-9dea-0822b7213ac8+9:18953:x1876044644781440:12345-192.168.201.31@tcp:101:lhsmtool_posix.0 Request processed in 15715us (16315us total) trans 12884901889 rc 0/0 00000100:00100000:2.0:1789136336.322652:0:23333:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 24 00000100:00100000:0.0:1789136336.338612:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:3.0:1789136336.339007:0:23334:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644781568 00000100:00100000:3.0:1789136336.339023:0:23334:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644781568 00000100:00100000:3.0:1789136336.339099:0:23334:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 25 00000100:00100000:3.0:1789136336.339110:0:23334:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7c86de940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bb852e64-3f46-4395-9dea-0822b7213ac8+9:18953:x1876044644781568:12345-192.168.201.31@tcp:59:lhsmtool_posix.0 00000100:00100000:3.0:1789136336.339278:0:23334:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7c86de940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bb852e64-3f46-4395-9dea-0822b7213ac8+9:18953:x1876044644781568:12345-192.168.201.31@tcp:59:lhsmtool_posix.0 Request processed in 169us (674us total) trans 0 rc 0/0 00000100:00100000:3.0:1789136336.339287:0:23334:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 25 00000100:00100000:0.0:1789136336.352096:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:2.0:1789136336.352311:0:23333:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644781696 00000100:00100000:2.0:1789136336.352323:0:23333:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644781696 00000100:00100000:2.0:1789136336.352396:0:23333:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 26 00000100:00100000:2.0:1789136336.352407:0:23333:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7c86df840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bb852e64-3f46-4395-9dea-0822b7213ac8+5:18953:x1876044644781696:12345-192.168.201.31@tcp:59:lhsmtool_posix.0 00000004:00080000:3.0:1789136336.353881:0:23333:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0001: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0001 0, time 1421us 00000100:00100000:1.0:1789136336.379989:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:3.0:1789136336.380229:0:23334:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:3.0:1789136336.380241:0:23334:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00100000:3.0:1789136336.381736:0:23334:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644781824 00000100:00100000:3.0:1789136336.381748:0:23334:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644781824 00000100:00100000:1.0:1789136336.382011:0:26387:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 27 00000100:00100000:1.0:1789136336.382024:0:26387:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c47e70c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bb852e64-3f46-4395-9dea-0822b7213ac8+9:18959:x1876044644781824:12345-192.168.201.31@tcp:101:lfs.0 00010000:00010000:1.0:1789136336.382047:0:26387:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789136336.382071:0:26387:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3b4de00/0x559c8745c6de4a45 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa7228e7a1ab08fd5 expref: -99 pid: 26387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136336.382138:0:26387:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3b4c400/0x559c8745c6de4a4c lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 26387 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136336.382153:0:26387:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3b4c400/0x559c8745c6de4a4c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 26387 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136336.382166:0:26387:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3b4c400/0x559c8745c6de4a4c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 26387 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136336.382360:0:26387:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3b4cc00/0x559c8745c6de4a53 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 26387 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136336.382370:0:26387:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3b4cc00/0x559c8745c6de4a53 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 26387 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136336.382378:0:26387:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3b4cc00/0x559c8745c6de4a53 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 26387 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136336.382438:0:26387:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3b4c400/0x559c8745c6de4a4c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 26387 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136336.382445:0:26387:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3b4c400/0x559c8745c6de4a4c lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 26387 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136336.382461:0:26387:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3b4c400/0x559c8745c6de4a4c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 26387 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136336.382468:0:26387:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a6c3b4c400 already unused, calling callback (ffffffffc19cc4f0) 00010000:00010000:1.0:1789136336.382472:0:26387:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3b4c400/0x559c8745c6de4a4c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 26387 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136336.382480:0:26387:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3b4c400/0x559c8745c6de4a4c lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 26387 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136336.382493:0:26387:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90a7fa5c0a00) 00010000:00010000:1.0:1789136336.382496:0:26387:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789136336.382501:0:26387:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3b4c400/0x559c8745c6de4a4c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 26387 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136336.382508:0:26387:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3b4c400/0x559c8745c6de4a4c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 26387 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136336.382523:0:26387:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3b4cc00/0x559c8745c6de4a53 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 26387 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136336.382529:0:26387:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3b4cc00/0x559c8745c6de4a53 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 26387 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136336.382534:0:26387:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3b4cc00/0x559c8745c6de4a53 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 26387 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136336.382539:0:26387:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a6c3b4cc00 already unused, calling callback (ffffffffc19cc4f0) 00010000:00010000:1.0:1789136336.382542:0:26387:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3b4cc00/0x559c8745c6de4a53 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 26387 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136336.382558:0:26387:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3b4cc00/0x559c8745c6de4a53 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 26387 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136336.382566:0:26387:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa6028a67 (ffff90a7d61d3100) 00010000:00010000:1.0:1789136336.382568:0:26387:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789136336.382571:0:26387:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3b4cc00/0x559c8745c6de4a53 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 26387 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136336.382578:0:26387:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3b4cc00/0x559c8745c6de4a53 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 26387 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136336.382612:0:26387:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3b4de00/0x559c8745c6de4a45 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08fd5 expref: 10 pid: 26387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136336.382624:0:26387:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90a7fa5c0a00) 00010000:00010000:1.0:1789136336.382627:0:26387:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789136336.382631:0:26387:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3b4de00/0x559c8745c6de4a45 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08fd5 expref: 10 pid: 26387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136336.382644:0:26387:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a6c3b4de00, rc 0) 00000100:00100000:1.0:1789136336.382769:0:26387:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c47e70c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bb852e64-3f46-4395-9dea-0822b7213ac8+9:18959:x1876044644781824:12345-192.168.201.31@tcp:101:lfs.0 Request processed in 748us (2790us total) trans 0 rc 301/301 00000100:00100000:1.0:1789136336.382778:0:26387:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 27 00000100:00100000:2.0:1789136336.394949:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:3.0:1789136336.396809:0:23342:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644781952 00000100:00100000:3.0:1789136336.396823:0:23342:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644781952 00000100:00100000:3.0:1789136336.396903:0:23342:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 0 00000100:00100000:3.0:1789136336.396914:0:23342:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7fe5ede00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:bb852e64-3f46-4395-9dea-0822b7213ac8+9:18959:x1876044644781952:12345-192.168.201.31@tcp:700:lfs.0 00000100:00100000:3.0:1789136336.397002:0:23342:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7fe5ede00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:bb852e64-3f46-4395-9dea-0822b7213ac8+9:18959:x1876044644781952:12345-192.168.201.31@tcp:700:lfs.0 Request processed in 89us (2064us total) trans 0 rc 0/0 00000100:00100000:3.0:1789136336.397010:0:23342:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 0 00000100:00100000:3.0:1789136336.400669:0:23333:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7c86df840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bb852e64-3f46-4395-9dea-0822b7213ac8+5:18953:x1876044644781696:12345-192.168.201.31@tcp:59:lhsmtool_posix.0 Request processed in 48253us (48572us total) trans 0 rc 0/0 00000100:00100000:3.0:1789136336.400685:0:23333:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 26 00000100:00100000:3.0:1789136336.405532:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:2.0:1789136336.405716:0:23334:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644782208 00000100:00100000:2.0:1789136336.405726:0:23334:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644782208 00000100:00100000:2.0:1789136336.405802:0:23334:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 28 00000100:00100000:2.0:1789136336.405813:0:23334:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7c69e8780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bb852e64-3f46-4395-9dea-0822b7213ac8+9:18959:x1876044644782208:12345-192.168.201.31@tcp:36:lfs.0 00010000:00010000:2.0:1789136336.405901:0:23334:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789136336.405930:0:23334:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3caf800/0x559c8745c6de4973 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08f42 expref: 9 pid: 23334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136336.405950:0:23334:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90a7fa5c0a00) 00010000:00010000:2.0:1789136336.405956:0:23334:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789136336.406020:0:23334:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c0031200/0x559c8745c6de4a5a lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 23334 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136336.406035:0:23334:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c0031400/0x559c8745c6de49b2 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08fb2 expref: 5 pid: 23334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136336.406046:0:23334:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c0031200/0x559c8745c6de4a5a lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 23334 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136336.406082:0:23334:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c0031400/0x559c8745c6de49b2 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08fb2 expref: 5 pid: 23334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136336.406096:0:23334:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c0031400/0x559c8745c6de49b2 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08fb2 expref: 5 pid: 23334 timeout: 884 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789136336.406111:0:23334:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7fe5ef840 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:23334:1876044666939904:192.168.201.31@tcp:104: 00000100:00100000:2.0:1789136336.406275:0:23334:0:(client.c:2715:ptlrpc_set_wait()) set ffff90a7c8646f00 going to sleep for 11 seconds 00000100:00100000:2.0:1789136336.411114:0:23334:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7fe5ef840 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:23334:1876044666939904:192.168.201.31@tcp:104: 00010000:00010000:2.0:1789136336.411151:0:23334:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c0031200/0x559c8745c6de4a5a lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 23334 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789136336.413298:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:3.0:1789136336.413897:0:26370:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644782336 00000100:00100000:3.0:1789136336.413908:0:26370:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644782336 00010000:00010000:3.0:1789136336.413952:0:26370:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c0031400/0x559c8745c6de49b2 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08fb2 expref: 6 pid: 23334 timeout: 884 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789136336.414006:0:26370:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 15 00000100:00100000:3.0:1789136336.414016:0:26370:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7fe5ef840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a4039233-0823-4bef-b733-24ab7c889e38+6:2391:x1876044644782336:12345-192.168.201.31@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789136336.414033:0:26370:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789136336.414040:0:26370:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c0031400/0x559c8745c6de49b2 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08fb2 expref: 6 pid: 23334 timeout: 884 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136336.414053:0:26370:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c0031400/0x559c8745c6de49b2 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08fb2 expref: 6 pid: 23334 timeout: 884 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136336.414079:0:26370:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c0031400/0x559c8745c6de49b2 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08fb2 expref: 6 pid: 23334 timeout: 884 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136336.414100:0:26370:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90a7fa5c0a00) 00010000:00010000:3.0:1789136336.414106:0:26370:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c0031200/0x559c8745c6de4a5a lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 23334 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136336.414116:0:26370:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c0031200/0x559c8745c6de4a5a lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 23334 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136336.414124:0:26370:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c0031200/0x559c8745c6de4a5a lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 23334 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136336.414155:0:26370:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789136336.414217:0:26370:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7fe5ef840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a4039233-0823-4bef-b733-24ab7c889e38+5:2391:x1876044644782336:12345-192.168.201.31@tcp:103:ldlm_bl.0 Request processed in 202us (928us total) trans 0 rc 0/0 00000100:00100000:3.0:1789136336.414225:0:26370:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 15 00010000:00010000:1.0:1789136336.415994:0:23334:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c0031200/0x559c8745c6de4a5a lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 23334 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136336.416010:0:23334:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c0031200/0x559c8745c6de4a5a lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 23334 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136336.416054:0:23334:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3b4de00/0x559c8745c6de4a61 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 23334 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136336.416066:0:23334:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3b4de00/0x559c8745c6de4a61 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 23334 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136336.416076:0:23334:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3b4de00/0x559c8745c6de4a61 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 23334 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136336.419790:0:23334:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3b4cc00/0x559c8745c6de4a68 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 23334 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136336.419814:0:23334:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3b4cc00/0x559c8745c6de4a68 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 23334 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136336.419825:0:23334:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3b4cc00/0x559c8745c6de4a68 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 23334 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789136336.419843:0:23334:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 0000000084c81551 reply state 000000006ea03203 transno 12884901890 ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3b4cc00/0x559c8745c6de4a68 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 23334 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136336.420160:0:23334:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3b4cc00/0x559c8745c6de4a68 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 23334 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136336.420168:0:23334:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff90a7d61d3600) 00010000:00010000:1.0:1789136336.420171:0:23334:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1789136336.420174:0:23334:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:1.0:1789136336.420301:0:23334:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00010000:00010000:1.0:1789136336.420312:0:23334:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c0031200/0x559c8745c6de4a5a lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 23334 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136336.420320:0:23334:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c0031200/0x559c8745c6de4a5a lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 23334 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136336.420336:0:23334:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c0031200/0x559c8745c6de4a5a lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 23334 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136336.420342:0:23334:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a7c0031200 already unused, calling callback (ffffffffc19cc4f0) 00010000:00010000:1.0:1789136336.420347:0:23334:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c0031200/0x559c8745c6de4a5a lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 23334 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136336.420355:0:23334:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c0031200/0x559c8745c6de4a5a lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 23334 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136336.420367:0:23334:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90a7fa5c0a00) 00010000:00010000:1.0:1789136336.420370:0:23334:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789136336.420373:0:23334:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c0031200/0x559c8745c6de4a5a lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 23334 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136336.420379:0:23334:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c0031200/0x559c8745c6de4a5a lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 23334 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789136336.420399:0:23334:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 0000000084c81551 reply state 000000006ea03203 transno 12884901890 ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3b4de00/0x559c8745c6de4a61 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 23334 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136336.420407:0:23334:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3b4de00/0x559c8745c6de4a61 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 23334 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136336.420425:0:23334:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa6028a67 (ffff90a7d61d3100) 00010000:00010000:1.0:1789136336.420428:0:23334:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1789136336.420430:0:23334:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000100:00100000:1.0:1789136336.420567:0:23334:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7c69e8780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bb852e64-3f46-4395-9dea-0822b7213ac8+10:18959:x1876044644782208:12345-192.168.201.31@tcp:36:lfs.0 Request processed in 14750us (15040us total) trans 12884901890 rc 0/0 00000100:00100000:1.0:1789136336.420577:0:23334:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 28 00000100:00100000:2.0:1789136336.578998:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:1.0:1789136336.584175:0:26387:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644782464 00000100:00100000:1.0:1789136336.584203:0:26387:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644782464 00000100:00100000:1.0:1789136336.584326:0:26387:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 29 00000100:00100000:1.0:1789136336.584340:0:26387:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7fe5ec3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bb852e64-3f46-4395-9dea-0822b7213ac8+10:18967:x1876044644782464:12345-192.168.201.31@tcp:101:lctl.0 00010000:00010000:1.0:1789136336.584385:0:26387:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789136336.584426:0:26387:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3b4c400/0x559c8745c6de4a6f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa7228e7a1ab08fdc expref: -99 pid: 26387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136336.584535:0:26387:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3b4dc00/0x559c8745c6de4a76 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 26387 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136336.584554:0:26387:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3b4dc00/0x559c8745c6de4a76 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 26387 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136336.584568:0:26387:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3b4dc00/0x559c8745c6de4a76 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 26387 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789136336.584627:0:26387:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1789136336.584631:0:26387:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1789136336.584678:0:26387:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3b4dc00/0x559c8745c6de4a76 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 26387 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136336.584709:0:26387:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3b4c400/0x559c8745c6de4a6f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08fdc expref: 12 pid: 26387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136336.584736:0:26387:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3b4dc00/0x559c8745c6de4a76 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08fdc expref: 11 pid: 26387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136336.584747:0:26387:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90a7d61d3200) 00010000:00010000:1.0:1789136336.584750:0:26387:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789136336.584774:0:26387:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a6c3b4dc00, rc 0) 00000100:00100000:1.0:1789136336.584924:0:26387:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7fe5ec3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bb852e64-3f46-4395-9dea-0822b7213ac8+11:18967:x1876044644782464:12345-192.168.201.31@tcp:101:lctl.0 Request processed in 585us (5942us total) trans 0 rc 0/0 00000100:00100000:1.0:1789136336.584933:0:26387:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 29 00010000:00010000:2.0:1789136336.618961:0:23320:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789136336.650365:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:3.0:1789136336.651117:0:23332:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644782592 00000100:00100000:3.0:1789136336.651144:0:23332:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644782592 00000100:00100000:3.0:1789136336.651215:0:23332:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 30 00000100:00100000:3.0:1789136336.651226:0:23332:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7fe5efc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a4039233-0823-4bef-b733-24ab7c889e38+5:18968:x1876044644782592:12345-192.168.201.31@tcp:101:lfs.0 00010000:00010000:3.0:1789136336.651250:0:23332:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789136336.651274:0:23332:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ff5f4000/0x559c8745c6de4a7d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa7228e7a1ab08fe3 expref: -99 pid: 23332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136336.651344:0:23332:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ff5f5800/0x559c8745c6de4a84 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 23332 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136336.651358:0:23332:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ff5f5800/0x559c8745c6de4a84 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 23332 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136336.651373:0:23332:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ff5f5800/0x559c8745c6de4a84 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 23332 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789136336.651429:0:23332:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1789136336.651433:0:23332:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1789136336.651464:0:23332:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ff5f5800/0x559c8745c6de4a84 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 23332 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136336.651490:0:23332:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ff5f4000/0x559c8745c6de4a7d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08fe3 expref: 7 pid: 23332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136336.651511:0:23332:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ff5f5800/0x559c8745c6de4a84 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08fe3 expref: 6 pid: 23332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136336.651520:0:23332:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90a7d61d3200) 00010000:00010000:3.0:1789136336.651524:0:23332:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789136336.651528:0:23332:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a7ff5f5800, rc 0) 00000100:00100000:3.0:1789136336.651657:0:23332:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7fe5efc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a4039233-0823-4bef-b733-24ab7c889e38+6:18968:x1876044644782592:12345-192.168.201.31@tcp:101:lfs.0 Request processed in 433us (1303us total) trans 0 rc 0/0 00000100:00100000:3.0:1789136336.651665:0:23332:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 30 00000100:00100000:0.0:1789136336.663256:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:1.0:1789136336.663414:0:26387:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644782720 00000100:00100000:1.0:1789136336.663425:0:26387:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644782720 00000100:00100000:1.0:1789136336.663532:0:26387:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 31 00000100:00100000:1.0:1789136336.663543:0:26387:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7c86dda40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a4039233-0823-4bef-b733-24ab7c889e38+6:18968:x1876044644782720:12345-192.168.201.31@tcp:101:lfs.0 00010000:00010000:1.0:1789136336.663567:0:26387:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789136336.663590:0:26387:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3b4c400/0x559c8745c6de4a8b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa7228e7a1ab08fea expref: -99 pid: 26387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136336.663677:0:26387:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3b4c600/0x559c8745c6de4a92 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 26387 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136336.663692:0:26387:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3b4c600/0x559c8745c6de4a92 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 26387 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136336.663705:0:26387:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3b4c600/0x559c8745c6de4a92 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 26387 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136336.663717:0:26387:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3b4d400/0x559c8745c6de4a99 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 26387 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136336.663723:0:26387:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3b4d400/0x559c8745c6de4a99 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 26387 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136336.663729:0:26387:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3b4d400/0x559c8745c6de4a99 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 26387 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136336.663804:0:26387:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3b4d800/0x559c8745c6de4aa0 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 26387 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136336.663828:0:26387:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3b4d800/0x559c8745c6de4aa0 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 26387 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136336.663835:0:26387:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3b4d800/0x559c8745c6de4aa0 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 26387 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789136336.664163:0:26387:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1789136336.664168:0:26387:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1789136336.664189:0:26387:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3b4d800/0x559c8745c6de4aa0 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 26387 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136336.664203:0:26387:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3b4c600/0x559c8745c6de4a92 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 26387 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136336.664211:0:26387:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3b4c600/0x559c8745c6de4a92 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 26387 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136336.664217:0:26387:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3b4c600/0x559c8745c6de4a92 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 26387 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136336.664223:0:26387:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a6c3b4c600 already unused, calling callback (ffffffffc19cc4f0) 00010000:00010000:1.0:1789136336.664227:0:26387:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3b4c600/0x559c8745c6de4a92 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 26387 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136336.664234:0:26387:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3b4c600/0x559c8745c6de4a92 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 26387 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136336.664247:0:26387:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90a7d61d3200) 00010000:00010000:1.0:1789136336.664250:0:26387:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789136336.664255:0:26387:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3b4c600/0x559c8745c6de4a92 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 26387 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136336.664273:0:26387:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3b4c600/0x559c8745c6de4a92 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 26387 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136336.664290:0:26387:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3b4d400/0x559c8745c6de4a99 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 26387 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136336.664295:0:26387:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3b4d400/0x559c8745c6de4a99 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 26387 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136336.664300:0:26387:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3b4d400/0x559c8745c6de4a99 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 26387 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136336.664304:0:26387:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a6c3b4d400 already unused, calling callback (ffffffffc19cc4f0) 00010000:00010000:1.0:1789136336.664307:0:26387:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3b4d400/0x559c8745c6de4a99 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 26387 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136336.664312:0:26387:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3b4d400/0x559c8745c6de4a99 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 26387 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136336.664320:0:26387:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa6028a67 (ffff90a7d61d3100) 00010000:00010000:1.0:1789136336.664322:0:26387:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789136336.664325:0:26387:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3b4d400/0x559c8745c6de4a99 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 26387 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136336.664330:0:26387:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3b4d400/0x559c8745c6de4a99 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 26387 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136336.664359:0:26387:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3b4c400/0x559c8745c6de4a8b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08fea expref: 8 pid: 26387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136336.664384:0:26387:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3b4d800/0x559c8745c6de4aa0 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08fea expref: 7 pid: 26387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136336.664392:0:26387:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff90a7d61d3600) 00010000:00010000:1.0:1789136336.664394:0:26387:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789136336.664397:0:26387:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a6c3b4d800, rc 0) 00000100:00100000:1.0:1789136336.664474:0:26387:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7c86dda40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a4039233-0823-4bef-b733-24ab7c889e38+7:18968:x1876044644782720:12345-192.168.201.31@tcp:101:lfs.0 Request processed in 933us (1229us total) trans 0 rc 0/0 00000100:00100000:1.0:1789136336.664483:0:26387:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 31 00000100:00100000:2.0:1789136336.675096:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:0.0:1789136336.675194:0:23345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644782848 00000100:00100000:0.0:1789136336.675205:0:23345:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644782848 00000100:00100000:0.0:1789136336.675266:0:23345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 6 00000100:00100000:0.0:1789136336.675277:0:23345:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7fe5ee580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:a4039233-0823-4bef-b733-24ab7c889e38+5:18968:x1876044644782848:12345-192.168.201.31@tcp:900:lfs.0 00000100:00100000:0.0:1789136336.675373:0:23345:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7fe5ee580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:a4039233-0823-4bef-b733-24ab7c889e38+5:18968:x1876044644782848:12345-192.168.201.31@tcp:900:lfs.0 Request processed in 98us (288us total) trans 0 rc 0/0 00000100:00100000:0.0:1789136336.675382:0:23345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 6 00000100:00100000:2.0:1789136336.685676:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:1.0:1789136336.685829:0:23334:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644783104 00000100:00100000:1.0:1789136336.686028:0:23334:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644783104 00000100:00100000:1.0:1789136336.686095:0:23334:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 32 00000100:00100000:1.0:1789136336.686106:0:23334:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7fe5eed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a4039233-0823-4bef-b733-24ab7c889e38+7:18968:x1876044644783104:12345-192.168.201.31@tcp:101:lfs.0 00010000:00010000:1.0:1789136336.686131:0:23334:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789136336.686154:0:23334:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3b4d400/0x559c8745c6de4aa7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa7228e7a1ab08ff1 expref: -99 pid: 23334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789136336.686260:0:23334:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00010000:00010000:1.0:1789136336.686374:0:23334:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3b4d400/0x559c8745c6de4aa7 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08ff1 expref: 9 pid: 23334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136336.686389:0:23334:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90a7d61d3200) 00010000:00010000:1.0:1789136336.686393:0:23334:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1789136336.686398:0:23334:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3b4d400/0x559c8745c6de4aa7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08ff1 expref: 9 pid: 23334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136336.686448:0:23334:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a6c3b4d400, rc 0) 00000100:00100000:1.0:1789136336.686512:0:23334:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7fe5eed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a4039233-0823-4bef-b733-24ab7c889e38+8:18968:x1876044644783104:12345-192.168.201.31@tcp:101:lfs.0 Request processed in 407us (847us total) trans 12884901891 rc 301/301 00000100:00100000:1.0:1789136336.686521:0:23334:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 32 00000100:00100000:1.0:1789136336.690933:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:3.0:1789136336.691046:0:23333:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644783360 00000100:00100000:3.0:1789136336.691064:0:23333:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644783360 00000100:00100000:2.0:1789136336.691274:0:23333:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 33 00000100:00100000:2.0:1789136336.691287:0:23333:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c47e43c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a4039233-0823-4bef-b733-24ab7c889e38+8:18968:x1876044644783360:12345-192.168.201.31@tcp:36:lfs.0 00010000:00010000:2.0:1789136336.691345:0:23333:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789136336.691375:0:23333:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3b4d800/0x559c8745c6de4aa0 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08fea expref: 8 pid: 26387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136336.691399:0:23333:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff90a7d61d3600) 00010000:00010000:2.0:1789136336.691414:0:23333:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789136336.691437:0:23333:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c0031200/0x559c8745c6de4ab5 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 23333 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136336.691451:0:23333:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c0031200/0x559c8745c6de4ab5 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 23333 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136336.691460:0:23333:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c0031200/0x559c8745c6de4ab5 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 23333 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789136336.691653:0:23333:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 000000007165796c reply state 00000000ec14458e transno 12884901892 ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c0031200/0x559c8745c6de4ab5 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 23333 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136336.691666:0:23333:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c0031200/0x559c8745c6de4ab5 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 23333 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136336.691693:0:23333:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff90a7d61d3600) 00010000:00010000:2.0:1789136336.691695:0:23333:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00000100:00100000:2.0:1789136336.691699:0:23333:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:2.0:1789136336.691706:0:23333:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00000100:00100000:2.0:1789136336.691796:0:23333:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c47e43c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a4039233-0823-4bef-b733-24ab7c889e38+9:18968:x1876044644783360:12345-192.168.201.31@tcp:36:lfs.0 Request processed in 508us (868us total) trans 12884901892 rc 0/0 00000100:00100000:2.0:1789136336.691804:0:23333:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 33 00000100:00100000:2.0:1789136336.697045:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:0.0:1789136336.697158:0:23336:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644783616 00000100:00100000:0.0:1789136336.697170:0:23336:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644783616 00000100:00100000:0.0:1789136336.697238:0:23336:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 2 00000100:00100000:0.0:1789136336.697249:0:23336:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7fe5ed2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a4039233-0823-4bef-b733-24ab7c889e38+9:18968:x1876044644783616:12345-192.168.201.31@tcp:35:lfs.0 00000100:00100000:0.0:1789136336.697702:0:23336:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7fe5ed2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a4039233-0823-4bef-b733-24ab7c889e38+10:18968:x1876044644783616:12345-192.168.201.31@tcp:35:lfs.0 Request processed in 453us (665us total) trans 12884901893 rc 0/0 00000100:00100000:0.0:1789136336.697710:0:23336:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 2 00000100:00100000:2.0:1789136336.705293:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:1.0:1789136336.705437:0:23334:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644783872 00000100:00100000:1.0:1789136336.705448:0:23334:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644783872 00000100:00100000:1.0:1789136336.705509:0:23334:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 34 00000100:00100000:1.0:1789136336.705518:0:23334:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7fe5eda40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a4039233-0823-4bef-b733-24ab7c889e38+10:18968:x1876044644783872:12345-192.168.201.31@tcp:101:lfs.0 00010000:00010000:1.0:1789136336.705543:0:23334:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789136336.705564:0:23334:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3b4c600/0x559c8745c6de4abc lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa7228e7a1ab08ff8 expref: -99 pid: 23334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136336.705632:0:23334:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3b4ca00/0x559c8745c6de4ac3 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 23334 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136336.705646:0:23334:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3b4ca00/0x559c8745c6de4ac3 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 23334 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136336.705657:0:23334:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3b4ca00/0x559c8745c6de4ac3 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 23334 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136336.705672:0:23334:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3b4c000/0x559c8745c6de4aca lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 23334 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136336.705679:0:23334:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3b4c000/0x559c8745c6de4aca lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 23334 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136336.705702:0:23334:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3b4c000/0x559c8745c6de4aca lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 23334 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789136336.705794:0:23334:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00010000:00010000:1.0:1789136336.705918:0:23334:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3b4ca00/0x559c8745c6de4ac3 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 23334 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136336.705925:0:23334:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3b4ca00/0x559c8745c6de4ac3 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 23334 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136336.705932:0:23334:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3b4ca00/0x559c8745c6de4ac3 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 23334 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136336.705938:0:23334:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a6c3b4ca00 already unused, calling callback (ffffffffc19cc4f0) 00010000:00010000:1.0:1789136336.705942:0:23334:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3b4ca00/0x559c8745c6de4ac3 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 23334 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136336.705949:0:23334:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3b4ca00/0x559c8745c6de4ac3 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 23334 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136336.705961:0:23334:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90a7d61d3200) 00010000:00010000:1.0:1789136336.705964:0:23334:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789136336.705968:0:23334:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3b4ca00/0x559c8745c6de4ac3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 23334 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136336.705974:0:23334:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3b4ca00/0x559c8745c6de4ac3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 23334 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136336.705988:0:23334:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3b4c000/0x559c8745c6de4aca lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 23334 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136336.706003:0:23334:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3b4c000/0x559c8745c6de4aca lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 23334 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136336.706009:0:23334:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3b4c000/0x559c8745c6de4aca lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 23334 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136336.706013:0:23334:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a6c3b4c000 already unused, calling callback (ffffffffc19cc4f0) 00010000:00010000:1.0:1789136336.706017:0:23334:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3b4c000/0x559c8745c6de4aca lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 23334 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136336.706023:0:23334:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3b4c000/0x559c8745c6de4aca lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 23334 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136336.706031:0:23334:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa6028a67 (ffff90a7d61d3100) 00010000:00010000:1.0:1789136336.706033:0:23334:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789136336.706036:0:23334:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3b4c000/0x559c8745c6de4aca lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 23334 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136336.706041:0:23334:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3b4c000/0x559c8745c6de4aca lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 23334 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136336.706077:0:23334:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3b4c600/0x559c8745c6de4abc lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08ff8 expref: 12 pid: 23334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136336.706086:0:23334:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90a7d61d3200) 00010000:00010000:1.0:1789136336.706088:0:23334:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1789136336.706092:0:23334:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3b4c600/0x559c8745c6de4abc lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08ff8 expref: 12 pid: 23334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136336.706110:0:23334:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a6c3b4c600, rc 0) 00000100:00100000:1.0:1789136336.706177:0:23334:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7fe5eda40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a4039233-0823-4bef-b733-24ab7c889e38+11:18968:x1876044644783872:12345-192.168.201.31@tcp:101:lfs.0 Request processed in 658us (894us total) trans 12884901894 rc 301/301 00000100:00100000:1.0:1789136336.706185:0:23334:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 34 00000100:00100000:1.0:1789136336.714482:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:2.0:1789136336.714655:0:23333:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644784000 00000100:00100000:2.0:1789136336.714665:0:23333:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644784000 00000100:00100000:2.0:1789136336.714728:0:23333:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 35 00000100:00100000:2.0:1789136336.714739:0:23333:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c47e6940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a4039233-0823-4bef-b733-24ab7c889e38+11:18968:x1876044644784000:12345-192.168.201.31@tcp:101:lfs.0 00010000:00010000:2.0:1789136336.714764:0:23333:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789136336.714787:0:23333:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c0031800/0x559c8745c6de4ad8 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa7228e7a1ab08fff expref: -99 pid: 23333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136336.715014:0:23333:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c0031400/0x559c8745c6de4adf lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 23333 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136336.715030:0:23333:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c0031400/0x559c8745c6de4adf lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 23333 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136336.715043:0:23333:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c0031400/0x559c8745c6de4adf lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 23333 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789136336.715067:0:23333:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1789136336.715071:0:23333:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1789136336.715107:0:23333:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c0031400/0x559c8745c6de4adf lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 23333 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136336.715139:0:23333:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c0031800/0x559c8745c6de4ad8 lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08fff expref: 13 pid: 23333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136336.715156:0:23333:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c0031400/0x559c8745c6de4adf lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08fff expref: 12 pid: 23333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136336.715164:0:23333:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff90a7d61d3600) 00010000:00010000:2.0:1789136336.715167:0:23333:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789136336.715171:0:23333:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a7c0031400, rc 0) 00000100:00100000:2.0:1789136336.715333:0:23333:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c47e6940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a4039233-0823-4bef-b733-24ab7c889e38+12:18968:x1876044644784000:12345-192.168.201.31@tcp:101:lfs.0 Request processed in 595us (860us total) trans 0 rc 0/0 00000100:00100000:2.0:1789136336.715341:0:23333:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 35 00000100:00100000:2.0:1789136336.725041:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:3.0:1789136336.737070:0:23335:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644784128 00000100:00100000:3.0:1789136336.737092:0:23335:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644784128 00000100:00100000:2.0:1789136336.738432:0:23335:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 3 00000100:00100000:2.0:1789136336.738449:0:23335:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7fe5ec780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a4039233-0823-4bef-b733-24ab7c889e38+12:18968:x1876044644784128:12345-192.168.201.31@tcp:37:lfs.0 00000100:00100000:1.0:1789136336.745092:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c47e4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1876044666940160:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789136336.745175:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789136336.745176:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789136336.745206:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7c69e8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1876044666940032:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1789136336.745248:0:24848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666940160 00000100:00100000:1.0:1789136336.745257:0:24848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666940160 00000100:00100000:3.0:1789136336.745278:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789136336.745312:0:24848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666940032 00000100:00100000:1.0:1789136336.745318:0:24848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666940032 00000100:00100000:3.0:1789136336.745350:0:24849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1789136336.745675:0:24849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7f662cf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1876044666940160:12345-0@lo:13:osp-pre-1-0.0 00000100:00080000:1.0:1789136336.748196:0:23328:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789136336.748267:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789136336.748306:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7c14b6940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1876044666940544:0@lo:400:kworker.0 00000100:00100000:1.0:1789136336.748380:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7fe5ef0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1876044666940288:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1789136336.748520:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789136336.748562:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c3ce8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1876044666940800:0@lo:400:kworker.0 00000100:00100000:1.0:1789136336.748605:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789136336.748636:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c4762580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3639:1876044666941312:0@lo:400:kworker.0 00000100:00100000:1.0:1789136336.748664:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789136336.748688:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1789136336.748694:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7c14b6d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3639:1876044666940672:0@lo:400:kworker.0 00000100:00100000:1.0:1789136336.748717:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789136336.748736:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c3ce83c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3639:1876044666941184:0@lo:400:kworker.0 00000100:00100000:1.0:1789136336.748758:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789136336.748795:0:23338:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666940288 00000100:00100000:1.0:1789136336.748809:0:23338:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666940288 00000100:00100000:1.0:1789136336.748969:0:23338:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666940800 00000100:00100000:1.0:1789136336.748973:0:23338:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666940800 00000100:00100000:1.0:1789136336.749003:0:23338:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1789136336.749012:0:23338:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7f02bb840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3639:x1876044666940288:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1789136336.749050:0:23338:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00002000:00000024:3.0:1789136336.751063:0:24849:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923501056 avail 3691978752 00000100:00100000:3.0:1789136336.751142:0:24849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7f662cf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1876044666940160:12345-0@lo:13:osp-pre-1-0.0 Request processed in 5473us (5967us total) trans 0 rc 0/0 00000100:00100000:3.0:1789136336.751153:0:24849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1789136336.751186:0:24849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1789136336.751199:0:24849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7c69ead00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1876044666940032:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1789136336.751223:0:24849:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923501056 avail 3691978752 00000100:00100000:3.0:1789136336.751256:0:24849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7c69ead00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1876044666940032:12345-0@lo:13:osp-pre-1-1.0 Request processed in 62us (5981us total) trans 0 rc 0/0 00000100:00100000:3.0:1789136336.751262:0:24849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1789136336.751303:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c3ce9680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3640:1876044666940928:0@lo:400:kworker.0 00000100:00100000:3.0:1789136336.751342:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789136336.751377:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7fa398b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3640:1876044666941440:0@lo:400:kworker.0 00000100:00100000:3.0:1789136336.752014:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789136336.752082:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7c69e8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1876044666940032:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1789136336.752112:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789136336.752121:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c3cebc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3640:1876044666941056:0@lo:400:kworker.0 00000100:00100000:3.0:1789136336.753950:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789136336.754125:0:23333:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666941312 00000100:00100000:3.0:1789136336.754133:0:23333:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666941312 00000100:00100000:3.0:1789136336.754192:0:23333:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666940672 00000100:00100000:3.0:1789136336.754195:0:23333:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666940672 00000100:00100000:3.0:1789136336.754206:0:23333:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666941184 00000100:00100000:3.0:1789136336.754208:0:23333:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666941184 00000100:00100000:3.0:1789136336.754220:0:23333:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666940928 00000100:00100000:3.0:1789136336.754222:0:23333:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666940928 00000100:00100000:3.0:1789136336.754233:0:23333:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666941440 00000100:00100000:3.0:1789136336.754235:0:23333:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666941440 00000100:00100000:3.0:1789136336.754244:0:23333:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666941056 00000100:00100000:3.0:1789136336.754246:0:23333:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666941056 00000100:00100000:3.0:1789136336.754258:0:23333:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1789136336.754266:0:23333:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7f02b92c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3639:x1876044666941312:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789136336.754322:0:23333:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7f02b92c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3639:x1876044666941312:12345-0@lo:400:kworker.0 Request processed in 57us (5658us total) trans 0 rc 0/0 00000100:00100000:3.0:1789136336.754329:0:23333:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1789136336.754345:0:23333:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1789136336.754350:0:23333:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7f02b8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3639:x1876044666940672:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789136336.754377:0:23333:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7f02b8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3639:x1876044666940672:12345-0@lo:400:kworker.0 Request processed in 27us (5660us total) trans 0 rc 0/0 00000100:00100000:3.0:1789136336.754383:0:23333:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1789136336.754393:0:23333:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1789136336.754399:0:23333:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7f02b8b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3639:x1876044666941184:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789136336.754605:0:23335:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7fe5ec780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a4039233-0823-4bef-b733-24ab7c889e38+12:18968:x1876044644784128:12345-192.168.201.31@tcp:37:lfs.0 Request processed in 16147us (29566us total) trans 0 rc 0/0 00000100:00100000:2.0:1789136336.754621:0:23335:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 3 00000100:00100000:3.0:1789136336.755018:0:23333:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7f02b8b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3639:x1876044666941184:12345-0@lo:400:kworker.0 Request processed in 617us (6256us total) trans 0 rc 0/0 00000100:00100000:3.0:1789136336.755027:0:23333:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1789136336.755049:0:23333:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1789136336.755059:0:23333:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7c69eb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3640:x1876044666940928:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789136336.755105:0:23333:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7c69eb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3640:x1876044666940928:12345-0@lo:400:kworker.0 Request processed in 49us (3763us total) trans 0 rc 0/0 00000100:00100000:3.0:1789136336.755112:0:23333:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1789136336.755159:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c3ce9680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3640:1876044666940928:0@lo:400:kworker.0 00000100:00100000:3.0:1789136336.755187:0:23333:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1789136336.755193:0:23333:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7d55ac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3640:x1876044666941440:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789136336.755227:0:23333:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7d55ac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3640:x1876044666941440:12345-0@lo:400:kworker.0 Request processed in 35us (3217us total) trans 0 rc 0/0 00000100:00100000:3.0:1789136336.755233:0:23333:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00010000:00080000:3.0:1789136336.755259:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90a7fa398b40 x1876044666941440/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789136352 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789136336.755272:0:23338:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7f02bb840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3639:x1876044666940288:12345-0@lo:41:osp-pre-1-0.0 Request processed in 206us (699us total) trans 0 rc 0/0 00000100:00100000:3.0:1789136336.755275:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7fa398b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3640:1876044666941440:0@lo:400:kworker.0 00000100:00100000:1.0:1789136336.755290:0:23338:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1789136336.755301:0:23333:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1789136336.755310:0:23333:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7d55ac3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3640:x1876044666941056:12345-0@lo:400:kworker.0 00000100:00080000:1.0:1789136336.755322:0:23328:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1789136336.755328:0:23328:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789136336.755347:0:23333:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7d55ac3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3640:x1876044666941056:12345-0@lo:400:kworker.0 Request processed in 38us (1403us total) trans 0 rc 0/0 00000100:00100000:3.0:1789136336.755355:0:23333:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1789136336.755374:0:24077:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1789136336.755379:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c3cebc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3640:1876044666941056:0@lo:400:kworker.0 00000100:00100000:1.0:1789136336.755386:0:24077:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7f02ba580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3639:x1876044666940800:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789136336.755439:0:24077:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7f02ba580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3639:x1876044666940800:12345-0@lo:400:kworker.0 Request processed in 56us (6833us total) trans 0 rc 0/0 00000100:00100000:1.0:1789136336.755446:0:24077:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1789136336.755491:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c47e4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1876044666940160:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789136336.755521:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7c14b6d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3639:1876044666940672:0@lo:400:kworker.0 00010000:00080000:1.0:1789136336.755532:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90a6c3ce83c0 x1876044666941184/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789136352 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789136336.755542:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c3ce83c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3639:1876044666941184:0@lo:400:kworker.0 00000100:00100000:1.0:1789136336.755559:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7fe5ef0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1876044666940288:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1789136336.755569:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c3ce8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1876044666940800:0@lo:400:kworker.0 00000100:00100000:1.0:1789136336.755580:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c4762580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3639:1876044666941312:0@lo:400:kworker.0 00000100:00100000:0.0:1789136336.755706:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789136336.755755:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7f662d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b11da215-324d-4c8d-90a5-0b7f26186c4c:3641:1876044666940416:0@lo:400:kworker.0 00000100:00100000:0.0:1789136336.755793:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789136336.755829:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7f02b9680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1876044666941568:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1789136336.755867:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789136336.755895:0:23339:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666940544 00000100:00100000:0.0:1789136336.755900:0:23339:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666940544 00000100:00100000:0.0:1789136336.755938:0:23339:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666941568 00000100:00100000:0.0:1789136336.755942:0:23339:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666941568 00000100:00100000:1.0:1789136336.755952:0:24077:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1789136336.755962:0:24077:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7c86df0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3641:x1876044666940544:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789136336.756001:0:24077:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7c86df0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3641:x1876044666940544:12345-0@lo:400:kworker.0 Request processed in 41us (296us total) trans 0 rc 0/0 00000100:00100000:0.0:1789136336.756840:0:23339:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1789136336.756852:0:23339:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7c86de1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3641:x1876044666941568:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1789136336.756909:0:23339:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1789136336.756959:0:23339:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7c86de1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3641:x1876044666941568:12345-0@lo:41:osp-pre-0-1.0 Request processed in 112us (1105us total) trans 0 rc 0/0 00000100:00100000:0.0:1789136336.756966:0:23339:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1789136336.757014:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7f02b9680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1876044666941568:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1789136336.757032:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7c14b6940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1876044666940544:0@lo:400:kworker.0 00000100:00100000:0.0:1789136336.757069:0:23324:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666940416 00000100:00100000:0.0:1789136336.757074:0:23324:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666940416 00000100:00100000:0.0:1789136336.757127:0:23324:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:0.0:1789136336.757133:0:23324:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7c4ffdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b11da215-324d-4c8d-90a5-0b7f26186c4c+24:3641:x1876044666940416:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789136336.757169:0:23324:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7c4ffdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b11da215-324d-4c8d-90a5-0b7f26186c4c+24:3641:x1876044666940416:12345-0@lo:400:kworker.0 Request processed in 37us (1376us total) trans 0 rc 0/0 00000100:00100000:0.0:1789136336.757175:0:23324:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00100000:3.0:1789136336.757503:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7f662d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b11da215-324d-4c8d-90a5-0b7f26186c4c:3641:1876044666940416:0@lo:400:kworker.0 00000100:00100000:1.0:1789136336.757623:0:24077:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1789136336.765693:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:0.0:1789136336.767484:0:23336:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644784384 00000100:00100000:0.0:1789136336.767497:0:23336:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644784384 00000100:00100000:0.0:1789136336.767585:0:23336:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 4 00000100:00100000:0.0:1789136336.767596:0:23336:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7f7de1050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a4039233-0823-4bef-b733-24ab7c889e38+12:18968:x1876044644784384:12345-192.168.201.31@tcp:35:lfs.0 00000100:00100000:0.0:1789136336.767832:0:23336:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7f7de1050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a4039233-0823-4bef-b733-24ab7c889e38+13:18968:x1876044644784384:12345-192.168.201.31@tcp:35:lfs.0 Request processed in 237us (2149us total) trans 12884901895 rc 0/0 00000100:00100000:0.0:1789136336.767840:0:23336:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 4 00000100:00100000:3.0:1789136336.851838:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:2.0:1789136336.851999:0:23333:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644784512 00000100:00100000:2.0:1789136336.852016:0:23333:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644784512 00000100:00100000:2.0:1789136336.852088:0:23333:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 36 00000100:00100000:2.0:1789136336.852098:0:23333:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7f662d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bb852e64-3f46-4395-9dea-0822b7213ac8+11:18974:x1876044644784512:12345-192.168.201.31@tcp:101:bash.0 00010000:00010000:2.0:1789136336.852119:0:23333:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789136336.852140:0:23333:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c0031000/0x559c8745c6de4ae6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa7228e7a1ab09006 expref: -99 pid: 23333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136336.852222:0:23333:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c0030a00/0x559c8745c6de4aed lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 23333 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136336.852236:0:23333:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c0030a00/0x559c8745c6de4aed lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 23333 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136336.852247:0:23333:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c0030a00/0x559c8745c6de4aed lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 23333 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136336.852260:0:23333:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c0031800/0x559c8745c6de4af4 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 23333 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136336.852268:0:23333:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c0031800/0x559c8745c6de4af4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 23333 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136336.852275:0:23333:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c0031800/0x559c8745c6de4af4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 23333 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136336.852358:0:23333:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7e1c9e200/0x559c8745c6de4afb lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 23333 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136336.852366:0:23333:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a7e1c9e200/0x559c8745c6de4afb lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 23333 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136336.852373:0:23333:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a7e1c9e200/0x559c8745c6de4afb lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 23333 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789136336.852415:0:23333:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1789136336.852419:0:23333:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1789136336.852459:0:23333:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90a7e1c9e200/0x559c8745c6de4afb lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 23333 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136336.852481:0:23333:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c0030a00/0x559c8745c6de4aed lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 23333 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136336.852488:0:23333:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c0030a00/0x559c8745c6de4aed lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 23333 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136336.852495:0:23333:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c0030a00/0x559c8745c6de4aed lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 23333 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136336.852500:0:23333:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a7c0030a00 already unused, calling callback (ffffffffc19cc4f0) 00010000:00010000:2.0:1789136336.852505:0:23333:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c0030a00/0x559c8745c6de4aed lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 23333 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136336.852512:0:23333:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c0030a00/0x559c8745c6de4aed lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 23333 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136336.852523:0:23333:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90a7d61d3200) 00010000:00010000:2.0:1789136336.852653:0:23333:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789136336.852660:0:23333:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c0030a00/0x559c8745c6de4aed lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 23333 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136336.852668:0:23333:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c0030a00/0x559c8745c6de4aed lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 23333 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136336.852682:0:23333:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c0031800/0x559c8745c6de4af4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 23333 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136336.852686:0:23333:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c0031800/0x559c8745c6de4af4 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 23333 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136336.852689:0:23333:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c0031800/0x559c8745c6de4af4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 23333 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136336.852697:0:23333:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a7c0031800 already unused, calling callback (ffffffffc19cc4f0) 00010000:00010000:2.0:1789136336.852699:0:23333:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c0031800/0x559c8745c6de4af4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 23333 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136336.852703:0:23333:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c0031800/0x559c8745c6de4af4 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 23333 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136336.852709:0:23333:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa6028a67 (ffff90a7d61d3100) 00010000:00010000:2.0:1789136336.852710:0:23333:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789136336.852712:0:23333:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c0031800/0x559c8745c6de4af4 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 23333 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136336.852716:0:23333:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c0031800/0x559c8745c6de4af4 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 23333 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136336.852735:0:23333:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c0031000/0x559c8745c6de4ae6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab09006 expref: 13 pid: 23333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136336.852743:0:23333:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7e1c9e200/0x559c8745c6de4afb lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab09006 expref: 12 pid: 23333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136336.852748:0:23333:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff90a7d61d3600) 00010000:00010000:2.0:1789136336.852749:0:23333:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1789136336.852751:0:23333:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a7e1c9e200, rc 0) 00000100:00100000:2.0:1789136336.852850:0:23333:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7f662d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bb852e64-3f46-4395-9dea-0822b7213ac8+12:18974:x1876044644784512:12345-192.168.201.31@tcp:101:bash.0 Request processed in 753us (1029us total) trans 0 rc 0/0 00000100:00100000:2.0:1789136336.852892:0:23333:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 36 00000100:00100000:3.0:1789136336.866990:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:0.0:1789136336.867211:0:23345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644784640 00000100:00100000:0.0:1789136336.867228:0:23345:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644784640 00000100:00100000:0.0:1789136336.867320:0:23345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 7 00000100:00100000:0.0:1789136336.867332:0:23345:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7fa398b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:bb852e64-3f46-4395-9dea-0822b7213ac8+5:18974:x1876044644784640:12345-192.168.201.31@tcp:900:bash.0 00000100:00100000:0.0:1789136336.867445:0:23345:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7fa398b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:bb852e64-3f46-4395-9dea-0822b7213ac8+5:18974:x1876044644784640:12345-192.168.201.31@tcp:900:bash.0 Request processed in 115us (470us total) trans 0 rc 0/0 00000100:00100000:0.0:1789136336.867453:0:23345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 7 00000040:00080000:2.0:1789136336.872719:0:24094:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:1.0:1789136336.880693:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:2.0:1789136336.880895:0:23334:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644784896 00000100:00100000:2.0:1789136336.880906:0:23334:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644784896 00000100:00100000:2.0:1789136336.880968:0:23334:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 37 00000100:00100000:2.0:1789136336.880979:0:23334:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7f02bad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bb852e64-3f46-4395-9dea-0822b7213ac8+12:18974:x1876044644784896:12345-192.168.201.31@tcp:101:bash.0 00010000:00010000:2.0:1789136336.881001:0:23334:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789136336.881025:0:23334:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a7e1c9fc00/0x559c8745c6de4b02 lrc: 2/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa7228e7a1ab0900d expref: -99 pid: 23334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136336.881145:0:23334:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c0031000/0x559c8745c6de4b09 lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 23334 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136336.881163:0:23334:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c0031400/0x559c8745c6de4adf lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08fff expref: 12 pid: 23333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136336.881737:0:23334:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c0031000/0x559c8745c6de4b09 lrc: 4/0,1 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 23334 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136336.881777:0:23334:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c0031400/0x559c8745c6de4adf lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08fff expref: 12 pid: 23333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136336.881790:0:23334:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c0031400/0x559c8745c6de4adf lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08fff expref: 12 pid: 23333 timeout: 884 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789136336.881802:0:23334:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7fe5ed680 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:23334:1876044666941696:192.168.201.31@tcp:104: 00000100:00100000:2.0:1789136336.882126:0:23334:0:(client.c:2715:ptlrpc_set_wait()) set ffff90a7c8646f00 going to sleep for 11 seconds 00000100:00100000:1.0:1789136336.890025:0:23334:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7fe5ed680 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:23334:1876044666941696:192.168.201.31@tcp:104: 00010000:00010000:1.0:1789136336.890054:0:23334:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c0031000/0x559c8745c6de4b09 lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 23334 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789136336.893560:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:0.0:1789136336.893640:0:23318:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644785024 00000100:00100000:0.0:1789136336.893650:0:23318:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644785024 00010000:00010000:0.0:1789136336.893695:0:23318:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c0031400/0x559c8745c6de4adf lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08fff expref: 13 pid: 23333 timeout: 884 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789136336.893743:0:23318:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 16 00000100:00100000:0.0:1789136336.893753:0:23318:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7f02b9e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a4039233-0823-4bef-b733-24ab7c889e38+13:2391:x1876044644785024:12345-192.168.201.31@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789136336.893770:0:23318:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789136336.893777:0:23318:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 1s ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c0031400/0x559c8745c6de4adf lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08fff expref: 13 pid: 23333 timeout: 884 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136336.893791:0:23318:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c0031400/0x559c8745c6de4adf lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08fff expref: 13 pid: 23333 timeout: 884 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136336.893819:0:23318:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c0031400/0x559c8745c6de4adf lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab08fff expref: 13 pid: 23333 timeout: 884 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136336.893835:0:23318:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff90a7d61d3600) 00010000:00010000:0.0:1789136336.893840:0:23318:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c0031000/0x559c8745c6de4b09 lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 23334 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136336.893850:0:23318:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c0031000/0x559c8745c6de4b09 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 23334 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136336.893907:0:23318:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c0031000/0x559c8745c6de4b09 lrc: 4/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 23334 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136336.893945:0:23318:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789136336.894001:0:23318:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7f02b9e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a4039233-0823-4bef-b733-24ab7c889e38+12:2391:x1876044644785024:12345-192.168.201.31@tcp:103:ldlm_bl.0 Request processed in 249us (451us total) trans 0 rc 0/0 00000100:00100000:0.0:1789136336.894009:0:23318:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 16 00010000:00010000:3.0:1789136336.894021:0:23334:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c0031000/0x559c8745c6de4b09 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 23334 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136336.894029:0:23334:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c0031000/0x559c8745c6de4b09 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 23334 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136336.894114:0:23334:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ff5f4000/0x559c8745c6de4b10 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 23334 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136336.894125:0:23334:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ff5f4000/0x559c8745c6de4b10 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 23334 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136336.894133:0:23334:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ff5f4000/0x559c8745c6de4b10 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 23334 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136336.897101:0:23334:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ff5f4400/0x559c8745c6de4b17 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 23334 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136336.897122:0:23334:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ff5f4400/0x559c8745c6de4b17 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 23334 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136336.897134:0:23334:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ff5f4400/0x559c8745c6de4b17 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 23334 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789136336.897147:0:23334:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00010000:00010000:3.0:1789136336.897175:0:23334:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c0031000/0x559c8745c6de4b09 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 23334 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136336.897182:0:23334:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c0031000/0x559c8745c6de4b09 lrc: 2/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 23334 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136336.897202:0:23334:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c0031000/0x559c8745c6de4b09 lrc: 3/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 23334 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136336.897208:0:23334:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a7c0031000 already unused, calling callback (ffffffffc19cc4f0) 00010000:00010000:3.0:1789136336.897213:0:23334:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c0031000/0x559c8745c6de4b09 lrc: 3/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 23334 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136336.897221:0:23334:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c0031000/0x559c8745c6de4b09 lrc: 4/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 23334 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136336.897235:0:23334:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff90a7d61d3600) 00010000:00010000:3.0:1789136336.897238:0:23334:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789136336.897242:0:23334:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c0031000/0x559c8745c6de4b09 lrc: 2/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 23334 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136336.897248:0:23334:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c0031000/0x559c8745c6de4b09 lrc: 0/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 23334 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789136336.897264:0:23334:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 00000000d9b31e0d reply state 00000000ba9c2eda transno 12884901896 ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ff5f4000/0x559c8745c6de4b10 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 23334 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136336.897275:0:23334:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ff5f4000/0x559c8745c6de4b10 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 23334 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136336.897281:0:23334:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0xb42112bc (ffff90a7c3817400) 00010000:00010000:3.0:1789136336.897283:0:23334:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1789136336.897286:0:23334:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1789136336.897326:0:23334:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a7e1c9fc00/0x559c8745c6de4b02 lrc: 0/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab0900d expref: 15 pid: 23334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136336.897343:0:23334:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ff5f4400/0x559c8745c6de4b17 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab0900d expref: 14 pid: 23334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136336.897356:0:23334:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff90a7c3817500) 00010000:00010000:3.0:1789136336.897358:0:23334:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 9 00010000:00010000:3.0:1789136336.897360:0:23334:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a7ff5f4400, rc 0) 00000100:00100000:3.0:1789136336.897436:0:23334:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7f02bad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bb852e64-3f46-4395-9dea-0822b7213ac8+15:18974:x1876044644784896:12345-192.168.201.31@tcp:101:bash.0 Request processed in 16458us (16751us total) trans 12884901896 rc 0/0 00000100:00100000:3.0:1789136336.897445:0:23334:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 37 00000100:00100000:1.0:1789136336.914486:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:3.0:1789136336.914625:0:23332:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644785152 00000100:00100000:3.0:1789136336.914636:0:23332:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644785152 00000100:00100000:3.0:1789136336.914698:0:23332:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 38 00000100:00100000:3.0:1789136336.914708:0:23332:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7f02ba940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bb852e64-3f46-4395-9dea-0822b7213ac8+15:18974:x1876044644785152:12345-192.168.201.31@tcp:101:bash.0 00010000:00010000:3.0:1789136336.914736:0:23332:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789136336.914758:0:23332:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ff5f5e00/0x559c8745c6de4b25 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa7228e7a1ab09014 expref: -99 pid: 23332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136336.914829:0:23332:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ff5f4a00/0x559c8745c6de4b2c lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 23332 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136336.914892:0:23332:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ff5f4a00/0x559c8745c6de4b2c lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 23332 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136336.914904:0:23332:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ff5f4a00/0x559c8745c6de4b2c lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 23332 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789136336.914953:0:23332:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00000004:00200000:3.0:1789136336.914958:0:23332:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1789136336.914978:0:23332:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ff5f4a00/0x559c8745c6de4b2c lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 23332 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136336.915176:0:23332:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ff5f4a00/0x559c8745c6de4b2c lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 23332 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136336.915206:0:23332:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ff5f5e00/0x559c8745c6de4b25 lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab09014 expref: 17 pid: 23332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136336.915225:0:23332:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ff5f4a00/0x559c8745c6de4b2c lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab09014 expref: 16 pid: 23332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136336.915233:0:23332:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff90a7c3817500) 00010000:00010000:3.0:1789136336.915236:0:23332:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789136336.915240:0:23332:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a7ff5f4a00, rc 0) 00000100:00100000:3.0:1789136336.915306:0:23332:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7f02ba940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bb852e64-3f46-4395-9dea-0822b7213ac8+16:18974:x1876044644785152:12345-192.168.201.31@tcp:101:bash.0 Request processed in 600us (830us total) trans 0 rc 0/0 00000100:00100000:3.0:1789136336.915314:0:23332:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 38 00000100:00100000:2.0:1789136336.920951:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:0.0:1789136336.921065:0:23336:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644785408 00000100:00100000:0.0:1789136336.921077:0:23336:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644785408 00000100:00100000:0.0:1789136336.921140:0:23336:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 5 00000100:00100000:0.0:1789136336.921151:0:23336:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7fe5ecb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bb852e64-3f46-4395-9dea-0822b7213ac8+16:18974:x1876044644785408:12345-192.168.201.31@tcp:35:bash.0 00000100:00100000:0.0:1789136336.921459:0:23336:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7fe5ecb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bb852e64-3f46-4395-9dea-0822b7213ac8+17:18974:x1876044644785408:12345-192.168.201.31@tcp:35:bash.0 Request processed in 308us (516us total) trans 12884901897 rc 0/0 00000100:00100000:0.0:1789136336.921467:0:23336:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 5 00000100:00100000:2.0:1789136337.063283:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:1.0:1789136337.063450:0:26387:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644785664 00000100:00100000:1.0:1789136337.063460:0:26387:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644785664 00000100:00100000:1.0:1789136337.063539:0:26387:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 39 00000100:00100000:1.0:1789136337.063554:0:26387:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7fe5ee940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bb852e64-3f46-4395-9dea-0822b7213ac8+17:18985:x1876044644785664:12345-192.168.201.31@tcp:101:lfs.0 00010000:00010000:1.0:1789136337.063579:0:26387:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789136337.063600:0:26387:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3b4d600/0x559c8745c6de4b33 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa7228e7a1ab0901b expref: -99 pid: 26387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789136337.063730:0:26387:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00010000:00010000:1.0:1789136337.063836:0:26387:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3b4d600/0x559c8745c6de4b33 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab0901b expref: 19 pid: 26387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136337.063850:0:26387:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90a7d61d3200) 00010000:00010000:1.0:1789136337.063930:0:26387:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1789136337.063938:0:26387:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3b4d600/0x559c8745c6de4b33 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab0901b expref: 19 pid: 26387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136337.063956:0:26387:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a6c3b4d600, rc 0) 00000100:00100000:1.0:1789136337.064016:0:26387:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7fe5ee940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bb852e64-3f46-4395-9dea-0822b7213ac8+18:18985:x1876044644785664:12345-192.168.201.31@tcp:101:lfs.0 Request processed in 467us (744us total) trans 12884901898 rc 301/301 00000100:00100000:1.0:1789136337.064024:0:26387:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 39 00000100:00080000:2.0:1789136337.064329:0:23328:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789136337.071202:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:0.0:1789136337.071517:0:23336:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644785920 00000100:00100000:0.0:1789136337.071527:0:23336:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644785920 00000100:00100000:0.0:1789136337.071583:0:23336:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 6 00000100:00100000:0.0:1789136337.071593:0:23336:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7f02b8f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bb852e64-3f46-4395-9dea-0822b7213ac8+18:18985:x1876044644785920:12345-192.168.201.31@tcp:35:lfs.0 00000100:00100000:0.0:1789136337.072049:0:23336:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7f02b8f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bb852e64-3f46-4395-9dea-0822b7213ac8+19:18985:x1876044644785920:12345-192.168.201.31@tcp:35:lfs.0 Request processed in 455us (856us total) trans 12884901899 rc 0/0 00000100:00100000:0.0:1789136337.072058:0:23336:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 6 00000100:00100000:1.0:1789136337.135167:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:2.0:1789136337.135316:0:23333:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644786176 00000100:00100000:2.0:1789136337.135351:0:23333:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644786176 00000100:00100000:2.0:1789136337.135534:0:23333:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 40 00000100:00100000:2.0:1789136337.135545:0:23333:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7f02bb0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bb852e64-3f46-4395-9dea-0822b7213ac8+19:18988:x1876044644786176:12345-192.168.201.31@tcp:101:lfs.0 00010000:00010000:2.0:1789136337.135569:0:23333:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789136337.135591:0:23333:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c0031800/0x559c8745c6de4b41 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa7228e7a1ab09022 expref: -99 pid: 23333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136337.135902:0:23333:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c0031400/0x559c8745c6de4b48 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 23333 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136337.135916:0:23333:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c0031400/0x559c8745c6de4b48 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 23333 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136337.135928:0:23333:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c0031400/0x559c8745c6de4b48 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 23333 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789136337.135940:0:23333:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00010000:00010000:2.0:1789136337.136130:0:23333:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c0031800/0x559c8745c6de4b41 lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab09022 expref: 22 pid: 23333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136337.136149:0:23333:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c0031400/0x559c8745c6de4b48 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab09022 expref: 21 pid: 23333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136337.136157:0:23333:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff90a7c3817500) 00010000:00010000:2.0:1789136337.136160:0:23333:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789136337.136164:0:23333:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a7c0031400, rc 0) 00000100:00100000:2.0:1789136337.136230:0:23333:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7f02bb0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bb852e64-3f46-4395-9dea-0822b7213ac8+21:18988:x1876044644786176:12345-192.168.201.31@tcp:101:lfs.0 Request processed in 687us (1073us total) trans 12884901900 rc 0/0 00000100:00100000:2.0:1789136337.136238:0:23333:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 40 00000100:00100000:2.0:1789136337.141323:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:3.0:1789136337.141422:0:26370:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644786304 00000100:00100000:3.0:1789136337.141433:0:26370:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644786304 00000100:00100000:3.0:1789136337.141504:0:26370:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 0 00000100:00100000:3.0:1789136337.141516:0:26370:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7fe5ed680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:bb852e64-3f46-4395-9dea-0822b7213ac8+21:2389:x1876044644786304:12345-192.168.201.31@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789136337.141533:0:26370:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789136337.141559:0:26370:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c0031400/0x559c8745c6de4b48 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab09022 expref: 21 pid: 23333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136337.141581:0:26370:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff90a7c3817500) 00010000:00010000:3.0:1789136337.141586:0:26370:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789136337.141657:0:26370:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7fe5ed680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:bb852e64-3f46-4395-9dea-0822b7213ac8+20:2389:x1876044644786304:12345-192.168.201.31@tcp:103:ldlm_bl.0 Request processed in 143us (345us total) trans 0 rc 0/0 00000100:00100000:3.0:1789136337.141680:0:26370:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 0 00000100:00100000:1.0:1789136337.144907:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:2.0:1789136337.145108:0:26387:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644786432 00000100:00100000:2.0:1789136337.145119:0:26387:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644786432 00000100:00100000:2.0:1789136337.145186:0:26387:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 41 00000100:00100000:2.0:1789136337.145197:0:26387:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7f02b9a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bb852e64-3f46-4395-9dea-0822b7213ac8+20:18988:x1876044644786432:12345-192.168.201.31@tcp:54:lfs.0 00010000:00010000:2.0:1789136337.145268:0:26387:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c0031800/0x559c8745c6de4b56 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 26387 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136337.145285:0:26387:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c0031800/0x559c8745c6de4b56 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 26387 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136337.145298:0:26387:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c0031800/0x559c8745c6de4b56 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 26387 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136337.145350:0:26387:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c0031800/0x559c8745c6de4b56 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 26387 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136337.145358:0:26387:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c0031800/0x559c8745c6de4b56 lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 26387 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136337.145364:0:26387:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c0031800/0x559c8745c6de4b56 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 26387 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136337.145371:0:26387:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a7c0031800 already unused, calling callback (ffffffffc19cc4f0) 00010000:00010000:2.0:1789136337.145377:0:26387:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c0031800/0x559c8745c6de4b56 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 26387 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136337.145467:0:26387:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c0031800/0x559c8745c6de4b56 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 26387 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136337.145480:0:26387:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff90a7c3817500) 00010000:00010000:2.0:1789136337.145484:0:26387:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789136337.145504:0:26387:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c0031800/0x559c8745c6de4b56 lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 26387 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136337.145511:0:26387:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c0031800/0x559c8745c6de4b56 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 26387 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789136337.145597:0:26387:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7f02b9a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bb852e64-3f46-4395-9dea-0822b7213ac8+20:18988:x1876044644786432:12345-192.168.201.31@tcp:54:lfs.0 Request processed in 400us (700us total) trans 0 rc 0/0 00000100:00100000:2.0:1789136337.145606:0:26387:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 41 00000100:00100000:1.0:1789136337.150826:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:2.0:1789136337.151076:0:23335:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644786688 00000100:00100000:2.0:1789136337.151090:0:23335:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644786688 00000100:00100000:2.0:1789136337.151141:0:23335:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 7 00000100:00100000:2.0:1789136337.151151:0:23335:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7f02b8780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bb852e64-3f46-4395-9dea-0822b7213ac8+20:18988:x1876044644786688:12345-192.168.201.31@tcp:35:lfs.0 00000100:00100000:2.0:1789136337.151564:0:23335:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7f02b8780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bb852e64-3f46-4395-9dea-0822b7213ac8+21:18988:x1876044644786688:12345-192.168.201.31@tcp:35:lfs.0 Request processed in 412us (748us total) trans 12884901901 rc 0/0 00000100:00100000:2.0:1789136337.151573:0:23335:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 7 00000040:00080000:2.0:1789136337.256795:0:23370:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:2.0:1789136337.601977:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:3.0:1789136337.602056:0:23332:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644786944 00000100:00100000:3.0:1789136337.602066:0:23332:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644786944 00000100:00100000:3.0:1789136337.602118:0:23332:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 42 00000100:00100000:3.0:1789136337.602128:0:23332:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7fe5ed2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bb852e64-3f46-4395-9dea-0822b7213ac8+21:19019:x1876044644786944:12345-192.168.201.31@tcp:101:cat.0 00010000:00010000:3.0:1789136337.602151:0:23332:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789136337.602170:0:23332:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ff5f5e00/0x559c8745c6de4b5d lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa7228e7a1ab09029 expref: -99 pid: 23332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136337.602281:0:23332:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ff5f5a00/0x559c8745c6de4b64 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 23332 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136337.602294:0:23332:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ff5f5a00/0x559c8745c6de4b64 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 23332 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136337.602304:0:23332:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ff5f5a00/0x559c8745c6de4b64 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 23332 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789136337.602312:0:23332:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00010000:00010000:3.0:1789136337.602443:0:23332:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ff5f5e00/0x559c8745c6de4b5d lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab09029 expref: 24 pid: 23332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136337.602463:0:23332:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ff5f5a00/0x559c8745c6de4b64 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab09029 expref: 23 pid: 23332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136337.602472:0:23332:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff90a7c3817500) 00010000:00010000:3.0:1789136337.602476:0:23332:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789136337.602480:0:23332:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a7ff5f5a00, rc 0) 00000100:00100000:3.0:1789136337.602568:0:23332:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7fe5ed2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bb852e64-3f46-4395-9dea-0822b7213ac8+23:19019:x1876044644786944:12345-192.168.201.31@tcp:101:cat.0 Request processed in 442us (601us total) trans 12884901902 rc 0/0 00000100:00100000:3.0:1789136337.602576:0:23332:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 42 00000100:00100000:1.0:1789136337.616959:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:1.0:1789136337.617026:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:0.0:1789136337.617187:0:23336:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644787200 00000100:00100000:0.0:1789136337.617198:0:23336:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644787200 00000100:00100000:0.0:1789136337.617267:0:23336:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 8 00000100:00100000:0.0:1789136337.617278:0:23336:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7f02bbc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bb852e64-3f46-4395-9dea-0822b7213ac8+23:19019:x1876044644787200:12345-192.168.201.31@tcp:35:cat.0 00000100:00100000:0.0:1789136337.617635:0:23336:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7f02bbc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bb852e64-3f46-4395-9dea-0822b7213ac8+24:19019:x1876044644787200:12345-192.168.201.31@tcp:35:cat.0 Request processed in 357us (684us total) trans 12884901903 rc 0/0 00000100:00100000:0.0:1789136337.617644:0:23336:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 8 00000100:00100000:2.0:1789136337.619792:0:23318:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644787328 00000100:00100000:2.0:1789136337.619933:0:23318:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644787328 00000100:00100000:2.0:1789136337.620005:0:23318:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 1 00000100:00100000:2.0:1789136337.620017:0:23318:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7f02ba1c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bb852e64-3f46-4395-9dea-0822b7213ac8+24:2391:x1876044644787328:12345-192.168.201.31@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789136337.620033:0:23318:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789136337.620059:0:23318:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ff5f5a00/0x559c8745c6de4b64 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab09029 expref: 24 pid: 23332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136337.620085:0:23318:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff90a7c3817500) 00010000:00010000:2.0:1789136337.620091:0:23318:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789136337.620168:0:23318:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7f02ba1c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bb852e64-3f46-4395-9dea-0822b7213ac8+23:2391:x1876044644787328:12345-192.168.201.31@tcp:103:ldlm_bl.0 Request processed in 149us (3150us total) trans 0 rc 0/0 00000100:00100000:2.0:1789136337.620177:0:23318:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 1 00010000:00010000:0.0:1789136337.640345:0:23321:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789136337.782639:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:2.0:1789136337.782718:0:26387:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644787584 00000100:00100000:2.0:1789136337.782729:0:26387:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644787584 00000100:00100000:2.0:1789136337.782810:0:26387:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 43 00000100:00100000:2.0:1789136337.782819:0:26387:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c3ce8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bb852e64-3f46-4395-9dea-0822b7213ac8+23:19025:x1876044644787584:12345-192.168.201.31@tcp:101:dd.0 00010000:00010000:2.0:1789136337.782841:0:26387:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789136337.782882:0:26387:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c0031800/0x559c8745c6de4b72 lrc: 2/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa7228e7a1ab09030 expref: -99 pid: 26387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136337.782980:0:26387:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c0031000/0x559c8745c6de4b79 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 26387 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136337.782995:0:26387:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c0031000/0x559c8745c6de4b79 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 26387 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136337.783005:0:26387:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c0031000/0x559c8745c6de4b79 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 26387 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789136337.783013:0:26387:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00010000:00010000:2.0:1789136337.783176:0:26387:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c0031800/0x559c8745c6de4b72 lrc: 0/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab09030 expref: 26 pid: 26387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136337.783195:0:26387:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c0031000/0x559c8745c6de4b79 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab09030 expref: 25 pid: 26387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136337.783204:0:26387:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff90a7c3817500) 00010000:00010000:2.0:1789136337.783207:0:26387:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789136337.783224:0:26387:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a7c0031000, rc 0) 00000100:00100000:2.0:1789136337.783280:0:26387:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c3ce8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bb852e64-3f46-4395-9dea-0822b7213ac8+25:19025:x1876044644787584:12345-192.168.201.31@tcp:101:dd.0 Request processed in 462us (652us total) trans 12884901904 rc 0/0 00000100:00100000:2.0:1789136337.783285:0:26387:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 43 00000100:00100000:1.0:1789136337.793006:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:3.0:1789136337.793189:0:23332:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644787712 00000100:00100000:3.0:1789136337.793199:0:23332:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644787712 00000100:00100000:3.0:1789136337.793290:0:23332:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 44 00000100:00100000:3.0:1789136337.793301:0:23332:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7f02b83c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bb852e64-3f46-4395-9dea-0822b7213ac8+25:19025:x1876044644787712:12345-192.168.201.31@tcp:101:dd.0 00010000:00010000:3.0:1789136337.793326:0:23332:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789136337.793670:0:23332:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ff5f5e00/0x559c8745c6de4b87 lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa7228e7a1ab09037 expref: -99 pid: 23332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136337.793711:0:23332:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ff5f5c00/0x559c8745c6de4b8e lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 23332 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136337.793725:0:23332:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ff5f5c00/0x559c8745c6de4b8e lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 23332 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136337.793736:0:23332:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ff5f5c00/0x559c8745c6de4b8e lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 23332 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136337.793877:0:23332:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ff5f5e00/0x559c8745c6de4b87 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab09037 expref: 27 pid: 23332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136337.793896:0:23332:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ff5f5c00/0x559c8745c6de4b8e lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab09037 expref: 26 pid: 23332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136337.793904:0:23332:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff90a7c3817500) 00010000:00010000:3.0:1789136337.793908:0:23332:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1789136337.793917:0:23332:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a7ff5f5c00, rc 0) 00000100:00100000:3.0:1789136337.794030:0:23332:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7f02b83c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bb852e64-3f46-4395-9dea-0822b7213ac8+26:19025:x1876044644787712:12345-192.168.201.31@tcp:101:dd.0 Request processed in 730us (1179us total) trans 0 rc 0/0 00000100:00100000:3.0:1789136337.794046:0:23332:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 44 00000100:00100000:1.0:1789136337.794422:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:2.0:1789136337.795203:0:26370:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644787840 00000100:00100000:2.0:1789136337.795213:0:26370:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644787840 00000100:00100000:2.0:1789136337.795276:0:26370:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 2 00000100:00100000:2.0:1789136337.795286:0:26370:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7f02bb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:bb852e64-3f46-4395-9dea-0822b7213ac8+26:2392:x1876044644787840:12345-192.168.201.31@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789136337.795299:0:26370:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789136337.795319:0:26370:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c0031000/0x559c8745c6de4b79 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab09030 expref: 26 pid: 26387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136337.795336:0:26370:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff90a7c3817500) 00010000:00010000:2.0:1789136337.795340:0:26370:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789136337.795379:0:26370:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7f02bb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:bb852e64-3f46-4395-9dea-0822b7213ac8+25:2392:x1876044644787840:12345-192.168.201.31@tcp:103:ldlm_bl.0 Request processed in 94us (958us total) trans 0 rc 0/0 00000100:00100000:2.0:1789136337.795398:0:26370:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 2 00000100:00100000:1.0:1789136337.796979:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:3.0:1789136337.797058:0:23334:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644788096 00000100:00100000:3.0:1789136337.797067:0:23334:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644788096 00000100:00100000:3.0:1789136337.797115:0:23334:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 45 00000100:00100000:3.0:1789136337.797124:0:23334:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7f02b9680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bb852e64-3f46-4395-9dea-0822b7213ac8+25:19025:x1876044644788096:12345-192.168.201.31@tcp:36:dd.0 00010000:00010000:3.0:1789136337.797177:0:23334:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789136337.797198:0:23334:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ff5f4a00/0x559c8745c6de4b2c lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab09014 expref: 25 pid: 23332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136337.797214:0:23334:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff90a7c3817500) 00010000:00010000:3.0:1789136337.797219:0:23334:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789136337.797400:0:23334:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ff5f5200/0x559c8745c6de4b95 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 23334 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136337.797413:0:23334:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ff5f5200/0x559c8745c6de4b95 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 23334 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136337.797423:0:23334:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ff5f5200/0x559c8745c6de4b95 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 23334 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789136337.797480:0:23334:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901905 00000004:00010000:3.0:1789136337.797502:0:23334:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 0000000058834c85 reply state 0000000054ea601d transno 12884901906 ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ff5f5200/0x559c8745c6de4b95 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 23334 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136337.797516:0:23334:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ff5f5200/0x559c8745c6de4b95 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 23334 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136337.797541:0:23334:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff90a7c3817500) 00010000:00010000:3.0:1789136337.797544:0:23334:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1789136337.797546:0:23334:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1789136337.800792:0:23334:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7f02b9680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bb852e64-3f46-4395-9dea-0822b7213ac8+27:19025:x1876044644788096:12345-192.168.201.31@tcp:36:dd.0 Request processed in 3656us (3806us total) trans 12884901906 rc 0/0 00000100:00100000:3.0:1789136337.800806:0:23334:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 45 00000020:00080000:3.0:1789136337.800816:0:23334:0:(tgt_main.c:785:tgt_ses_key_exit()) total 2 transactions per RPC 00000040:00080000:2.0:1789136337.900455:0:24094:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:1.0:1789136337.942555:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:0.0:1789136337.942906:0:23336:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644788352 00000100:00100000:0.0:1789136337.942922:0:23336:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644788352 00000100:00100000:0.0:1789136337.942988:0:23336:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 9 00000100:00100000:0.0:1789136337.942998:0:23336:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c4762580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bb852e64-3f46-4395-9dea-0822b7213ac8+27:19025:x1876044644788352:12345-192.168.201.31@tcp:35:dd.0 00000100:00100000:0.0:1789136337.943251:0:23336:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c4762580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bb852e64-3f46-4395-9dea-0822b7213ac8+28:19025:x1876044644788352:12345-192.168.201.31@tcp:35:dd.0 Request processed in 253us (712us total) trans 12884901907 rc 0/0 00000100:00100000:0.0:1789136337.943260:0:23336:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 9 00000100:00100000:0.0:1789136338.216022:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:2.0:1789136338.216192:0:23333:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644788480 00000100:00100000:2.0:1789136338.216203:0:23333:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644788480 00000100:00100000:2.0:1789136338.216272:0:23333:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 46 00000100:00100000:2.0:1789136338.216283:0:23333:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7c86dd680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bb852e64-3f46-4395-9dea-0822b7213ac8+28:19039:x1876044644788480:12345-192.168.201.31@tcp:101:stat.0 00010000:00010000:2.0:1789136338.216308:0:23333:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789136338.216330:0:23333:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c0031800/0x559c8745c6de4b9c lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa7228e7a1ab0903e expref: -99 pid: 23333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136338.216413:0:23333:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c0031000/0x559c8745c6de4ba3 lrc: 3/1,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 23333 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136338.216443:0:23333:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c0031000/0x559c8745c6de4ba3 lrc: 3/1,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 23333 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136338.216458:0:23333:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c0031000/0x559c8745c6de4ba3 lrc: 3/1,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 23333 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136338.216471:0:23333:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c0031400/0x559c8745c6de4baa lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 23333 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136338.216478:0:23333:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c0031400/0x559c8745c6de4baa lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 23333 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136338.216484:0:23333:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c0031400/0x559c8745c6de4baa lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 23333 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136338.216552:0:23333:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c0030a00/0x559c8745c6de4bb1 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 23333 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136338.216562:0:23333:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c0030a00/0x559c8745c6de4bb1 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 23333 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136338.216569:0:23333:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c0030a00/0x559c8745c6de4bb1 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 23333 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789136338.216612:0:23333:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00000004:00200000:2.0:1789136338.216617:0:23333:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1789136338.216709:0:23333:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c0030a00/0x559c8745c6de4bb1 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 23333 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136338.216723:0:23333:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c0030a00/0x559c8745c6de4bb1 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 23333 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136338.216743:0:23333:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c0031000/0x559c8745c6de4ba3 lrc: 3/1,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 23333 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136338.216749:0:23333:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c0031000/0x559c8745c6de4ba3 lrc: 2/0,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 23333 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136338.216755:0:23333:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c0031000/0x559c8745c6de4ba3 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 23333 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136338.216761:0:23333:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a7c0031000 already unused, calling callback (ffffffffc19cc4f0) 00010000:00010000:2.0:1789136338.216765:0:23333:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c0031000/0x559c8745c6de4ba3 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 23333 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136338.216773:0:23333:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c0031000/0x559c8745c6de4ba3 lrc: 4/0,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 23333 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136338.216787:0:23333:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff90a7d61d3600) 00010000:00010000:2.0:1789136338.216790:0:23333:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789136338.216796:0:23333:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c0031000/0x559c8745c6de4ba3 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 23333 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136338.216803:0:23333:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c0031000/0x559c8745c6de4ba3 lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 23333 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136338.216816:0:23333:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c0031400/0x559c8745c6de4baa lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 23333 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136338.216823:0:23333:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c0031400/0x559c8745c6de4baa lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 23333 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136338.216828:0:23333:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c0031400/0x559c8745c6de4baa lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 23333 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136338.216838:0:23333:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a7c0031400 already unused, calling callback (ffffffffc19cc4f0) 00010000:00010000:2.0:1789136338.216841:0:23333:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c0031400/0x559c8745c6de4baa lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 23333 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136338.216846:0:23333:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c0031400/0x559c8745c6de4baa lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 23333 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136338.216950:0:23333:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0xb42112bc (ffff90a7c3817400) 00010000:00010000:2.0:1789136338.216954:0:23333:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789136338.216958:0:23333:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c0031400/0x559c8745c6de4baa lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 23333 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136338.216963:0:23333:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c0031400/0x559c8745c6de4baa lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 23333 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136338.216992:0:23333:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c0031800/0x559c8745c6de4b9c lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab0903e expref: 30 pid: 23333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136338.217006:0:23333:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c0030a00/0x559c8745c6de4bb1 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab0903e expref: 29 pid: 23333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136338.217013:0:23333:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff90a7c3817500) 00010000:00010000:2.0:1789136338.217016:0:23333:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789136338.217018:0:23333:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a7c0030a00, rc 0) 00000100:00100000:2.0:1789136338.217081:0:23333:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7c86dd680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bb852e64-3f46-4395-9dea-0822b7213ac8+29:19039:x1876044644788480:12345-192.168.201.31@tcp:101:stat.0 Request processed in 799us (1070us total) trans 0 rc 0/0 00000100:00100000:2.0:1789136338.217089:0:23333:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 46 00000100:00100000:2.0:1789136338.330793:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:1.0:1789136338.330962:0:26387:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644788736 00000100:00100000:1.0:1789136338.330973:0:26387:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644788736 00000100:00100000:1.0:1789136338.331059:0:26387:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 47 00000100:00100000:1.0:1789136338.331072:0:26387:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7fe5ec780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bb852e64-3f46-4395-9dea-0822b7213ac8+29:19045:x1876044644788736:12345-192.168.201.31@tcp:36:truncate.0 00010000:00010000:1.0:1789136338.331131:0:26387:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789136338.331160:0:26387:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c0030a00/0x559c8745c6de4bb1 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab0903e expref: 29 pid: 23333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136338.331182:0:26387:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff90a7c3817500) 00010000:00010000:1.0:1789136338.331192:0:26387:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789136338.331355:0:26387:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3b4d600/0x559c8745c6de4bb8 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 26387 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136338.331369:0:26387:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3b4d600/0x559c8745c6de4bb8 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 26387 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136338.331388:0:26387:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3b4d600/0x559c8745c6de4bb8 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 26387 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789136338.331429:0:26387:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901908 00000004:00010000:1.0:1789136338.331450:0:26387:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 00000000934e5794 reply state 00000000777e6452 transno 12884901909 ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3b4d600/0x559c8745c6de4bb8 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 26387 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136338.331463:0:26387:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3b4d600/0x559c8745c6de4bb8 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 26387 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136338.331470:0:26387:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff90a7c3817500) 00010000:00010000:1.0:1789136338.331473:0:26387:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1789136338.331475:0:26387:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1789136338.331592:0:26387:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7fe5ec780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bb852e64-3f46-4395-9dea-0822b7213ac8+31:19045:x1876044644788736:12345-192.168.201.31@tcp:36:truncate.0 Request processed in 521us (808us total) trans 12884901909 rc 0/0 00000100:00100000:1.0:1789136338.331600:0:26387:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 47 00000020:00080000:1.0:1789136338.331606:0:26387:0:(tgt_main.c:785:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1789136338.653544:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:2.0:1789136338.663412:0:23333:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644788864 00000100:00100000:2.0:1789136338.663718:0:23333:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644788864 00010000:00010000:0.0:1789136338.664129:0:23320:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789136338.666358:0:23333:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 48 00000100:00100000:2.0:1789136338.666398:0:23333:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7c14b6940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bb852e64-3f46-4395-9dea-0822b7213ac8+31:19059:x1876044644788864:12345-192.168.201.31@tcp:101:stat.0 00010000:00010000:2.0:1789136338.666437:0:23333:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789136338.666461:0:23333:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c0031800/0x559c8745c6de4bbf lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa7228e7a1ab09045 expref: -99 pid: 23333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136338.666544:0:23333:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c0031400/0x559c8745c6de4bc6 lrc: 3/1,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 23333 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136338.666563:0:23333:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c0031400/0x559c8745c6de4bc6 lrc: 3/1,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 23333 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136338.666575:0:23333:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c0031400/0x559c8745c6de4bc6 lrc: 3/1,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 23333 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136338.666589:0:23333:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c0031000/0x559c8745c6de4bcd lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 23333 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136338.666596:0:23333:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c0031000/0x559c8745c6de4bcd lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 23333 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136338.666602:0:23333:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c0031000/0x559c8745c6de4bcd lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 23333 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136338.667152:0:23333:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c0030a00/0x559c8745c6de4bd4 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 23333 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136338.667164:0:23333:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c0030a00/0x559c8745c6de4bd4 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 23333 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136338.667191:0:23333:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c0030a00/0x559c8745c6de4bd4 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 23333 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789136338.667248:0:23333:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 1234567 00000004:00200000:2.0:1789136338.667254:0:23333:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1789136338.667273:0:23333:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c0030a00/0x559c8745c6de4bd4 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 23333 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136338.667285:0:23333:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c0030a00/0x559c8745c6de4bd4 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 23333 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136338.667293:0:23333:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c0031400/0x559c8745c6de4bc6 lrc: 3/1,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 23333 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136338.667299:0:23333:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c0031400/0x559c8745c6de4bc6 lrc: 2/0,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 23333 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136338.667306:0:23333:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c0031400/0x559c8745c6de4bc6 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 23333 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136338.667312:0:23333:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a7c0031400 already unused, calling callback (ffffffffc19cc4f0) 00010000:00010000:2.0:1789136338.667317:0:23333:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c0031400/0x559c8745c6de4bc6 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 23333 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136338.667325:0:23333:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c0031400/0x559c8745c6de4bc6 lrc: 4/0,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 23333 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136338.667338:0:23333:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff90a7d61d3600) 00010000:00010000:2.0:1789136338.667342:0:23333:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789136338.667347:0:23333:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c0031400/0x559c8745c6de4bc6 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 23333 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136338.667366:0:23333:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c0031400/0x559c8745c6de4bc6 lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 23333 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136338.667394:0:23333:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c0031000/0x559c8745c6de4bcd lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 23333 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136338.667399:0:23333:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c0031000/0x559c8745c6de4bcd lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 23333 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136338.667405:0:23333:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c0031000/0x559c8745c6de4bcd lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 23333 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136338.667409:0:23333:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a7c0031000 already unused, calling callback (ffffffffc19cc4f0) 00010000:00010000:2.0:1789136338.667412:0:23333:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c0031000/0x559c8745c6de4bcd lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 23333 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136338.667418:0:23333:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c0031000/0x559c8745c6de4bcd lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 23333 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136338.667426:0:23333:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0xb42112bc (ffff90a7c3817400) 00010000:00010000:2.0:1789136338.667428:0:23333:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789136338.667432:0:23333:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c0031000/0x559c8745c6de4bcd lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 23333 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136338.667438:0:23333:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c0031000/0x559c8745c6de4bcd lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 23333 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136338.667468:0:23333:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c0031800/0x559c8745c6de4bbf lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab09045 expref: 33 pid: 23333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136338.667494:0:23333:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c0030a00/0x559c8745c6de4bd4 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab09045 expref: 32 pid: 23333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136338.667503:0:23333:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff90a7c3817500) 00010000:00010000:2.0:1789136338.667506:0:23333:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789136338.667508:0:23333:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a7c0030a00, rc 0) 00000100:00100000:2.0:1789136338.667602:0:23333:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7c14b6940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bb852e64-3f46-4395-9dea-0822b7213ac8+32:19059:x1876044644788864:12345-192.168.201.31@tcp:101:stat.0 Request processed in 1229us (14080us total) trans 0 rc 0/0 00000100:00100000:2.0:1789136338.667612:0:23333:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 48 00000100:00100000:0.0:1789136338.817475:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:1.0:1789136338.817661:0:26387:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644789120 00000100:00100000:1.0:1789136338.817674:0:26387:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644789120 00000100:00100000:1.0:1789136338.817748:0:26387:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 49 00000100:00100000:1.0:1789136338.817759:0:26387:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7c86dc3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bb852e64-3f46-4395-9dea-0822b7213ac8+32:19069:x1876044644789120:12345-192.168.201.31@tcp:101:lfs.0 00010000:00010000:1.0:1789136338.817786:0:26387:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789136338.817825:0:26387:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3b4c600/0x559c8745c6de4bdb lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa7228e7a1ab0904c expref: -99 pid: 26387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789136338.818014:0:26387:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00010000:00010000:1.0:1789136338.818164:0:26387:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3b4c600/0x559c8745c6de4bdb lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab0904c expref: 34 pid: 26387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136338.818181:0:26387:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90a7d61d3200) 00010000:00010000:1.0:1789136338.818185:0:26387:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1789136338.818191:0:26387:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3b4c600/0x559c8745c6de4bdb lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab0904c expref: 34 pid: 26387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136338.818209:0:26387:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a6c3b4c600, rc 0) 00000100:00100000:1.0:1789136338.818303:0:26387:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7c86dc3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bb852e64-3f46-4395-9dea-0822b7213ac8+33:19069:x1876044644789120:12345-192.168.201.31@tcp:101:lfs.0 Request processed in 544us (840us total) trans 12884901910 rc 301/301 00000100:00100000:1.0:1789136338.818312:0:26387:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 49 00000100:00100000:1.0:1789136338.824414:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:0.0:1789136338.824589:0:23336:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644789376 00000100:00100000:0.0:1789136338.824603:0:23336:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644789376 00000100:00100000:0.0:1789136338.824688:0:23336:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 10 00000100:00100000:0.0:1789136338.824700:0:23336:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7f7de1c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bb852e64-3f46-4395-9dea-0822b7213ac8+33:19069:x1876044644789376:12345-192.168.201.31@tcp:35:lfs.0 00000100:00100000:0.0:1789136338.825063:0:23336:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7f7de1c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bb852e64-3f46-4395-9dea-0822b7213ac8+34:19069:x1876044644789376:12345-192.168.201.31@tcp:35:lfs.0 Request processed in 364us (670us total) trans 12884901911 rc 0/0 00000100:00100000:0.0:1789136338.825073:0:23336:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 10 00000100:00100000:2.0:1789136338.917459:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:3.0:1789136338.917585:0:23332:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644789632 00000100:00100000:3.0:1789136338.917600:0:23332:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644789632 00000100:00100000:3.0:1789136338.917679:0:23332:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 50 00000100:00100000:3.0:1789136338.917692:0:23332:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7fe5ef0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bb852e64-3f46-4395-9dea-0822b7213ac8+34:19075:x1876044644789632:12345-192.168.201.31@tcp:101:bash.0 00010000:00010000:3.0:1789136338.917725:0:23332:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789136338.917757:0:23332:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ff5f4a00/0x559c8745c6de4be9 lrc: 2/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa7228e7a1ab09053 expref: -99 pid: 23332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136338.917961:0:23332:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ff5f5e00/0x559c8745c6de4bf0 lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 23332 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136338.917980:0:23332:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ff5f4400/0x559c8745c6de4b17 lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab0900d expref: 35 pid: 23334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136338.917989:0:23332:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c0030a00/0x559c8745c6de4bd4 lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab09045 expref: 35 pid: 23333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136338.917999:0:23332:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ff5f5e00/0x559c8745c6de4bf0 lrc: 5/0,1 mode: --/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 23332 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136338.918046:0:23332:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c0030a00/0x559c8745c6de4bd4 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab09045 expref: 35 pid: 23333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136338.918081:0:23332:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c0030a00/0x559c8745c6de4bd4 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab09045 expref: 35 pid: 23333 timeout: 887 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789136338.918098:0:23332:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c3ce83c0 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:23332:1876044666941824:192.168.201.31@tcp:104: 00010000:00010000:3.0:1789136338.918227:0:23332:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ff5f4400/0x559c8745c6de4b17 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab0900d expref: 35 pid: 23334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136338.918238:0:23332:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ff5f4400/0x559c8745c6de4b17 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab0900d expref: 35 pid: 23334 timeout: 887 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789136338.918247:0:23332:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c3cebc00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:23332:1876044666941952:192.168.201.31@tcp:104: 00000100:00100000:3.0:1789136338.918276:0:23332:0:(client.c:2715:ptlrpc_set_wait()) set ffff90a7c864f000 going to sleep for 11 seconds 00000100:00100000:1.0:1789136338.927940:0:23332:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c3ce83c0 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:23332:1876044666941824:192.168.201.31@tcp:104: 00000100:00100000:1.0:1789136338.927959:0:23332:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c3cebc00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:23332:1876044666941952:192.168.201.31@tcp:104: 00010000:00010000:1.0:1789136338.927999:0:23332:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ff5f5e00/0x559c8745c6de4bf0 lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 23332 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789136338.932273:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:1.0:1789136338.932479:0:23317:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644789760 00000100:00100000:1.0:1789136338.932496:0:23317:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644789760 00010000:00010000:1.0:1789136338.932557:0:23317:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c0030a00/0x559c8745c6de4bd4 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab09045 expref: 36 pid: 23333 timeout: 887 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789136338.932614:0:23317:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 17 00000100:00100000:1.0:1789136338.932625:0:23317:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7d0414c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bb852e64-3f46-4395-9dea-0822b7213ac8+36:2391:x1876044644789760:12345-192.168.201.31@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789136338.932663:0:23317:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789136338.932672:0:23317:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c0030a00/0x559c8745c6de4bd4 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab09045 expref: 36 pid: 23333 timeout: 887 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136338.932687:0:23317:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c0030a00/0x559c8745c6de4bd4 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab09045 expref: 36 pid: 23333 timeout: 887 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136338.932718:0:23317:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c0030a00/0x559c8745c6de4bd4 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab09045 expref: 36 pid: 23333 timeout: 887 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136338.932739:0:23317:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff90a7c3817500) 00010000:00010000:1.0:1789136338.932744:0:23317:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ff5f5e00/0x559c8745c6de4bf0 lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 23332 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136338.932755:0:23317:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ff5f5e00/0x559c8745c6de4bf0 lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 23332 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136338.932762:0:23317:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789136338.932839:0:23317:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7d0414c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bb852e64-3f46-4395-9dea-0822b7213ac8+35:2391:x1876044644789760:12345-192.168.201.31@tcp:103:ldlm_bl.0 Request processed in 216us (581us total) trans 0 rc 0/0 00000100:00100000:1.0:1789136338.932848:0:23317:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 17 00000100:00100000:3.0:1789136338.939352:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:2.0:1789136338.943294:0:26370:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644789888 00000100:00100000:2.0:1789136338.943315:0:26370:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644789888 00010000:00010000:2.0:1789136338.943398:0:26370:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ff5f4400/0x559c8745c6de4b17 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab0900d expref: 35 pid: 23334 timeout: 887 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789136338.943749:0:26370:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 18 00000100:00100000:2.0:1789136338.943763:0:26370:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c3ce9680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:bb852e64-3f46-4395-9dea-0822b7213ac8+35:2392:x1876044644789888:12345-192.168.201.31@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789136338.943784:0:26370:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789136338.943793:0:26370:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ff5f4400/0x559c8745c6de4b17 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab0900d expref: 35 pid: 23334 timeout: 887 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136338.943808:0:26370:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ff5f4400/0x559c8745c6de4b17 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab0900d expref: 35 pid: 23334 timeout: 887 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136338.943838:0:26370:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ff5f4400/0x559c8745c6de4b17 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab0900d expref: 35 pid: 23334 timeout: 887 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136338.943902:0:26370:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff90a7c3817500) 00010000:00010000:2.0:1789136338.943908:0:26370:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ff5f5e00/0x559c8745c6de4bf0 lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 23332 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136338.943920:0:26370:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ff5f5e00/0x559c8745c6de4bf0 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 23332 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136338.943929:0:26370:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ff5f5e00/0x559c8745c6de4bf0 lrc: 4/0,1 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 23332 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136338.943978:0:26370:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789136338.944061:0:26370:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c3ce9680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:bb852e64-3f46-4395-9dea-0822b7213ac8+34:2392:x1876044644789888:12345-192.168.201.31@tcp:103:ldlm_bl.0 Request processed in 301us (4724us total) trans 0 rc 0/0 00000100:00100000:2.0:1789136338.944070:0:26370:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 18 00010000:00010000:3.0:1789136338.944156:0:23332:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ff5f5e00/0x559c8745c6de4bf0 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 23332 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136338.944166:0:23332:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ff5f5e00/0x559c8745c6de4bf0 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 23332 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789136338.944189:0:23332:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 1234567 00010000:00010000:3.0:1789136338.944378:0:23332:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ff5f4a00/0x559c8745c6de4be9 lrc: 0/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab09053 expref: 35 pid: 23332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136338.944394:0:23332:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ff5f5e00/0x559c8745c6de4bf0 lrc: 3/0,0 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab09053 expref: 34 pid: 23332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136338.944413:0:23332:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff90a7c3817500) 00010000:00010000:3.0:1789136338.944416:0:23332:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1789136338.944419:0:23332:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a7ff5f5e00, rc 0) 00000100:00100000:3.0:1789136338.947114:0:23332:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7fe5ef0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bb852e64-3f46-4395-9dea-0822b7213ac8+34:19075:x1876044644789632:12345-192.168.201.31@tcp:101:bash.0 Request processed in 29407us (29663us total) trans 12884901912 rc 0/0 00000100:00100000:3.0:1789136338.947132:0:23332:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 50 00000100:00100000:3.0:1789136338.951232:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:1.0:1789136338.952219:0:26387:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644790144 00000100:00100000:1.0:1789136338.952236:0:26387:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644790144 00000100:00100000:1.0:1789136338.952315:0:26387:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 51 00000100:00100000:1.0:1789136338.952327:0:26387:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c3cebc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bb852e64-3f46-4395-9dea-0822b7213ac8+34:19075:x1876044644790144:12345-192.168.201.31@tcp:36:bash.0 00010000:00010000:1.0:1789136338.952679:0:26387:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3b4d400/0x559c8745c6de4bfe lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 26387 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136338.952725:0:26387:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3b4d400/0x559c8745c6de4bfe lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 26387 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136338.952740:0:26387:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3b4d400/0x559c8745c6de4bfe lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 26387 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789136338.952793:0:26387:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901913 00000004:00010000:1.0:1789136338.952820:0:26387:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 0000000053763e2f reply state 00000000fec3b76a transno 12884901914 ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3b4d400/0x559c8745c6de4bfe lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 26387 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136338.952835:0:26387:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3b4d400/0x559c8745c6de4bfe lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 26387 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136338.952844:0:26387:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff90a7c3817500) 00010000:00010000:1.0:1789136338.952847:0:26387:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1789136338.952881:0:26387:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1789136338.953006:0:26387:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c3cebc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bb852e64-3f46-4395-9dea-0822b7213ac8+37:19075:x1876044644790144:12345-192.168.201.31@tcp:36:bash.0 Request processed in 680us (1787us total) trans 12884901914 rc 0/0 00000100:00100000:1.0:1789136338.953015:0:26387:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 51 00000020:00080000:1.0:1789136338.953021:0:26387:0:(tgt_main.c:785:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1789136338.961570:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:2.0:1789136338.961811:0:23333:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644790272 00000100:00100000:2.0:1789136338.961824:0:23333:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644790272 00000100:00100000:2.0:1789136338.962019:0:23333:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 52 00000100:00100000:2.0:1789136338.962033:0:23333:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7c86dde00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bb852e64-3f46-4395-9dea-0822b7213ac8+37:19075:x1876044644790272:12345-192.168.201.31@tcp:101:bash.0 00010000:00010000:2.0:1789136338.962066:0:23333:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789136338.962096:0:23333:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c0031000/0x559c8745c6de4c05 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa7228e7a1ab0905a expref: -99 pid: 23333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136338.962175:0:23333:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c0031000/0x559c8745c6de4c05 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab0905a expref: 38 pid: 23333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136338.962191:0:23333:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c0031000/0x559c8745c6de4c05 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab0905a expref: 38 pid: 23333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136338.962237:0:23333:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff90a7c3817500) 00010000:00010000:2.0:1789136338.962241:0:23333:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1789136338.962245:0:23333:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a7c0031000, rc 0) 00000100:00100000:2.0:1789136338.962320:0:23333:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7c86dde00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bb852e64-3f46-4395-9dea-0822b7213ac8+38:19075:x1876044644790272:12345-192.168.201.31@tcp:101:bash.0 Request processed in 291us (767us total) trans 0 rc 0/0 00000100:00100000:2.0:1789136338.962329:0:23333:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 52 00000100:00100000:0.0:1789136338.978658:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:1.0:1789136338.978785:0:26387:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644790400 00000100:00100000:1.0:1789136338.978798:0:26387:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644790400 00000100:00100000:1.0:1789136338.978972:0:26387:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 53 00000100:00100000:1.0:1789136338.978986:0:26387:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7c86ded00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bb852e64-3f46-4395-9dea-0822b7213ac8+38:19075:x1876044644790400:12345-192.168.201.31@tcp:101:bash.0 00010000:00010000:1.0:1789136338.979016:0:26387:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789136338.979045:0:26387:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3b4d800/0x559c8745c6de4c0c lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa7228e7a1ab09061 expref: -99 pid: 26387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136338.979171:0:26387:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3b4c400/0x559c8745c6de4c13 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 26387 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136338.979207:0:26387:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ff5f5e00/0x559c8745c6de4bf0 lrc: 2/0,0 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab09053 expref: 39 pid: 23332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136338.979218:0:26387:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3b4c400/0x559c8745c6de4c13 lrc: 4/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x13/0x8 rrc: 9 type: IBT flags: 0x50210000000000 pid: 26387 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136338.979267:0:26387:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ff5f5e00/0x559c8745c6de4bf0 lrc: 3/0,0 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab09053 expref: 39 pid: 23332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136338.979282:0:26387:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ff5f5e00/0x559c8745c6de4bf0 lrc: 4/0,0 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab09053 expref: 39 pid: 23332 timeout: 887 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789136338.979299:0:26387:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7c14b6d00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:26387:1876044666942080:192.168.201.31@tcp:104: 00000100:00100000:1.0:1789136338.979469:0:26387:0:(client.c:2715:ptlrpc_set_wait()) set ffff90a7d6029540 going to sleep for 11 seconds 00000100:00100000:1.0:1789136338.985308:0:26387:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7c14b6d00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:26387:1876044666942080:192.168.201.31@tcp:104: 00010000:00010000:1.0:1789136338.985354:0:26387:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3b4c400/0x559c8745c6de4c13 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x13/0x8 rrc: 9 type: IBT flags: 0x40210000000000 pid: 26387 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789136338.990244:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:1.0:1789136338.990529:0:23317:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644790528 00000100:00100000:1.0:1789136338.990543:0:23317:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644790528 00010000:00010000:1.0:1789136338.990610:0:23317:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ff5f5e00/0x559c8745c6de4bf0 lrc: 4/0,0 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab09053 expref: 40 pid: 23332 timeout: 887 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789136338.990664:0:23317:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 19 00000100:00100000:1.0:1789136338.990677:0:23317:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7c86dcf00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bb852e64-3f46-4395-9dea-0822b7213ac8+40:2391:x1876044644790528:12345-192.168.201.31@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789136338.990696:0:23317:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789136338.990723:0:23317:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ff5f5e00/0x559c8745c6de4bf0 lrc: 4/0,0 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab09053 expref: 40 pid: 23332 timeout: 887 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136338.990738:0:23317:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ff5f5e00/0x559c8745c6de4bf0 lrc: 3/0,0 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab09053 expref: 40 pid: 23332 timeout: 887 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136338.990766:0:23317:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ff5f5e00/0x559c8745c6de4bf0 lrc: 0/0,0 mode: --/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab09053 expref: 40 pid: 23332 timeout: 887 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136338.990785:0:23317:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff90a7c3817500) 00010000:00010000:1.0:1789136338.990791:0:23317:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3b4c400/0x559c8745c6de4c13 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x13/0x8 rrc: 9 type: IBT flags: 0x40210000000000 pid: 26387 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136338.990804:0:23317:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3b4c400/0x559c8745c6de4c13 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 26387 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136338.990813:0:23317:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3b4c400/0x559c8745c6de4c13 lrc: 4/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 26387 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136338.990907:0:23317:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789136338.990977:0:23317:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7c86dcf00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bb852e64-3f46-4395-9dea-0822b7213ac8+39:2391:x1876044644790528:12345-192.168.201.31@tcp:103:ldlm_bl.0 Request processed in 301us (747us total) trans 0 rc 0/0 00000100:00100000:1.0:1789136338.990986:0:23317:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 19 00010000:00010000:3.0:1789136338.991306:0:26387:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3b4c400/0x559c8745c6de4c13 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 26387 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136338.991317:0:26387:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3b4c400/0x559c8745c6de4c13 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 26387 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789136338.991436:0:26387:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00000004:00200000:3.0:1789136338.991442:0:26387:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1789136338.991471:0:26387:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3b4c400/0x559c8745c6de4c13 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 26387 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136338.991513:0:26387:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3b4d800/0x559c8745c6de4c0c lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab09061 expref: 39 pid: 26387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136338.991537:0:26387:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3b4c400/0x559c8745c6de4c13 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab09061 expref: 38 pid: 26387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136338.991547:0:26387:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff90a7c3817500) 00010000:00010000:3.0:1789136338.991550:0:26387:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789136338.991553:0:26387:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a6c3b4c400, rc 0) 00000100:00100000:3.0:1789136338.991624:0:26387:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7c86ded00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bb852e64-3f46-4395-9dea-0822b7213ac8+38:19075:x1876044644790400:12345-192.168.201.31@tcp:101:bash.0 Request processed in 12641us (12981us total) trans 0 rc 0/0 00000100:00100000:3.0:1789136338.991633:0:26387:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 53 00000100:00100000:0.0:1789136339.007576:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:1.0:1789136339.007712:0:23319:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644790784 00000100:00100000:1.0:1789136339.007724:0:23319:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644790784 00000100:00100000:1.0:1789136339.007845:0:23319:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 3 00000100:00100000:1.0:1789136339.007907:0:23319:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7c86dc780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bb852e64-3f46-4395-9dea-0822b7213ac8+38:19075:x1876044644790784:12345-192.168.201.31@tcp:103:bash.0 00010000:00010000:1.0:1789136339.007929:0:23319:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:1.0:1789136339.007964:0:23319:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c0031000/0x559c8745c6de4c05 lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab0905a expref: 38 pid: 23333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136339.008015:0:23319:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3b4c400/0x559c8745c6de4c13 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab09061 expref: 37 pid: 26387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136339.008030:0:23319:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff90a7c3817500) 00010000:00010000:1.0:1789136339.008036:0:23319:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789136339.008104:0:23319:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7c86dc780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bb852e64-3f46-4395-9dea-0822b7213ac8+36:19075:x1876044644790784:12345-192.168.201.31@tcp:103:bash.0 Request processed in 250us (544us total) trans 0 rc 0/0 00000100:00100000:1.0:1789136339.008114:0:23319:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 3 00000100:00080000:2.0:1789136339.008216:0:23328:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789136339.011594:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:3.0:1789136339.011773:0:23332:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644790912 00000100:00100000:3.0:1789136339.011787:0:23332:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644790912 00000100:00100000:3.0:1789136339.011894:0:23332:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 54 00000100:00100000:3.0:1789136339.011907:0:23332:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7c14b6d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bb852e64-3f46-4395-9dea-0822b7213ac8+36:19075:x1876044644790912:12345-192.168.201.31@tcp:58:bash.0 00010000:00010000:3.0:1789136339.012046:0:23332:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ff5f4a00/0x559c8745c6de4c1a lrc: 3/0,1 mode: --/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 23332 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136339.012069:0:23332:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ff5f4a00/0x559c8745c6de4c1a lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 23332 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136339.012084:0:23332:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ff5f4a00/0x559c8745c6de4c1a lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 23332 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1789136339.027312:0:23332:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1789136339.027383:0:23332:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 64 off8384 00000040:00080000:0.0:1789136339.027552:0:23332:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x14:0x0].1, 136 off8328 00000100:00100000:0.0:1789136339.027696:0:23332:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7c14b6d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bb852e64-3f46-4395-9dea-0822b7213ac8+36:19075:x1876044644790912:12345-192.168.201.31@tcp:58:bash.0 Request processed in 15787us (16116us total) trans 0 rc 0/0 00000100:00100000:0.0:1789136339.027710:0:23332:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 54 00000100:00100000:0.0:1789136339.030434:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:3.0:1789136339.030520:0:23334:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644791040 00000100:00100000:3.0:1789136339.030529:0:23334:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644791040 00000100:00100000:3.0:1789136339.030594:0:23334:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 55 00000100:00100000:3.0:1789136339.030627:0:23334:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7c86de580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bb852e64-3f46-4395-9dea-0822b7213ac8+36:19075:x1876044644791040:12345-192.168.201.31@tcp:101:bash.0 00010000:00010000:3.0:1789136339.031175:0:23334:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789136339.031203:0:23334:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ff5f4600/0x559c8745c6de4c21 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa7228e7a1ab09068 expref: -99 pid: 23334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136339.031256:0:23334:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ff5f4a00/0x559c8745c6de4c1a lrc: 2/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 23332 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136339.031270:0:23334:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ff5f4600/0x559c8745c6de4c21 lrc: 4/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab09068 expref: 37 pid: 23334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136339.031308:0:23334:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ff5f4a00/0x559c8745c6de4c1a lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x40210400000020 pid: 23332 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136339.031324:0:23334:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ff5f4600/0x559c8745c6de4c21 lrc: 3/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab09068 expref: 37 pid: 23334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136339.031338:0:23334:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff90a7c3817500) 00010000:00010000:3.0:1789136339.031342:0:23334:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1789136339.031346:0:23334:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ff5f4600/0x559c8745c6de4c21 lrc: 3/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab09068 expref: 37 pid: 23334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136339.031353:0:23334:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a7ff5f4600, rc 0) 00000100:00100000:3.0:1789136339.031422:0:23334:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7c86de580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bb852e64-3f46-4395-9dea-0822b7213ac8+37:19075:x1876044644791040:12345-192.168.201.31@tcp:101:bash.0 Request processed in 797us (997us total) trans 0 rc 0/0 00000100:00100000:3.0:1789136339.031430:0:23334:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 55 00000040:00080000:1.0:1789136339.307320:0:23370:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:1.0:1789136339.307331:0:23370:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x14:0x0] at index 3 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1789136339.307391:0:23370:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x14:0x0] index 2 count 2 00000040:00080000:1.0:1789136339.307412:0:23370:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 4 count 2 00000100:00100000:1.0:1789136339.307554:0:23370:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c47e4000 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:23370:1876044666942208:192.168.201.31@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1789136339.307834:0:23370:0:(client.c:2715:ptlrpc_set_wait()) set ffff90a7c8691540 going to sleep for 11 seconds 00000100:00100000:0.0:1789136339.311747:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:2.0:1789136339.311878:0:23333:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644791168 00000100:00100000:2.0:1789136339.311889:0:23333:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644791168 00000100:00100000:2.0:1789136339.311959:0:23333:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 56 00000100:00100000:2.0:1789136339.311970:0:23333:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7c86dc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bb852e64-3f46-4395-9dea-0822b7213ac8+38:19076:x1876044644791168:12345-192.168.201.31@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1789136339.312004:0:23333:0:(mdt_handler.c:7985:mdt_fid2path()) path get [0x2000013a1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1789136339.312144:0:23333:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7c86dc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bb852e64-3f46-4395-9dea-0822b7213ac8+38:19076:x1876044644791168:12345-192.168.201.31@tcp:53:lhsmtool_posix.0 Request processed in 176us (408us total) trans 0 rc 0/0 00000100:00100000:2.0:1789136339.312153:0:23333:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 56 00000100:00100000:1.0:1789136339.312693:0:23370:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c47e4000 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:23370:1876044666942208:192.168.201.31@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1789136339.320753:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:1.0:1789136339.320983:0:26387:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644791296 00000100:00100000:1.0:1789136339.320994:0:26387:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644791296 00000100:00100000:1.0:1789136339.321064:0:26387:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 57 00000100:00100000:1.0:1789136339.321076:0:26387:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7c86dd2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bb852e64-3f46-4395-9dea-0822b7213ac8+37:19076:x1876044644791296:12345-192.168.201.31@tcp:34:lhsmtool_posix.0 00010000:00010000:1.0:1789136339.321156:0:26387:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3b4ca00/0x559c8745c6de4c28 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 26387 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136339.321175:0:26387:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3b4ca00/0x559c8745c6de4c28 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 26387 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136339.321218:0:26387:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3b4ca00/0x559c8745c6de4c28 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 26387 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136339.321287:0:26387:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3b4d000/0x559c8745c6de4c2f lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 26387 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136339.321296:0:26387:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3b4d000/0x559c8745c6de4c2f lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 26387 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136339.321302:0:26387:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3b4d000/0x559c8745c6de4c2f lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 26387 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136339.321326:0:26387:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3b4c800/0x559c8745c6de4c36 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 26387 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136339.321335:0:26387:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3b4c800/0x559c8745c6de4c36 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 26387 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136339.321342:0:26387:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3b4c800/0x559c8745c6de4c36 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 26387 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789136339.321417:0:26387:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00000004:00200000:1.0:1789136339.321423:0:26387:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1789136339.321442:0:26387:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3b4c800/0x559c8745c6de4c36 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 26387 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136339.321454:0:26387:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3b4ca00/0x559c8745c6de4c28 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 26387 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136339.321461:0:26387:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3b4ca00/0x559c8745c6de4c28 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 26387 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136339.321480:0:26387:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3b4ca00/0x559c8745c6de4c28 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 26387 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136339.321487:0:26387:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a6c3b4ca00 already unused, calling callback (ffffffffc19cc4f0) 00010000:00010000:1.0:1789136339.321492:0:26387:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3b4ca00/0x559c8745c6de4c28 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 26387 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136339.321501:0:26387:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3b4ca00/0x559c8745c6de4c28 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 26387 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136339.321515:0:26387:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff90a7fa5c0b00) 00010000:00010000:1.0:1789136339.321518:0:26387:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789136339.321524:0:26387:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3b4ca00/0x559c8745c6de4c28 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 26387 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136339.321530:0:26387:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3b4ca00/0x559c8745c6de4c28 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 26387 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136339.321546:0:26387:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3b4d000/0x559c8745c6de4c2f lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 26387 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136339.321552:0:26387:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3b4d000/0x559c8745c6de4c2f lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 26387 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136339.321558:0:26387:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3b4d000/0x559c8745c6de4c2f lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 26387 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136339.321563:0:26387:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a6c3b4d000 already unused, calling callback (ffffffffc19cc4f0) 00010000:00010000:1.0:1789136339.321566:0:26387:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3b4d000/0x559c8745c6de4c2f lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 26387 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136339.321583:0:26387:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3b4d000/0x559c8745c6de4c2f lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 26387 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136339.321604:0:26387:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x925dcd63 (ffff90a7d61d3800) 00010000:00010000:1.0:1789136339.321607:0:26387:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789136339.321611:0:26387:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3b4d000/0x559c8745c6de4c2f lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 26387 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136339.321617:0:26387:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3b4d000/0x559c8745c6de4c2f lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 26387 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136339.321634:0:26387:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3b4c800/0x559c8745c6de4c36 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 26387 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136339.321641:0:26387:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3b4c800/0x559c8745c6de4c36 lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 26387 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136339.321647:0:26387:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3b4c800/0x559c8745c6de4c36 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 26387 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136339.321652:0:26387:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a6c3b4c800 already unused, calling callback (ffffffffc19cc4f0) 00010000:00010000:1.0:1789136339.321655:0:26387:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3b4c800/0x559c8745c6de4c36 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 26387 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136339.321660:0:26387:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3b4c800/0x559c8745c6de4c36 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 26387 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136339.321668:0:26387:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff90a7c3817500) 00010000:00010000:1.0:1789136339.321670:0:26387:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789136339.321673:0:26387:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3b4c800/0x559c8745c6de4c36 lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 26387 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136339.321689:0:26387:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3b4c800/0x559c8745c6de4c36 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 26387 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789136339.321772:0:26387:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7c86dd2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bb852e64-3f46-4395-9dea-0822b7213ac8+37:19076:x1876044644791296:12345-192.168.201.31@tcp:34:lhsmtool_posix.0 Request processed in 697us (1029us total) trans 0 rc 0/0 00000100:00100000:1.0:1789136339.321781:0:26387:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 57 00000100:00100000:3.0:1789136339.326773:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:2.0:1789136339.326974:0:23333:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644791552 00000100:00100000:2.0:1789136339.326985:0:23333:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644791552 00000100:00100000:2.0:1789136339.327052:0:23333:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 58 00000100:00100000:2.0:1789136339.327064:0:23333:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c3ce83c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bb852e64-3f46-4395-9dea-0822b7213ac8+37:19076:x1876044644791552:12345-192.168.201.31@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789136339.327085:0:23333:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789136339.327107:0:23333:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c0031400/0x559c8745c6de4c3d lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa7228e7a1ab0906f expref: -99 pid: 23333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136339.327230:0:23333:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c0031000/0x559c8745c6de4c44 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 23333 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136339.327266:0:23333:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c0031000/0x559c8745c6de4c44 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 23333 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136339.327279:0:23333:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c0031000/0x559c8745c6de4c44 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 23333 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789136339.327293:0:23333:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00010000:00010000:2.0:1789136339.327381:0:23333:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c0031000/0x559c8745c6de4c44 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 23333 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136339.327390:0:23333:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c0031000/0x559c8745c6de4c44 lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 23333 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136339.329515:0:23333:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c0031000/0x559c8745c6de4c44 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 23333 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136339.329524:0:23333:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a7c0031000 already unused, calling callback (ffffffffc19cc4f0) 00010000:00010000:2.0:1789136339.329529:0:23333:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c0031000/0x559c8745c6de4c44 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 23333 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136339.329538:0:23333:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c0031000/0x559c8745c6de4c44 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 23333 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136339.329555:0:23333:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff90a7c3817500) 00010000:00010000:2.0:1789136339.329559:0:23333:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789136339.329563:0:23333:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c0031000/0x559c8745c6de4c44 lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 23333 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136339.329571:0:23333:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c0031000/0x559c8745c6de4c44 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 23333 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136339.329645:0:23333:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c0031400/0x559c8745c6de4c3d lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab0906f expref: 39 pid: 23333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136339.329674:0:23333:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff90a7fa5c0b00) 00010000:00010000:2.0:1789136339.329676:0:23333:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789136339.329681:0:23333:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c0031400/0x559c8745c6de4c3d lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab0906f expref: 39 pid: 23333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136339.329692:0:23333:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a7c0031400, rc 0) 00000100:00100000:2.0:1789136339.329774:0:23333:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c3ce83c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bb852e64-3f46-4395-9dea-0822b7213ac8+38:19076:x1876044644791552:12345-192.168.201.31@tcp:101:lhsmtool_posix.0 Request processed in 2712us (3010us total) trans 12884901915 rc 301/301 00000100:00100000:2.0:1789136339.329782:0:23333:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 58 00000100:00100000:3.0:1789136339.332467:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:1.0:1789136339.332626:0:26387:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644791680 00000100:00100000:1.0:1789136339.332636:0:26387:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644791680 00000100:00100000:1.0:1789136339.332698:0:26387:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 59 00000100:00100000:1.0:1789136339.332710:0:26387:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7c69e8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bb852e64-3f46-4395-9dea-0822b7213ac8+38:19076:x1876044644791680:12345-192.168.201.31@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1789136339.332750:0:26387:0:(mdt_handler.c:7985:mdt_fid2path()) path get [0x2000013a1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1789136339.332888:0:26387:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7c69e8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bb852e64-3f46-4395-9dea-0822b7213ac8+38:19076:x1876044644791680:12345-192.168.201.31@tcp:53:lhsmtool_posix.0 Request processed in 180us (429us total) trans 0 rc 0/0 00000100:00100000:1.0:1789136339.332897:0:26387:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 59 00000100:00100000:1.0:1789136339.357954:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:0.0:1789136339.358117:0:23332:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644791936 00000100:00100000:0.0:1789136339.358128:0:23332:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644791936 00000100:00100000:0.0:1789136339.358196:0:23332:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 60 00000100:00100000:0.0:1789136339.358207:0:23332:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c47e4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bb852e64-3f46-4395-9dea-0822b7213ac8+38:19076:x1876044644791936:12345-192.168.201.31@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789136339.358229:0:23332:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789136339.358253:0:23332:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3caf400/0x559c8745c6de4c52 lrc: 2/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa7228e7a1ab09076 expref: -99 pid: 23332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1789136339.358656:0:23332:0:(osp_internal.h:553:osp_update_last_fid()) Gap in objids: start=[0x280000401:0x23:0x0], count =31 00000004:00080000:0.0:1789136339.358664:0:23332:0:(osp_object.c:1645:osp_create()) Writing gap [0x280000401:0x23:0x0]+31 in llog 00000004:00080000:0.0:1789136339.358685:0:23332:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x42:0x0], index 0: 0 00010000:00010000:0.0:1789136339.358833:0:23332:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3caf800/0x559c8745c6de4c59 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 23332 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136339.358849:0:23332:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3caf800/0x559c8745c6de4c59 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 23332 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136339.358905:0:23332:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3caf800/0x559c8745c6de4c59 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 23332 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136339.358964:0:23332:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3caf400/0x559c8745c6de4c52 lrc: 0/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab09076 expref: 41 pid: 23332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136339.359003:0:23332:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3caf800/0x559c8745c6de4c59 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab09076 expref: 40 pid: 23332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136339.359013:0:23332:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff90a7fa5c0700) 00010000:00010000:0.0:1789136339.359016:0:23332:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789136339.359019:0:23332:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a6c3caf800, rc 0) 00000100:00100000:0.0:1789136339.359084:0:23332:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c47e4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bb852e64-3f46-4395-9dea-0822b7213ac8+40:19076:x1876044644791936:12345-192.168.201.31@tcp:101:lhsmtool_posix.0 Request processed in 878us (1142us total) trans 12884901916 rc 0/0 00000100:00100000:0.0:1789136339.359092:0:23332:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 60 00000100:00100000:2.0:1789136339.377022:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:1.0:1789136339.377185:0:26387:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644792192 00000100:00100000:1.0:1789136339.377201:0:26387:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644792192 00000100:00100000:1.0:1789136339.377287:0:26387:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 61 00000100:00100000:1.0:1789136339.377300:0:26387:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7fe5ef840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bb852e64-3f46-4395-9dea-0822b7213ac8+40:19076:x1876044644792192:12345-192.168.201.31@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1789136339.377375:0:26387:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789136339.377484:0:26387:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3caf800/0x559c8745c6de4c59 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab09076 expref: 40 pid: 23332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136339.377506:0:26387:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff90a7fa5c0700) 00010000:00010000:1.0:1789136339.377519:0:26387:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789136339.377557:0:26387:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3b4c800/0x559c8745c6de4c67 lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 26387 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136339.377571:0:26387:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3b4c800/0x559c8745c6de4c67 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 26387 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136339.377582:0:26387:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3b4c800/0x559c8745c6de4c67 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 26387 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136339.377596:0:26387:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3b4d000/0x559c8745c6de4c6e lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x1:0x0].0x2116129f bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 26387 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136339.377604:0:26387:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3b4d000/0x559c8745c6de4c6e lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x2116129f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 26387 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136339.377610:0:26387:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3b4d000/0x559c8745c6de4c6e lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x2116129f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 26387 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136339.377653:0:26387:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3b4c800/0x559c8745c6de4c67 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 26387 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136339.377671:0:26387:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3b4c800/0x559c8745c6de4c67 lrc: 2/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 26387 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136339.377678:0:26387:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3b4c800/0x559c8745c6de4c67 lrc: 3/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 26387 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136339.377684:0:26387:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a6c3b4c800 already unused, calling callback (ffffffffc19cc4f0) 00010000:00010000:1.0:1789136339.377688:0:26387:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3b4c800/0x559c8745c6de4c67 lrc: 3/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 26387 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136339.377695:0:26387:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3b4c800/0x559c8745c6de4c67 lrc: 4/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 26387 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136339.377716:0:26387:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff90a7d61d3600) 00010000:00010000:1.0:1789136339.377718:0:26387:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789136339.377722:0:26387:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3b4c800/0x559c8745c6de4c67 lrc: 2/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 26387 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136339.377729:0:26387:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3b4c800/0x559c8745c6de4c67 lrc: 0/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 26387 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136339.377741:0:26387:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3b4d000/0x559c8745c6de4c6e lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x2116129f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 26387 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136339.377748:0:26387:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3b4d000/0x559c8745c6de4c6e lrc: 2/0,0 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x2116129f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 26387 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136339.377754:0:26387:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3b4d000/0x559c8745c6de4c6e lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x2116129f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 26387 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136339.377759:0:26387:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a6c3b4d000 already unused, calling callback (ffffffffc19cc4f0) 00010000:00010000:1.0:1789136339.377762:0:26387:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3b4d000/0x559c8745c6de4c6e lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x2116129f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 26387 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136339.377767:0:26387:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3b4d000/0x559c8745c6de4c6e lrc: 4/0,0 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x2116129f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 26387 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136339.377774:0:26387:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x2116129f (ffff90a7d61d3800) 00010000:00010000:1.0:1789136339.377776:0:26387:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789136339.377779:0:26387:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3b4d000/0x559c8745c6de4c6e lrc: 2/0,0 mode: --/PW res: [0x2000013a1:0x1:0x0].0x2116129f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 26387 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136339.377784:0:26387:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3b4d000/0x559c8745c6de4c6e lrc: 0/0,0 mode: --/PW res: [0x2000013a1:0x1:0x0].0x2116129f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 26387 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789136339.378650:0:26387:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7fe5ef840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bb852e64-3f46-4395-9dea-0822b7213ac8+39:19076:x1876044644792192:12345-192.168.201.31@tcp:36:lhsmtool_posix.0 Request processed in 1347us (1638us total) trans 0 rc -2/-2 00000100:00100000:1.0:1789136339.378661:0:26387:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 61 00000100:00100000:3.0:1789136339.382805:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:1.0:1789136339.382931:0:23332:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644792320 00000100:00100000:1.0:1789136339.382941:0:23332:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644792320 00000100:00100000:1.0:1789136339.382995:0:23332:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 62 00000100:00100000:1.0:1789136339.383006:0:23332:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7fa3bd2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bb852e64-3f46-4395-9dea-0822b7213ac8+39:19076:x1876044644792320:12345-192.168.201.31@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789136339.383189:0:23332:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789136339.383210:0:23332:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3b4ca00/0x559c8745c6de4c75 lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa7228e7a1ab0907d expref: -99 pid: 23332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136339.383250:0:23332:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3b4c200/0x559c8745c6de4c7c lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 23332 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136339.383263:0:23332:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3b4c200/0x559c8745c6de4c7c lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 23332 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136339.383276:0:23332:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3b4c200/0x559c8745c6de4c7c lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 23332 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136339.383472:0:23332:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3b4ca00/0x559c8745c6de4c75 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab0907d expref: 41 pid: 23332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136339.383495:0:23332:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3b4c200/0x559c8745c6de4c7c lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab0907d expref: 40 pid: 23332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136339.383503:0:23332:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff90a7d61d3900) 00010000:00010000:1.0:1789136339.383513:0:23332:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1789136339.383518:0:23332:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a6c3b4c200, rc 0) 00000100:00100000:1.0:1789136339.383585:0:23332:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7fa3bd2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bb852e64-3f46-4395-9dea-0822b7213ac8+40:19076:x1876044644792320:12345-192.168.201.31@tcp:101:lhsmtool_posix.0 Request processed in 580us (790us total) trans 0 rc 0/0 00000100:00100000:1.0:1789136339.383592:0:23332:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 62 00000100:00100000:2.0:1789136339.388829:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:3.0:1789136339.389277:0:23334:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644792576 00000100:00100000:3.0:1789136339.389287:0:23334:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644792576 00000100:00100000:3.0:1789136339.389353:0:23334:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 63 00000100:00100000:3.0:1789136339.389375:0:23334:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7fe5ed680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bb852e64-3f46-4395-9dea-0822b7213ac8+40:19076:x1876044644792576:12345-192.168.201.31@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1789136339.389579:0:23334:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ff5f4c00/0x559c8745c6de4c83 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 23334 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136339.389611:0:23334:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ff5f4c00/0x559c8745c6de4c83 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 23334 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136339.389640:0:23334:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ff5f4c00/0x559c8745c6de4c83 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 23334 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1789136339.389822:0:23334:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x10:0x0].2, 88 off8344 00000004:00080000:3.0:1789136339.389832:0:23334:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 787508976759ns, next at 788508974337ns, rc = 0 00000004:00010000:3.0:1789136339.389921:0:23334:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 00000000fbff6f62 reply state 0000000000f2f994 transno 12884901917 ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ff5f4c00/0x559c8745c6de4c83 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 23334 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136339.389935:0:23334:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ff5f4c00/0x559c8745c6de4c83 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 23334 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136339.389944:0:23334:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff90a7d61d3900) 00010000:00010000:3.0:1789136339.389947:0:23334:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:3.0:1789136339.389950:0:23334:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1789136339.390543:0:23334:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7fe5ed680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bb852e64-3f46-4395-9dea-0822b7213ac8+42:19076:x1876044644792576:12345-192.168.201.31@tcp:36:lhsmtool_posix.0 Request processed in 1166us (1719us total) trans 12884901917 rc 0/0 00000100:00100000:3.0:1789136339.390552:0:23334:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 63 00000100:00100000:2.0:1789136339.400889:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:1.0:1789136339.401057:0:23332:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644792704 00000100:00100000:1.0:1789136339.401067:0:23332:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644792704 00000100:00100000:1.0:1789136339.401125:0:23332:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 64 00000100:00100000:1.0:1789136339.401136:0:23332:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7fe5ecb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bb852e64-3f46-4395-9dea-0822b7213ac8+42:19076:x1876044644792704:12345-192.168.201.31@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789136339.401161:0:23332:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789136339.401183:0:23332:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3b4ca00/0x559c8745c6de4c8a lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa7228e7a1ab09084 expref: -99 pid: 23332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136339.401245:0:23332:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3b4ca00/0x559c8745c6de4c8a lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab09084 expref: 43 pid: 23332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136339.401261:0:23332:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3b4ca00/0x559c8745c6de4c8a lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab09084 expref: 43 pid: 23332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136339.401280:0:23332:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff90a7d61d3900) 00010000:00010000:1.0:1789136339.401283:0:23332:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1789136339.401287:0:23332:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a6c3b4ca00, rc 0) 00000100:00100000:1.0:1789136339.401353:0:23332:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7fe5ecb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bb852e64-3f46-4395-9dea-0822b7213ac8+43:19076:x1876044644792704:12345-192.168.201.31@tcp:101:lhsmtool_posix.0 Request processed in 219us (475us total) trans 0 rc 0/0 00000100:00100000:1.0:1789136339.401371:0:23332:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 64 00000100:00100000:1.0:1789136339.405462:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:3.0:1789136339.405619:0:25418:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644792832 00000100:00100000:3.0:1789136339.405630:0:25418:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644792832 00000100:00080000:2.0:1789136339.405786:0:23328:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789136339.406116:0:25418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 23 00000100:00100000:3.0:1789136339.406130:0:25418:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7f036e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:bb852e64-3f46-4395-9dea-0822b7213ac8+5:2392:x1876044644792832:12345-192.168.201.31@tcp:2:lhsmtool_posix.0 00000100:00100000:3.0:1789136339.406388:0:25418:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7f036e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:bb852e64-3f46-4395-9dea-0822b7213ac8+6:2392:x1876044644792832:12345-192.168.201.31@tcp:2:lhsmtool_posix.0 Request processed in 261us (936us total) trans 12884901891 rc 0/0 00000100:00100000:3.0:1789136339.406403:0:25418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 23 00000100:00100000:3.0:1789136339.419719:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:0.0:1789136339.421310:0:23336:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644793088 00000100:00100000:0.0:1789136339.421328:0:23336:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644793088 00000100:00100000:0.0:1789136339.421438:0:23336:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 11 00000100:00100000:0.0:1789136339.421450:0:23336:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7fa3bcb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bb852e64-3f46-4395-9dea-0822b7213ac8+43:19076:x1876044644793088:12345-192.168.201.31@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1789136339.421782:0:23336:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7fa3bcb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bb852e64-3f46-4395-9dea-0822b7213ac8+44:19076:x1876044644793088:12345-192.168.201.31@tcp:35:lhsmtool_posix.0 Request processed in 332us (2076us total) trans 12884901918 rc 0/0 00000100:00100000:0.0:1789136339.421791:0:23336:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 11 00000100:00100000:2.0:1789136339.449147:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:1.0:1789136339.449276:0:26387:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644793344 00000100:00100000:1.0:1789136339.449309:0:26387:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644793344 00000100:00100000:1.0:1789136339.449409:0:26387:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 65 00000100:00100000:1.0:1789136339.449432:0:26387:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7fcf46940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bb852e64-3f46-4395-9dea-0822b7213ac8+44:19076:x1876044644793344:12345-192.168.201.31@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1789136339.449671:0:26387:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7fcf46940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bb852e64-3f46-4395-9dea-0822b7213ac8+44:19076:x1876044644793344:12345-192.168.201.31@tcp:57:lhsmtool_posix.0 Request processed in 248us (531us total) trans 0 rc 0/0 00000100:00100000:1.0:1789136339.449679:0:26387:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 65 00000100:00100000:3.0:1789136339.458397:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:1.0:1789136339.458552:0:23332:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644793472 00000100:00100000:1.0:1789136339.458563:0:23332:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644793472 00000100:00100000:1.0:1789136339.458636:0:23332:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 66 00000100:00100000:1.0:1789136339.458645:0:23332:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7fa3bde00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bb852e64-3f46-4395-9dea-0822b7213ac8+44:19076:x1876044644793472:12345-192.168.201.31@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789136339.458668:0:23332:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789136339.458691:0:23332:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3b4d000/0x559c8745c6de4c91 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa7228e7a1ab0908b expref: -99 pid: 23332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136339.458781:0:23332:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3b4c800/0x559c8745c6de4c98 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 23332 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136339.458798:0:23332:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3b4c800/0x559c8745c6de4c98 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 23332 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136339.458812:0:23332:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3b4c800/0x559c8745c6de4c98 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 23332 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789136339.458909:0:23332:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1789136339.458935:0:23332:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3b4c800/0x559c8745c6de4c98 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 23332 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136339.458970:0:23332:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3b4d000/0x559c8745c6de4c91 lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab0908b expref: 46 pid: 23332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136339.459016:0:23332:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3b4c800/0x559c8745c6de4c98 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab0908b expref: 45 pid: 23332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136339.459023:0:23332:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff90a7d61d3900) 00010000:00010000:1.0:1789136339.459026:0:23332:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1789136339.459029:0:23332:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a6c3b4c800, rc 0) 00000100:00100000:1.0:1789136339.459259:0:23332:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7fa3bde00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bb852e64-3f46-4395-9dea-0822b7213ac8+45:19076:x1876044644793472:12345-192.168.201.31@tcp:101:lhsmtool_posix.0 Request processed in 614us (876us total) trans 0 rc 0/0 00000100:00100000:1.0:1789136339.459266:0:23332:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 66 00000100:00100000:2.0:1789136339.465233:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:3.0:1789136339.465443:0:24845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644793600 00000100:00100000:3.0:1789136339.465467:0:24845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644793600 00000100:00100000:3.0:1789136339.465524:0:24845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 24 00000100:00100000:3.0:1789136339.465534:0:24845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7fcf44f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:bb852e64-3f46-4395-9dea-0822b7213ac8+6:2391:x1876044644793600:12345-192.168.201.31@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789136339.465552:0:24845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789136339.465573:0:24845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b6292b74/0x559c8745c6de4c9f lrc: 2/0,0 mode: --/PR res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa7228e7a1ab09092 expref: -99 pid: 24845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789136339.465601:0:24845:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x42:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6aa40dd3, blocks: 0x0 00010000:00010000:3.0:1789136339.465621:0:24845:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x42:0x0].0x0 since=787s v=(0 0) 00010000:00010000:3.0:1789136339.465627:0:24845:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789136339.465636:0:24845:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b6292b74/0x559c8745c6de4c9f lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab09092 expref: 7 pid: 24845 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136339.465657:0:24845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000b6292b74/0x559c8745c6de4c9f lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab09092 expref: 7 pid: 24845 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136339.465669:0:24845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a7ff5f5600, rc 0) 00000100:00100000:3.0:1789136339.465732:0:24845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7fcf44f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:bb852e64-3f46-4395-9dea-0822b7213ac8+7:2391:x1876044644793600:12345-192.168.201.31@tcp:101:lhsmtool_posix.0 Request processed in 200us (510us total) trans 0 rc 0/0 00000100:00100000:3.0:1789136339.465740:0:24845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 24 00000100:00100000:3.0:1789136339.474337:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:1.0:1789136339.476070:0:26387:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644793856 00000100:00100000:1.0:1789136339.476085:0:26387:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644793856 00000100:00100000:3.0:1789136339.476389:0:23334:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 67 00000100:00100000:3.0:1789136339.476416:0:23334:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7fa3bc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bb852e64-3f46-4395-9dea-0822b7213ac8+45:19076:x1876044644793856:12345-192.168.201.31@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1789136339.476547:0:23334:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7fa3bc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bb852e64-3f46-4395-9dea-0822b7213ac8+45:19076:x1876044644793856:12345-192.168.201.31@tcp:57:lhsmtool_posix.0 Request processed in 135us (2219us total) trans 0 rc 0/0 00000100:00100000:3.0:1789136339.476575:0:23334:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 67 00000100:00100000:0.0:1789136339.484275:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:1.0:1789136339.485725:0:23332:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644793984 00000100:00100000:1.0:1789136339.485743:0:23332:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644793984 00000100:00100000:2.0:1789136339.486028:0:23332:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 68 00000100:00100000:2.0:1789136339.486042:0:23332:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7c86dcb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bb852e64-3f46-4395-9dea-0822b7213ac8+45:19076:x1876044644793984:12345-192.168.201.31@tcp:44:lhsmtool_posix.0 00000001:00080000:1.0:1789136339.490415:0:23312:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 12884901918 is committed 00000004:00080000:1.0:1789136339.490441:0:23312:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2 committed 00000001:00080000:1.0:1789136339.490535:0:23312:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 12884901895 is committed 00000100:00100000:1.0:1789136339.490844:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7f02b9e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1876044666942336:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1789136339.490991:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1789136339.491262:0:3625:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c0031200/0x559c8745c6de4ab5 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 23333 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136339.491276:0:3625:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c0031200/0x559c8745c6de4ab5 lrc: 2/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 23333 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136339.491284:0:3625:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c0031200/0x559c8745c6de4ab5 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 23333 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136339.491290:0:3625:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a7c0031200 already unused, calling callback (ffffffffc19cc4f0) 00010000:00010000:3.0:1789136339.491296:0:3625:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c0031200/0x559c8745c6de4ab5 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 23333 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136339.491304:0:3625:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c0031200/0x559c8745c6de4ab5 lrc: 4/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 23333 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136339.491337:0:3625:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff90a7d61d3600) 00010000:00010000:3.0:1789136339.491341:0:3625:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00010000:00010000:3.0:1789136339.491347:0:3625:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c0031200/0x559c8745c6de4ab5 lrc: 2/0,0 mode: --/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 23333 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136339.491363:0:3625:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c0031200/0x559c8745c6de4ab5 lrc: 0/0,0 mode: --/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 23333 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789136339.491491:0:24846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666942336 00000100:00100000:0.0:1789136339.491502:0:24846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666942336 00000100:00100000:0.0:1789136339.491583:0:24846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1789136339.491594:0:24846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c47e5e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3638:x1876044666942336:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1789136339.491772:0:24846:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x42:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1789136339.491777:0:24846:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x42:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:0.0:1789136339.491779:0:24846:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x42:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1789136339.491781:0:24846:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x42:0x0] updating lvb ctime from disk: 1789136339 -> 1789136339 00002000:00010000:0.0:1789136339.491801:0:24846:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x42:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:0.0:1789136339.491899:0:24846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c47e5e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3638:x1876044666942336:12345-0@lo:2:osp-syn-0-0.0 Request processed in 306us (908us total) trans 12884901892 rc 0/0 00000100:00100000:0.0:1789136339.491908:0:24846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00080000:1.0:1789136339.492234:0:23328:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000004:00080000:1.0:1789136339.492284:0:3638:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff90a7f02b9e00/2, rc 0, transno 12884901892 00000100:00100000:1.0:1789136339.492291:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7f02b9e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1876044666942336:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1789136339.493260:0:23332:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7c86dcb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bb852e64-3f46-4395-9dea-0822b7213ac8+20:19076:x1876044644793984:12345-192.168.201.31@tcp:44:lhsmtool_posix.0 Request processed in 7043us (8821us total) trans 0 rc 0/0 00000100:00100000:3.0:1789136339.493273:0:23332:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 68 00010000:00010000:2.0:1789136339.493922:0:3624:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3b4de00/0x559c8745c6de4a61 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 23334 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136339.493937:0:3624:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3b4de00/0x559c8745c6de4a61 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 23334 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136339.493947:0:3624:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3b4de00/0x559c8745c6de4a61 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 23334 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136339.493985:0:3624:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a6c3b4de00 already unused, calling callback (ffffffffc19cc4f0) 00010000:00010000:2.0:1789136339.493990:0:3624:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3b4de00/0x559c8745c6de4a61 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 23334 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136339.494000:0:3624:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3b4de00/0x559c8745c6de4a61 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 23334 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136339.494020:0:3624:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa6028a67 (ffff90a7d61d3100) 00010000:00010000:2.0:1789136339.494023:0:3624:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789136339.494029:0:3624:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3b4de00/0x559c8745c6de4a61 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 23334 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136339.494036:0:3624:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3b4de00/0x559c8745c6de4a61 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 23334 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136339.494067:0:3624:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3b4cc00/0x559c8745c6de4a68 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 23334 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136339.494074:0:3624:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3b4cc00/0x559c8745c6de4a68 lrc: 2/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 23334 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136339.494081:0:3624:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3b4cc00/0x559c8745c6de4a68 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 23334 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136339.494096:0:3624:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a6c3b4cc00 already unused, calling callback (ffffffffc19cc4f0) 00010000:00010000:2.0:1789136339.494099:0:3624:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3b4cc00/0x559c8745c6de4a68 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 23334 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136339.494106:0:3624:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3b4cc00/0x559c8745c6de4a68 lrc: 4/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 23334 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136339.494125:0:3624:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff90a7d61d3600) 00010000:00010000:2.0:1789136339.494127:0:3624:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789136339.494755:0:3624:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3b4cc00/0x559c8745c6de4a68 lrc: 2/0,0 mode: --/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 23334 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136339.494769:0:3624:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3b4cc00/0x559c8745c6de4a68 lrc: 0/0,0 mode: --/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 23334 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136339.494792:0:3624:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ff5f4000/0x559c8745c6de4b10 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 23334 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136339.494798:0:3624:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ff5f4000/0x559c8745c6de4b10 lrc: 2/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 23334 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136339.494804:0:3624:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ff5f4000/0x559c8745c6de4b10 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 23334 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136339.494808:0:3624:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a7ff5f4000 already unused, calling callback (ffffffffc19cc4f0) 00010000:00010000:2.0:1789136339.494812:0:3624:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ff5f4000/0x559c8745c6de4b10 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 23334 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136339.494818:0:3624:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ff5f4000/0x559c8745c6de4b10 lrc: 4/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 23334 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136339.494827:0:3624:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0xb42112bc (ffff90a7c3817400) 00010000:00010000:2.0:1789136339.494830:0:3624:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789136339.494835:0:3624:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ff5f4000/0x559c8745c6de4b10 lrc: 2/0,0 mode: --/TXN res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 23334 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136339.494841:0:3624:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ff5f4000/0x559c8745c6de4b10 lrc: 0/0,0 mode: --/TXN res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 23334 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136339.494893:0:3624:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ff5f5200/0x559c8745c6de4b95 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 23334 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136339.494900:0:3624:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ff5f5200/0x559c8745c6de4b95 lrc: 2/0,0 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 23334 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136339.494905:0:3624:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ff5f5200/0x559c8745c6de4b95 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 23334 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136339.494910:0:3624:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a7ff5f5200 already unused, calling callback (ffffffffc19cc4f0) 00010000:00010000:2.0:1789136339.494912:0:3624:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ff5f5200/0x559c8745c6de4b95 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 23334 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136339.494918:0:3624:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ff5f5200/0x559c8745c6de4b95 lrc: 4/0,0 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 23334 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136339.494927:0:3624:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff90a7c3817500) 00010000:00010000:2.0:1789136339.494929:0:3624:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789136339.494932:0:3624:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ff5f5200/0x559c8745c6de4b95 lrc: 2/0,0 mode: --/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 23334 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136339.494937:0:3624:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ff5f5200/0x559c8745c6de4b95 lrc: 0/0,0 mode: --/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 23334 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136339.494947:0:3624:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3b4d600/0x559c8745c6de4bb8 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 26387 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136339.494953:0:3624:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3b4d600/0x559c8745c6de4bb8 lrc: 2/0,0 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 26387 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136339.494958:0:3624:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3b4d600/0x559c8745c6de4bb8 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 26387 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136339.494968:0:3624:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a6c3b4d600 already unused, calling callback (ffffffffc19cc4f0) 00010000:00010000:2.0:1789136339.494971:0:3624:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3b4d600/0x559c8745c6de4bb8 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 26387 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136339.494976:0:3624:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3b4d600/0x559c8745c6de4bb8 lrc: 4/0,0 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 26387 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136339.494984:0:3624:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff90a7c3817500) 00010000:00010000:2.0:1789136339.494985:0:3624:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789136339.494988:0:3624:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3b4d600/0x559c8745c6de4bb8 lrc: 2/0,0 mode: --/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 26387 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136339.494993:0:3624:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3b4d600/0x559c8745c6de4bb8 lrc: 0/0,0 mode: --/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 26387 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136339.495006:0:3624:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3b4d400/0x559c8745c6de4bfe lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 26387 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136339.495012:0:3624:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3b4d400/0x559c8745c6de4bfe lrc: 2/0,0 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 26387 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136339.495017:0:3624:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3b4d400/0x559c8745c6de4bfe lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 26387 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136339.495022:0:3624:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a6c3b4d400 already unused, calling callback (ffffffffc19cc4f0) 00010000:00010000:2.0:1789136339.495024:0:3624:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3b4d400/0x559c8745c6de4bfe lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 26387 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136339.495030:0:3624:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3b4d400/0x559c8745c6de4bfe lrc: 4/0,0 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 26387 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136339.495048:0:3624:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff90a7c3817500) 00010000:00010000:2.0:1789136339.495050:0:3624:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789136339.495054:0:3624:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3b4d400/0x559c8745c6de4bfe lrc: 2/0,0 mode: --/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 26387 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136339.495060:0:3624:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3b4d400/0x559c8745c6de4bfe lrc: 0/0,0 mode: --/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 26387 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136339.495072:0:3624:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ff5f4c00/0x559c8745c6de4c83 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 23334 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136339.495078:0:3624:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ff5f4c00/0x559c8745c6de4c83 lrc: 2/0,0 mode: TXN/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 23334 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136339.496737:0:3624:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ff5f4c00/0x559c8745c6de4c83 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 23334 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136339.496758:0:3624:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a7ff5f4c00 already unused, calling callback (ffffffffc19cc4f0) 00010000:00010000:2.0:1789136339.496763:0:3624:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ff5f4c00/0x559c8745c6de4c83 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 23334 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136339.496772:0:3624:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ff5f4c00/0x559c8745c6de4c83 lrc: 4/0,0 mode: TXN/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 23334 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136339.496790:0:3624:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff90a7d61d3900) 00010000:00010000:2.0:1789136339.496793:0:3624:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1789136339.496798:0:3624:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ff5f4c00/0x559c8745c6de4c83 lrc: 2/0,0 mode: --/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 23334 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136339.496805:0:3624:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ff5f4c00/0x559c8745c6de4c83 lrc: 0/0,0 mode: --/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 23334 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789136339.499453:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:3.0:1789136339.499784:0:24845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644794112 00000100:00100000:3.0:1789136339.499797:0:24845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644794112 00000100:00100000:3.0:1789136339.499920:0:24845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 26 00000100:00100000:3.0:1789136339.499931:0:24845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7fcf470c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:bb852e64-3f46-4395-9dea-0822b7213ac8+7:2391:x1876044644794112:12345-192.168.201.31@tcp:16:lhsmtool_posix.0 00000100:00100000:3.0:1789136339.500169:0:24845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7fcf470c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:bb852e64-3f46-4395-9dea-0822b7213ac8+7:2391:x1876044644794112:12345-192.168.201.31@tcp:16:lhsmtool_posix.0 Request processed in 239us (729us total) trans 0 rc 0/0 00000100:00100000:3.0:1789136339.500179:0:24845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 26 00000100:00100000:0.0:1789136339.515024:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:3.0:1789136339.516726:0:23334:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644794368 00000100:00100000:3.0:1789136339.516745:0:23334:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644794368 00000100:00100000:3.0:1789136339.516843:0:23334:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 69 00000100:00100000:3.0:1789136339.516896:0:23334:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7f02ba1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bb852e64-3f46-4395-9dea-0822b7213ac8+14:19076:x1876044644794368:12345-192.168.201.31@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1789136339.517005:0:23334:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789136339.517041:0:23334:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3b4c800/0x559c8745c6de4c98 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab0908b expref: 14 pid: 23332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136339.517072:0:23334:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff90a7d61d3900) 00010000:00010000:3.0:1789136339.517079:0:23334:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789136339.517330:0:23334:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ff5f5000/0x559c8745c6de4ca6 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 23334 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136339.517348:0:23334:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ff5f5000/0x559c8745c6de4ca6 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 23334 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136339.517371:0:23334:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ff5f5000/0x559c8745c6de4ca6 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 23334 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789136339.517541:0:23334:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 00000000972ed061 reply state 0000000027ebbd2e transno 12884901919 ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ff5f5000/0x559c8745c6de4ca6 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 23334 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136339.517555:0:23334:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ff5f5000/0x559c8745c6de4ca6 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 23334 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136339.517574:0:23334:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff90a7d61d3900) 00010000:00010000:3.0:1789136339.517576:0:23334:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1789136339.517580:0:23334:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1789136339.517952:0:23334:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7f02ba1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bb852e64-3f46-4395-9dea-0822b7213ac8+15:19076:x1876044644794368:12345-192.168.201.31@tcp:36:lhsmtool_posix.0 Request processed in 1095us (2940us total) trans 12884901919 rc 0/0 00000100:00100000:3.0:1789136339.517962:0:23334:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 69 00000100:00100000:2.0:1789136339.523060:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:0.0:1789136339.523240:0:24846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644794496 00000100:00100000:0.0:1789136339.523254:0:24846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644794496 00000100:00100000:0.0:1789136339.523325:0:24846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 27 00000100:00100000:0.0:1789136339.523336:0:24846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7fcf45a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bb852e64-3f46-4395-9dea-0822b7213ac8+7:19076:x1876044644794496:12345-192.168.201.31@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789136339.523371:0:24846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789136339.523399:0:24846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f1d20fab/0x559c8745c6de4cad lrc: 2/0,0 mode: --/PW res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa7228e7a1ab09099 expref: -99 pid: 24846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136339.523443:0:24846:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000b6292b74/0x559c8745c6de4c9f lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab09092 expref: 8 pid: 24845 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136339.523454:0:24846:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789136339.523460:0:24846:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789136339.523466:0:24846:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f1d20fab/0x559c8745c6de4cad lrc: 4/0,0 mode: --/PW res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab09099 expref: 8 pid: 24846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136339.523514:0:24846:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000b6292b74/0x559c8745c6de4c9f lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab09092 expref: 8 pid: 24845 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136339.523531:0:24846:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000b6292b74/0x559c8745c6de4c9f lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab09092 expref: 8 pid: 24845 timeout: 887 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789136339.523570:0:24846:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7f02bb480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:24846:1876044666942464:192.168.201.31@tcp:104: 00000100:00100000:0.0:1789136339.523847:0:24846:0:(client.c:2715:ptlrpc_set_wait()) set ffff90a6c2225600 going to sleep for 11 seconds 00000100:00100000:0.0:1789136339.528128:0:24846:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7f02bb480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:24846:1876044666942464:192.168.201.31@tcp:104: 00010000:00010000:0.0:1789136339.528180:0:24846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000f1d20fab/0x559c8745c6de4cad lrc: 3/0,0 mode: --/PW res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab09099 expref: 8 pid: 24846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136339.528209:0:24846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a6c3caf800, rc 0) 00000100:00100000:0.0:1789136339.528291:0:24846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7fcf45a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bb852e64-3f46-4395-9dea-0822b7213ac8+8:19076:x1876044644794496:12345-192.168.201.31@tcp:101:lhsmtool_posix.0 Request processed in 4956us (5245us total) trans 0 rc 0/0 00000100:00100000:0.0:1789136339.528302:0:24846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 27 00000100:00100000:3.0:1789136339.531023:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:1.0:1789136339.531402:0:23317:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644794624 00000100:00100000:1.0:1789136339.531415:0:23317:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644794624 00010000:00010000:1.0:1789136339.531470:0:23317:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000b6292b74/0x559c8745c6de4c9f lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab09092 expref: 8 pid: 24845 timeout: 887 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789136339.531553:0:23317:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 20 00000100:00100000:1.0:1789136339.531564:0:23317:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7ff648f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bb852e64-3f46-4395-9dea-0822b7213ac8+8:2391:x1876044644794624:12345-192.168.201.31@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789136339.531586:0:23317:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789136339.531617:0:23317:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000b6292b74/0x559c8745c6de4c9f lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab09092 expref: 8 pid: 24845 timeout: 887 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136339.531633:0:23317:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000b6292b74/0x559c8745c6de4c9f lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab09092 expref: 8 pid: 24845 timeout: 887 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136339.531663:0:23317:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b6292b74/0x559c8745c6de4c9f lrc: 0/0,0 mode: --/PR res: [0x280000401:0x42:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab09092 expref: 8 pid: 24845 timeout: 887 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136339.531684:0:23317:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789136339.531689:0:23317:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789136339.531697:0:23317:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000f1d20fab/0x559c8745c6de4cad lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab09099 expref: 7 pid: 24846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136339.531709:0:23317:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f1d20fab/0x559c8745c6de4cad lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab09099 expref: 7 pid: 24846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136339.531754:0:23317:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000f1d20fab/0x559c8745c6de4cad lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab09099 expref: 7 pid: 24846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789136339.531808:0:23317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c47e4780 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:23317:1876044666942592:192.168.201.31@tcp:105: 00000100:00100000:1.0:1789136339.531967:0:23317:0:(client.c:2715:ptlrpc_set_wait()) set ffff90a7c8691a80 going to sleep for 11 seconds 00000100:00100000:2.0:1789136339.535562:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:1.0:1789136339.535688:0:23317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c47e4780 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:23317:1876044666942592:192.168.201.31@tcp:105: 00010000:00010000:1.0:1789136339.535724:0:23317:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789136339.535820:0:23317:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7ff648f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bb852e64-3f46-4395-9dea-0822b7213ac8+7:2391:x1876044644794624:12345-192.168.201.31@tcp:103:ldlm_bl.0 Request processed in 4256us (4812us total) trans 0 rc 0/0 00000100:00100000:1.0:1789136339.535833:0:23317:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 20 00000100:00100000:3.0:1789136339.536203:0:24845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644794752 00000100:00100000:3.0:1789136339.536213:0:24845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644794752 00000100:00100000:3.0:1789136339.536276:0:24845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 28 00000100:00100000:3.0:1789136339.536286:0:24845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7fcf44780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:bb852e64-3f46-4395-9dea-0822b7213ac8+7:2391:x1876044644794752:12345-192.168.201.31@tcp:2:lhsmtool_posix.0 00002000:00010000:3.0:1789136339.536551:0:24845:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x42:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1789136339.536555:0:24845:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x42:0x0] updating lvb mtime from disk: 0 -> 1789136338 00002000:00010000:3.0:1789136339.536557:0:24845:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x42:0x0] updating lvb atime from disk: 0 -> 1789136336 00002000:00010000:3.0:1789136339.536559:0:24845:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x42:0x0] updating lvb ctime from disk: 1789136339 -> 1789136338 00002000:00010000:3.0:1789136339.536561:0:24845:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x42:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:3.0:1789136339.536609:0:24845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7fcf44780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:bb852e64-3f46-4395-9dea-0822b7213ac8+8:2391:x1876044644794752:12345-192.168.201.31@tcp:2:lhsmtool_posix.0 Request processed in 323us (1062us total) trans 12884901893 rc 0/0 00000100:00100000:3.0:1789136339.536617:0:24845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 28 00000100:00100000:2.0:1789136339.552280:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:3.0:1789136339.552392:0:25418:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644794880 00000100:00100000:3.0:1789136339.552406:0:25418:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644794880 00000100:00100000:3.0:1789136339.552488:0:25418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 29 00000100:00100000:3.0:1789136339.552502:0:25418:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7fcf47c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:bb852e64-3f46-4395-9dea-0822b7213ac8+8:2389:x1876044644794880:12345-192.168.201.31@tcp:1:lhsmtool_posix.0 00010000:00010000:3.0:1789136339.552567:0:25418:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000d57b5b09/0x559c8745c6de4cb4 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136339.552620:0:25418:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000f1d20fab/0x559c8745c6de4cad lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab09099 expref: 8 pid: 24846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136339.552629:0:25418:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789136339.552634:0:25418:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x42:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1789136339.552640:0:25418:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d57b5b09/0x559c8745c6de4cb4 lrc: 4/1,0 mode: --/PR res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 25418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136339.552685:0:25418:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000f1d20fab/0x559c8745c6de4cad lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000020020 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab09099 expref: 8 pid: 24846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136339.552703:0:25418:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000f1d20fab/0x559c8745c6de4cad lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400020020 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab09099 expref: 8 pid: 24846 timeout: 887 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789136339.552721:0:25418:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7ff64b840 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:25418:1876044666942720:192.168.201.31@tcp:104: 00000100:00100000:3.0:1789136339.552916:0:25418:0:(client.c:2715:ptlrpc_set_wait()) set ffff90a7c864f000 going to sleep for 11 seconds 00000100:00100000:3.0:1789136339.556348:0:25418:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7ff64b840 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:25418:1876044666942720:192.168.201.31@tcp:104: 00010000:00010000:3.0:1789136339.556395:0:25418:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000d57b5b09/0x559c8745c6de4cb4 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 25418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789136339.556999:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:1.0:1789136339.557452:0:23319:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644795008 00000100:00100000:1.0:1789136339.557462:0:23319:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644795008 00010000:00010000:1.0:1789136339.557518:0:23319:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000f1d20fab/0x559c8745c6de4cad lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab09099 expref: 9 pid: 24846 timeout: 887 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789136339.557571:0:23319:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 21 00000100:00100000:1.0:1789136339.557582:0:23319:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7fcf461c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bb852e64-3f46-4395-9dea-0822b7213ac8+9:2391:x1876044644795008:12345-192.168.201.31@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789136339.557601:0:23319:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789136339.557629:0:23319:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000f1d20fab/0x559c8745c6de4cad lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab09099 expref: 9 pid: 24846 timeout: 887 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136339.557644:0:23319:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000f1d20fab/0x559c8745c6de4cad lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400020020 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab09099 expref: 9 pid: 24846 timeout: 887 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136339.557672:0:23319:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f1d20fab/0x559c8745c6de4cad lrc: 0/0,0 mode: --/PW res: [0x280000401:0x42:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400020020 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab09099 expref: 9 pid: 24846 timeout: 887 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136339.557716:0:23319:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x42:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1789136339.557721:0:23319:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x42:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1789136339.557728:0:23319:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000d57b5b09/0x559c8745c6de4cb4 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 25418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136339.557740:0:23319:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d57b5b09/0x559c8745c6de4cb4 lrc: 4/1,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 25418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136339.557791:0:23319:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789136339.557887:0:25418:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000d57b5b09/0x559c8745c6de4cb4 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 25418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136339.557899:0:25418:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d57b5b09/0x559c8745c6de4cb4 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 25418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789136339.557909:0:23319:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7fcf461c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bb852e64-3f46-4395-9dea-0822b7213ac8+8:2391:x1876044644795008:12345-192.168.201.31@tcp:103:ldlm_bl.0 Request processed in 326us (911us total) trans 0 rc 0/0 00000100:00100000:1.0:1789136339.557920:0:23319:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 21 00010000:00010000:0.0:1789136339.557929:0:25418:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000d57b5b09/0x559c8745c6de4cb4 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 25418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136339.557939:0:25418:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d57b5b09/0x559c8745c6de4cb4 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 25418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136339.557948:0:25418:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d57b5b09/0x559c8745c6de4cb4 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 25418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136339.557964:0:25418:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a7ff5f5400 already unused, calling callback (ffffffffc0dbf540) 00010000:00010000:0.0:1789136339.557970:0:25418:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d57b5b09/0x559c8745c6de4cb4 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 25418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136339.557980:0:25418:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d57b5b09/0x559c8745c6de4cb4 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 25418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136339.557995:0:25418:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d57b5b09/0x559c8745c6de4cb4 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 25418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136339.558004:0:25418:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d57b5b09/0x559c8745c6de4cb4 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 25418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789136339.558070:0:25418:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7fcf47c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:bb852e64-3f46-4395-9dea-0822b7213ac8+7:2389:x1876044644794880:12345-192.168.201.31@tcp:1:lhsmtool_posix.0 Request processed in 5571us (5805us total) trans 0 rc 0/0 00000100:00100000:0.0:1789136339.558081:0:25418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 29 00000100:00100000:0.0:1789136339.562327:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:3.0:1789136339.563964:0:23333:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644795264 00000100:00100000:3.0:1789136339.563982:0:23333:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644795264 00000100:00100000:3.0:1789136339.564073:0:23333:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 70 00000100:00100000:3.0:1789136339.564084:0:23333:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7f02bb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bb852e64-3f46-4395-9dea-0822b7213ac8+15:19076:x1876044644795264:12345-192.168.201.31@tcp:57:lhsmtool_posix.0 00010000:00010000:3.0:1789136339.564216:0:23333:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ff5f4e00/0x559c8745c6de4cbb lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 23333 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136339.564236:0:23333:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ff5f5c00/0x559c8745c6de4b8e lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab09037 expref: 15 pid: 23332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136339.564246:0:23333:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ff5f4e00/0x559c8745c6de4cbb lrc: 4/0,1 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 23333 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136339.564286:0:23333:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ff5f5c00/0x559c8745c6de4b8e lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab09037 expref: 15 pid: 23332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136339.564301:0:23333:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ff5f5c00/0x559c8745c6de4b8e lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab09037 expref: 15 pid: 23332 timeout: 887 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789136339.564315:0:23333:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7ff64b840 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:23333:1876044666942848:192.168.201.31@tcp:104: 00000100:00100000:3.0:1789136339.564443:0:23333:0:(client.c:2715:ptlrpc_set_wait()) set ffff90a7c864f000 going to sleep for 11 seconds 00000100:00100000:3.0:1789136339.569466:0:23333:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7ff64b840 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:23333:1876044666942848:192.168.201.31@tcp:104: 00010000:00010000:3.0:1789136339.569507:0:23333:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ff5f4e00/0x559c8745c6de4cbb lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 23333 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789136339.570828:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:2.0:1789136339.571244:0:23318:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644795392 00000100:00100000:2.0:1789136339.571256:0:23318:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644795392 00010000:00010000:2.0:1789136339.571314:0:23318:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ff5f5c00/0x559c8745c6de4b8e lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab09037 expref: 16 pid: 23332 timeout: 887 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789136339.571366:0:23318:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 22 00000100:00100000:2.0:1789136339.571377:0:23318:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7f02b8f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bb852e64-3f46-4395-9dea-0822b7213ac8+16:2391:x1876044644795392:12345-192.168.201.31@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789136339.571397:0:23318:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789136339.571406:0:23318:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ff5f5c00/0x559c8745c6de4b8e lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab09037 expref: 16 pid: 23332 timeout: 887 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136339.571422:0:23318:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ff5f5c00/0x559c8745c6de4b8e lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab09037 expref: 16 pid: 23332 timeout: 887 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136339.571451:0:23318:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ff5f5c00/0x559c8745c6de4b8e lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab09037 expref: 16 pid: 23332 timeout: 887 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136339.571471:0:23318:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff90a7c3817500) 00010000:00010000:2.0:1789136339.571477:0:23318:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ff5f4600/0x559c8745c6de4c21 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab09068 expref: 15 pid: 23334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136339.571511:0:23318:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ff5f4e00/0x559c8745c6de4cbb lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 23333 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136339.571520:0:23318:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ff5f4e00/0x559c8745c6de4cbb lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 23333 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136339.571529:0:23318:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ff5f4e00/0x559c8745c6de4cbb lrc: 4/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 23333 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136339.571574:0:23318:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789136339.571715:0:23318:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7f02b8f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bb852e64-3f46-4395-9dea-0822b7213ac8+15:2391:x1876044644795392:12345-192.168.201.31@tcp:103:ldlm_bl.0 Request processed in 338us (895us total) trans 0 rc 0/0 00000100:00100000:2.0:1789136339.571725:0:23318:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 22 00010000:00010000:0.0:1789136339.571802:0:23333:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ff5f4e00/0x559c8745c6de4cbb lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 23333 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136339.571812:0:23333:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ff5f4e00/0x559c8745c6de4cbb lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 23333 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136339.572122:0:23333:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1878800/0x559c8745c6de4cc2 lrc: 3/0,1 mode: --/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 23333 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136339.572147:0:23333:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3b4ca00/0x559c8745c6de4c8a lrc: 2/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab09084 expref: 15 pid: 23332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136339.572157:0:23333:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1878800/0x559c8745c6de4cc2 lrc: 4/0,1 mode: --/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 23333 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136339.572196:0:23333:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3b4ca00/0x559c8745c6de4c8a lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab09084 expref: 15 pid: 23332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136339.572213:0:23333:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3b4ca00/0x559c8745c6de4c8a lrc: 4/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab09084 expref: 15 pid: 23332 timeout: 887 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789136339.572230:0:23333:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7f02b8780 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:23333:1876044666942976:192.168.201.31@tcp:104: 00000100:00100000:0.0:1789136339.572308:0:23333:0:(client.c:2715:ptlrpc_set_wait()) set ffff90a6c2225e40 going to sleep for 11 seconds 00000100:00100000:0.0:1789136339.577278:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:3.0:1789136339.577412:0:23333:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7f02b8780 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:23333:1876044666942976:192.168.201.31@tcp:104: 00010000:00010000:3.0:1789136339.577449:0:23333:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1878800/0x559c8745c6de4cc2 lrc: 3/0,1 mode: --/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 23333 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789136339.579939:0:23319:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644795520 00000100:00100000:1.0:1789136339.579962:0:23319:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644795520 00010000:00010000:1.0:1789136339.580035:0:23319:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3b4ca00/0x559c8745c6de4c8a lrc: 4/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab09084 expref: 16 pid: 23332 timeout: 887 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789136339.580103:0:23319:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 23 00000100:00100000:1.0:1789136339.580114:0:23319:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7d0417050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bb852e64-3f46-4395-9dea-0822b7213ac8+16:2392:x1876044644795520:12345-192.168.201.31@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789136339.580142:0:23319:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789136339.580151:0:23319:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3b4ca00/0x559c8745c6de4c8a lrc: 4/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab09084 expref: 16 pid: 23332 timeout: 887 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136339.580166:0:23319:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3b4ca00/0x559c8745c6de4c8a lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab09084 expref: 16 pid: 23332 timeout: 887 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136339.580221:0:23319:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a6c3b4ca00/0x559c8745c6de4c8a lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab09084 expref: 16 pid: 23332 timeout: 887 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136339.580244:0:23319:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff90a7d61d3900) 00010000:00010000:1.0:1789136339.580250:0:23319:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1878800/0x559c8745c6de4cc2 lrc: 3/0,1 mode: --/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 23333 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136339.580261:0:23319:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1878800/0x559c8745c6de4cc2 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 23333 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136339.580270:0:23319:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1878800/0x559c8745c6de4cc2 lrc: 4/0,1 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 23333 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136339.580302:0:23319:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789136339.580398:0:23319:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7d0417050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bb852e64-3f46-4395-9dea-0822b7213ac8+15:2392:x1876044644795520:12345-192.168.201.31@tcp:103:ldlm_bl.0 Request processed in 285us (3136us total) trans 0 rc 0/0 00000100:00100000:1.0:1789136339.580407:0:23319:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 23 00010000:00010000:0.0:1789136339.581809:0:23333:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1878800/0x559c8745c6de4cc2 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 23333 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789136339.581826:0:23333:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1878800/0x559c8745c6de4cc2 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 23333 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789136339.582018:0:23333:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901920 00000001:00080000:0.0:1789136339.582188:0:23333:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901921 00000001:00080000:0.0:1789136339.582224:0:23333:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901922 00000100:00100000:0.0:1789136339.582321:0:23333:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7f02bbc00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:23333:1876044666943104:0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1789136339.582419:0:23333:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789136339.582465:0:23333:0:(client.c:2715:ptlrpc_set_wait()) set ffff90a6c2225e40 going to sleep for 11 seconds 00000100:00100000:1.0:1789136339.583306:0:23339:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666943104 00000100:00100000:1.0:1789136339.583319:0:23339:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666943104 00000100:00100000:1.0:1789136339.583405:0:23339:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1789136339.583417:0:23339:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7f02b8f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:23333:x1876044666943104:12345-0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1789136339.583567:0:23339:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7f02b8f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:23333:x1876044666943104:12345-0@lo:1000:mdt00_001.0 Request processed in 152us (1147us total) trans 0 rc 0/0 00000100:00100000:1.0:1789136339.583575:0:23339:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1789136339.583647:0:23333:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7f02bbc00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:23333:1876044666943104:0@lo:1000:mdt00_001.0 00000001:00080000:3.0:1789136339.583936:0:23333:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901923 00000100:00100000:3.0:1789136339.584037:0:23333:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7ff64b840 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:23333:1876044666943232:0@lo:1000:mdt00_001.0 00000100:00100000:3.0:1789136339.584083:0:23333:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789136339.584112:0:23333:0:(client.c:2715:ptlrpc_set_wait()) set ffff90a7c864f0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789136339.584745:0:24077:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666943232 00000100:00100000:1.0:1789136339.584755:0:24077:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666943232 00000100:00100000:1.0:1789136339.584825:0:24077:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1789136339.584836:0:24077:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7ff648f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:23333:x1876044666943232:12345-0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1789136339.585070:0:24077:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7ff648f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+7:23333:x1876044666943232:12345-0@lo:1000:mdt00_001.0 Request processed in 236us (986us total) trans 12884901894 rc 0/0 00000100:00100000:1.0:1789136339.585080:0:24077:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1789136339.586096:0:23333:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7ff64b840 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:23333:1876044666943232:0@lo:1000:mdt00_001.0 00010000:00010000:3.0:1789136339.586164:0:23333:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1878800/0x559c8745c6de4cc2 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 23333 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136339.586176:0:23333:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1878800/0x559c8745c6de4cc2 lrc: 2/0,0 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 23333 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136339.586184:0:23333:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1878800/0x559c8745c6de4cc2 lrc: 3/0,0 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 23333 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136339.586190:0:23333:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a7d1878800 already unused, calling callback (ffffffffc19cc4f0) 00010000:00010000:3.0:1789136339.586196:0:23333:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1878800/0x559c8745c6de4cc2 lrc: 3/0,0 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 23333 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136339.586205:0:23333:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1878800/0x559c8745c6de4cc2 lrc: 4/0,0 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 23333 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136339.586222:0:23333:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff90a7d61d3900) 00010000:00010000:3.0:1789136339.586225:0:23333:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1789136339.586231:0:23333:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1878800/0x559c8745c6de4cc2 lrc: 2/0,0 mode: --/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 23333 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136339.586237:0:23333:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a7d1878800/0x559c8745c6de4cc2 lrc: 0/0,0 mode: --/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 23333 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136339.586282:0:23333:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ff5f4a00/0x559c8745c6de4c1a lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000020 pid: 23332 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136339.586288:0:23333:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ff5f4a00/0x559c8745c6de4c1a lrc: 2/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000020 pid: 23332 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136339.586308:0:23333:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ff5f4a00/0x559c8745c6de4c1a lrc: 3/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 23332 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136339.586312:0:23333:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a7ff5f4a00 already unused, calling callback (ffffffffc19cc4f0) 00010000:00010000:3.0:1789136339.586315:0:23333:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ff5f4a00/0x559c8745c6de4c1a lrc: 3/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 23332 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136339.586321:0:23333:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ff5f4a00/0x559c8745c6de4c1a lrc: 4/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000020 pid: 23332 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136339.586329:0:23333:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff90a7c3817500) 00010000:00010000:3.0:1789136339.586331:0:23333:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1789136339.586339:0:23333:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ff5f4600/0x559c8745c6de4c21 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab09068 expref: 18 pid: 23334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136339.586363:0:23333:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ff5f4600/0x559c8745c6de4c21 lrc: 2/0,0 mode: CR/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab09068 expref: 18 pid: 23334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136339.586372:0:23333:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ff5f4600/0x559c8745c6de4c21 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab09068 expref: 18 pid: 23334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136339.586447:0:23333:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ff5f4600/0x559c8745c6de4c21 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab09068 expref: 18 pid: 23334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789136339.586465:0:23333:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7f662f0c0 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:23333:1876044666943360:192.168.201.31@tcp:105: 00000100:00100000:3.0:1789136339.586659:0:23333:0:(client.c:2715:ptlrpc_set_wait()) set ffff90a7c864ff00 going to sleep for 11 seconds 00000100:00100000:0.0:1789136339.601145:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:2.0:1789136339.601225:0:23336:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644795648 00000100:00100000:2.0:1789136339.601237:0:23336:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644795648 00000100:00100000:3.0:1789136339.601261:0:23333:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7f662f0c0 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:23333:1876044666943360:192.168.201.31@tcp:105: 00010000:00010000:3.0:1789136339.601311:0:23333:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ff5f4a00/0x559c8745c6de4c1a lrc: 2/0,0 mode: --/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000020 pid: 23332 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789136339.601312:0:23336:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 12 00010000:00010000:3.0:1789136339.601323:0:23333:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ff5f4a00/0x559c8745c6de4c1a lrc: 0/0,0 mode: --/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000020 pid: 23332 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789136339.601323:0:23336:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7f02b8780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bb852e64-3f46-4395-9dea-0822b7213ac8+19:19075:x1876044644795648:12345-192.168.201.31@tcp:49:bash.0 00010000:00010000:3.0:1789136339.601421:0:23333:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ff5f5c00/0x559c8745c6de4cc9 lrc: 3/0,1 mode: --/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 23333 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136339.601439:0:23333:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ff5f5c00/0x559c8745c6de4cc9 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 23333 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136339.601451:0:23333:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ff5f5c00/0x559c8745c6de4cc9 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 23333 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136339.601460:0:23333:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ff5f5c00/0x559c8745c6de4cc9 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 23333 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136339.601466:0:23333:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ff5f5c00/0x559c8745c6de4cc9 lrc: 2/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 23333 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136339.601472:0:23333:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ff5f5c00/0x559c8745c6de4cc9 lrc: 3/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 23333 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136339.601477:0:23333:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a7ff5f5c00 already unused, calling callback (ffffffffc19cc4f0) 00010000:00010000:3.0:1789136339.601481:0:23333:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ff5f5c00/0x559c8745c6de4cc9 lrc: 3/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 23333 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136339.601488:0:23333:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ff5f5c00/0x559c8745c6de4cc9 lrc: 4/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 23333 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789136339.601496:0:23336:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7f02b8780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bb852e64-3f46-4395-9dea-0822b7213ac8+19:19075:x1876044644795648:12345-192.168.201.31@tcp:49:bash.0 Request processed in 175us (365us total) trans 0 rc 0/0 00010000:00010000:3.0:1789136339.601500:0:23333:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff90a7c3817500) 00000100:00100000:2.0:1789136339.601503:0:23336:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 12 00010000:00010000:3.0:1789136339.601508:0:23333:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789136339.601513:0:23333:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ff5f5c00/0x559c8745c6de4cc9 lrc: 2/0,0 mode: --/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 23333 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136339.601519:0:23333:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ff5f5c00/0x559c8745c6de4cc9 lrc: 0/0,0 mode: --/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 23333 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136339.601529:0:23333:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ff5f4e00/0x559c8745c6de4cbb lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 23333 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136339.601534:0:23333:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ff5f4e00/0x559c8745c6de4cbb lrc: 2/0,0 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 23333 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136339.601540:0:23333:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ff5f4e00/0x559c8745c6de4cbb lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 23333 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136339.601544:0:23333:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a7ff5f4e00 already unused, calling callback (ffffffffc19cc4f0) 00010000:00010000:3.0:1789136339.601547:0:23333:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ff5f4e00/0x559c8745c6de4cbb lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 23333 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136339.601552:0:23333:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ff5f4e00/0x559c8745c6de4cbb lrc: 4/0,0 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 23333 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136339.601561:0:23333:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff90a7c3817500) 00010000:00010000:3.0:1789136339.601563:0:23333:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1789136339.601566:0:23333:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ff5f4e00/0x559c8745c6de4cbb lrc: 2/0,0 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 23333 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136339.601572:0:23333:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ff5f4e00/0x559c8745c6de4cbb lrc: 0/0,0 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 23333 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789136339.601800:0:23333:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7f02bb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bb852e64-3f46-4395-9dea-0822b7213ac8+18:19076:x1876044644795264:12345-192.168.201.31@tcp:57:lhsmtool_posix.0 Request processed in 37716us (39487us total) trans 12884901924 rc 0/0 00000100:00100000:3.0:1789136339.601820:0:23333:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 70 00000020:00080000:3.0:1789136339.601824:0:23333:0:(tgt_main.c:785:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:2.0:1789136339.602110:0:23370:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:2.0:1789136339.602116:0:23370:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x14:0x0] at index 3 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1789136339.602134:0:23370:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x14:0x0] index 2 count 2 00000040:00080000:2.0:1789136339.602142:0:23370:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 4 count 2 00000100:00100000:0.0:1789136339.604960:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:3.0:1789136339.605717:0:24845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644795776 00000100:00100000:3.0:1789136339.605732:0:24845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644795776 00000100:00100000:3.0:1789136339.605817:0:24845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 30 00000100:00100000:3.0:1789136339.605829:0:24845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7f02bbc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:bb852e64-3f46-4395-9dea-0822b7213ac8+7:19075:x1876044644795776:12345-192.168.201.31@tcp:101:bash.0 00010000:00010000:3.0:1789136339.605878:0:24845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789136339.605907:0:24845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d57b5b09/0x559c8745c6de4cd0 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa7228e7a1ab090a0 expref: -99 pid: 24845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789136339.605942:0:24845:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x42:0x0] initial LVB size: 0, mtime: 0x6aa40dd2, atime: 0x6aa40dd0, ctime: 0x6aa40dd2, blocks: 0x0 00010000:00010000:3.0:1789136339.605969:0:24845:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x42:0x0].0x0 since=787s v=(0 0) 00010000:00010000:3.0:1789136339.605975:0:24845:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789136339.605987:0:24845:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d57b5b09/0x559c8745c6de4cd0 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab090a0 expref: 8 pid: 24845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136339.606007:0:24845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000d57b5b09/0x559c8745c6de4cd0 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab090a0 expref: 8 pid: 24845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136339.606022:0:24845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a7ff5f5400, rc 0) 00000100:00100000:2.0:1789136339.606024:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:2.0:1789136339.606052:0:23336:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644796032 00000100:00100000:2.0:1789136339.606057:0:23336:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644796032 00000100:00100000:3.0:1789136339.606090:0:24845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7f02bbc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:bb852e64-3f46-4395-9dea-0822b7213ac8+8:19075:x1876044644795776:12345-192.168.201.31@tcp:101:bash.0 Request processed in 263us (1146us total) trans 0 rc 0/0 00000100:00100000:3.0:1789136339.606098:0:24845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 30 00000100:00100000:2.0:1789136339.606111:0:23335:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 13 00000100:00100000:2.0:1789136339.606118:0:23335:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7fcf443c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bb852e64-3f46-4395-9dea-0822b7213ac8+18:19076:x1876044644796032:12345-192.168.201.31@tcp:35:lhsmtool_posix.0 00000004:00080000:2.0:1789136339.606471:0:23335:0:(mdd_object.c:4024:mdd_close()) Object [0x2000013a1:0x3:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:2.0:1789136339.606512:0:23335:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901925 00010000:00010000:2.0:1789136339.606546:0:23335:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c0031200/0x559c8745c6de4cd7 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 23335 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136339.606562:0:23335:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c0031200/0x559c8745c6de4cd7 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010080000000 pid: 23335 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136339.606573:0:23335:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c0031200/0x559c8745c6de4cd7 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 23335 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136339.606583:0:23335:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c0031200/0x559c8745c6de4cd7 lrc: 4/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 23335 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136339.606590:0:23335:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c0031200/0x559c8745c6de4cd7 lrc: 4/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 23335 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136339.606597:0:23335:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c0031200/0x559c8745c6de4cd7 lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 23335 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136339.606625:0:23335:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789136339.606677:0:23321:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789136339.606687:0:23321:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c0031200/0x559c8745c6de4cd7 lrc: 2/0,0 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 23335 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136339.606695:0:23321:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a7c0031200 already unused, calling callback (ffffffffc0dbf540) 00010000:00010000:1.0:1789136339.606699:0:23321:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c0031200/0x559c8745c6de4cd7 lrc: 2/0,0 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 23335 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136339.606707:0:23321:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c0031200/0x559c8745c6de4cd7 lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40018480000000 pid: 23335 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136339.606720:0:23321:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff90a7d61d3900) 00010000:00010000:1.0:1789136339.606723:0:23321:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1789136339.606728:0:23321:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c0031200/0x559c8745c6de4cd7 lrc: 1/0,0 mode: --/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 23335 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136339.606735:0:23321:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c0031200/0x559c8745c6de4cd7 lrc: 0/0,0 mode: --/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 23335 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789136339.606749:0:23321:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789136339.606752:0:23321:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789136339.606753:0:23321:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789136339.607621:0:23335:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7fcf443c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bb852e64-3f46-4395-9dea-0822b7213ac8+20:19076:x1876044644796032:12345-192.168.201.31@tcp:35:lhsmtool_posix.0 Request processed in 1494us (1587us total) trans 12884901926 rc 0/0 00000100:00100000:2.0:1789136339.607634:0:23335:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 13 00000020:00080000:2.0:1789136339.607642:0:23335:0:(tgt_main.c:785:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1789136339.614419:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:3.0:1789136339.614660:0:26387:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644796160 00000100:00100000:3.0:1789136339.614673:0:26387:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644796160 00000100:00100000:3.0:1789136339.614754:0:26387:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 71 00000100:00100000:3.0:1789136339.614798:0:26387:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7fcf47480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bb852e64-3f46-4395-9dea-0822b7213ac8+20:19075:x1876044644796160:12345-192.168.201.31@tcp:101:bash.0 00010000:00010000:3.0:1789136339.614827:0:26387:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789136339.614869:0:26387:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ff5f5600/0x559c8745c6de4cde lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa7228e7a1ab090a7 expref: -99 pid: 26387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136339.614917:0:26387:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ff5f4c00/0x559c8745c6de4ce5 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 26387 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136339.614936:0:26387:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ff5f4c00/0x559c8745c6de4ce5 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 26387 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136339.614950:0:26387:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ff5f4c00/0x559c8745c6de4ce5 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 26387 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136339.615105:0:26387:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ff5f5600/0x559c8745c6de4cde lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab090a7 expref: 22 pid: 26387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136339.615124:0:26387:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ff5f4c00/0x559c8745c6de4ce5 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab090a7 expref: 21 pid: 26387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136339.615134:0:26387:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff90a7c3817500) 00010000:00010000:3.0:1789136339.615137:0:26387:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1789136339.615142:0:26387:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a7ff5f4c00, rc 0) 00000100:00100000:3.0:1789136339.615222:0:26387:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7fcf47480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bb852e64-3f46-4395-9dea-0822b7213ac8+21:19075:x1876044644796160:12345-192.168.201.31@tcp:101:bash.0 Request processed in 428us (819us total) trans 0 rc 0/0 00000100:00100000:3.0:1789136339.615229:0:26387:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 71 00000100:00100000:0.0:1789136339.619197:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:2.0:1789136339.619920:0:23335:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644796416 00000100:00100000:2.0:1789136339.619934:0:23335:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644796416 00000100:00100000:2.0:1789136339.620013:0:23335:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 14 00000100:00100000:2.0:1789136339.620040:0:23335:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c4760b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bb852e64-3f46-4395-9dea-0822b7213ac8+21:19075:x1876044644796416:12345-192.168.201.31@tcp:35:bash.0 00000001:00080000:2.0:1789136339.620301:0:23335:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901927 00000001:00080000:2.0:1789136339.620427:0:23335:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901928 00000100:00100000:2.0:1789136339.620561:0:23335:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c4760b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bb852e64-3f46-4395-9dea-0822b7213ac8+24:19075:x1876044644796416:12345-192.168.201.31@tcp:35:bash.0 Request processed in 521us (1382us total) trans 12884901929 rc 0/0 00000100:00100000:2.0:1789136339.620569:0:23335:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 14 00000020:00080000:2.0:1789136339.620574:0:23335:0:(tgt_main.c:785:tgt_ses_key_exit()) total 3 transactions per RPC 00010000:00010000:0.0:1789136339.688290:0:23320:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789136339.777724:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:2.0:1789136339.779312:0:23332:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644796672 00000100:00100000:2.0:1789136339.779333:0:23332:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644796672 00000100:00100000:2.0:1789136339.779452:0:23332:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 72 00000100:00100000:2.0:1789136339.779466:0:23332:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c47621c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bb852e64-3f46-4395-9dea-0822b7213ac8+24:19086:x1876044644796672:12345-192.168.201.31@tcp:101:lfs.0 00010000:00010000:2.0:1789136339.779502:0:23332:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789136339.779535:0:23332:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c0031200/0x559c8745c6de4cec lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa7228e7a1ab090ae expref: -99 pid: 23332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789136339.779674:0:23332:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00010000:00010000:2.0:1789136339.779825:0:23332:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c0031200/0x559c8745c6de4cec lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab090ae expref: 26 pid: 23332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136339.779843:0:23332:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90a7d61d3200) 00010000:00010000:2.0:1789136339.779847:0:23332:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789136339.779913:0:23332:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a7c0031200/0x559c8745c6de4cec lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.31@tcp remote: 0xa7228e7a1ab090ae expref: 26 pid: 23332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789136339.779932:0:23332:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a7c0031200, rc 0) 00000100:00100000:2.0:1789136339.780021:0:23332:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c47621c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bb852e64-3f46-4395-9dea-0822b7213ac8+25:19086:x1876044644796672:12345-192.168.201.31@tcp:101:lfs.0 Request processed in 559us (2306us total) trans 12884901930 rc 301/301 00000100:00100000:2.0:1789136339.780052:0:23332:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 72 00000100:00100000:1.0:1789136339.787542:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:3.0:1789136339.787664:0:26387:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644796800 00000100:00100000:3.0:1789136339.787679:0:26387:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644796800 00000100:00100000:3.0:1789136339.787761:0:26387:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 73 00000100:00100000:3.0:1789136339.787804:0:26387:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c47e4780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bb852e64-3f46-4395-9dea-0822b7213ac8+25:19086:x1876044644796800:12345-192.168.201.31@tcp:34:lfs.0 00010000:00010000:3.0:1789136339.788543:0:26387:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ff5f5600/0x559c8745c6de4cfa lrc: 3/1,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 26387 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136339.788568:0:26387:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ff5f5600/0x559c8745c6de4cfa lrc: 3/1,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 26387 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136339.788585:0:26387:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ff5f5600/0x559c8745c6de4cfa lrc: 3/1,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 26387 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136339.788604:0:26387:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ff5f4e00/0x559c8745c6de4d01 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 26387 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136339.788612:0:26387:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ff5f4e00/0x559c8745c6de4d01 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 26387 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136339.788618:0:26387:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ff5f4e00/0x559c8745c6de4d01 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 26387 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136339.788726:0:26387:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ff5f5c00/0x559c8745c6de4d08 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 26387 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136339.788736:0:26387:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ff5f5c00/0x559c8745c6de4d08 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 26387 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136339.788743:0:26387:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ff5f5c00/0x559c8745c6de4d08 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 26387 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789136339.788929:0:26387:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ff5f5c00/0x559c8745c6de4d08 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 26387 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136339.788947:0:26387:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ff5f5600/0x559c8745c6de4cfa lrc: 3/1,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 26387 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136339.788966:0:26387:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ff5f5600/0x559c8745c6de4cfa lrc: 2/0,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 26387 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136339.788973:0:26387:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ff5f5600/0x559c8745c6de4cfa lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 26387 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136339.788979:0:26387:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a7ff5f5600 already unused, calling callback (ffffffffc19cc4f0) 00010000:00010000:3.0:1789136339.788984:0:26387:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ff5f5600/0x559c8745c6de4cfa lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 26387 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136339.788992:0:26387:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ff5f5600/0x559c8745c6de4cfa lrc: 4/0,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 26387 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136339.789007:0:26387:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff90a7d61d3600) 00010000:00010000:3.0:1789136339.789011:0:26387:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789136339.789016:0:26387:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ff5f5600/0x559c8745c6de4cfa lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 26387 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136339.789022:0:26387:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ff5f5600/0x559c8745c6de4cfa lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 26387 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136339.789038:0:26387:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ff5f4e00/0x559c8745c6de4d01 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 26387 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136339.789044:0:26387:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ff5f4e00/0x559c8745c6de4d01 lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 26387 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136339.789049:0:26387:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ff5f4e00/0x559c8745c6de4d01 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 26387 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136339.789054:0:26387:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a7ff5f4e00 already unused, calling callback (ffffffffc19cc4f0) 00010000:00010000:3.0:1789136339.789064:0:26387:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ff5f4e00/0x559c8745c6de4d01 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 26387 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136339.789072:0:26387:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ff5f4e00/0x559c8745c6de4d01 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 26387 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136339.789082:0:26387:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0xb42112bc (ffff90a7c3817700) 00010000:00010000:3.0:1789136339.789084:0:26387:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789136339.789088:0:26387:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ff5f4e00/0x559c8745c6de4d01 lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 26387 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136339.789093:0:26387:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ff5f4e00/0x559c8745c6de4d01 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 26387 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136339.789110:0:26387:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ff5f5c00/0x559c8745c6de4d08 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 26387 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136339.789115:0:26387:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ff5f5c00/0x559c8745c6de4d08 lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 26387 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136339.789122:0:26387:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ff5f5c00/0x559c8745c6de4d08 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 26387 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136339.789126:0:26387:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a7ff5f5c00 already unused, calling callback (ffffffffc19cc4f0) 00010000:00010000:3.0:1789136339.789129:0:26387:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ff5f5c00/0x559c8745c6de4d08 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 26387 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136339.789135:0:26387:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ff5f5c00/0x559c8745c6de4d08 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 26387 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136339.789142:0:26387:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff90a7c3817500) 00010000:00010000:3.0:1789136339.789145:0:26387:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789136339.790301:0:26387:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ff5f5c00/0x559c8745c6de4d08 lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 26387 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789136339.790317:0:26387:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a7ff5f5c00/0x559c8745c6de4d08 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 26387 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789136339.790468:0:26387:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c47e4780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bb852e64-3f46-4395-9dea-0822b7213ac8+25:19086:x1876044644796800:12345-192.168.201.31@tcp:34:lfs.0 Request processed in 2660us (2935us total) trans 0 rc 0/0 00000100:00100000:3.0:1789136339.790482:0:26387:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 73 00000100:00100000:0.0:1789136339.795432:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:2.0:1789136339.795539:0:23336:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644797056 00000100:00100000:2.0:1789136339.795556:0:23336:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644797056 00000100:00100000:2.0:1789136339.795635:0:23336:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 15 00000100:00100000:2.0:1789136339.795650:0:23336:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c4760f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bb852e64-3f46-4395-9dea-0822b7213ac8+25:19086:x1876044644797056:12345-192.168.201.31@tcp:35:lfs.0 00000100:00100000:2.0:1789136339.796005:0:23336:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c4760f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bb852e64-3f46-4395-9dea-0822b7213ac8+26:19086:x1876044644797056:12345-192.168.201.31@tcp:35:lfs.0 Request processed in 358us (581us total) trans 12884901931 rc 0/0 00000100:00100000:2.0:1789136339.796013:0:23336:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 15 00010000:00010000:1.0:1789136340.731443:0:23321:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789136340.980468:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:0.0:1789136340.980513:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:0.0:1789136340.980552:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:0.0:1789136340.980571:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:0.0:1789136340.980597:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:0.0:1789136340.980618:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:0.0:1789136340.980639:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:0.0:1789136340.980655:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:0.0:1789136340.980678:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:0.0:1789136340.980715:0:24846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644797568 00000100:00100000:0.0:1789136340.980725:0:24846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644797568 00000100:00100000:0.0:1789136340.980768:0:24846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644798080 00000100:00100000:0.0:1789136340.980771:0:24846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644798080 00000100:00100000:0.0:1789136340.980794:0:24846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644797696 00000100:00100000:0.0:1789136340.980797:0:24846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644797696 00000100:00100000:0.0:1789136340.980808:0:24846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644798208 00000100:00100000:0.0:1789136340.980811:0:24846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644798208 00000100:00100000:0.0:1789136340.980826:0:24846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 19 00000100:00100000:0.0:1789136340.980835:0:24846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c4763480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bb852e64-3f46-4395-9dea-0822b7213ac8+8:2389:x1876044644797568:12345-192.168.201.31@tcp:400:kworker.0 00000100:00100000:0.0:1789136340.980929:0:24846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c4763480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bb852e64-3f46-4395-9dea-0822b7213ac8+8:2389:x1876044644797568:12345-192.168.201.31@tcp:400:kworker.0 Request processed in 94us (413us total) trans 0 rc 0/0 00000100:00100000:0.0:1789136340.980937:0:24846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 19 00000100:00100000:0.0:1789136340.980956:0:24846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 20 00000100:00100000:0.0:1789136340.980962:0:24846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c4762580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a4039233-0823-4bef-b733-24ab7c889e38+5:2389:x1876044644798080:12345-192.168.201.31@tcp:400:kworker.0 00000100:00100000:0.0:1789136340.981016:0:24846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c4762580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a4039233-0823-4bef-b733-24ab7c889e38+5:2389:x1876044644798080:12345-192.168.201.31@tcp:400:kworker.0 Request processed in 54us (444us total) trans 0 rc 0/0 00000100:00100000:0.0:1789136340.981023:0:24846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 20 00000100:00100000:0.0:1789136340.981037:0:24846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 21 00000100:00100000:0.0:1789136340.981044:0:24846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c3fe03c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bb852e64-3f46-4395-9dea-0822b7213ac8+5:2389:x1876044644797696:12345-192.168.201.31@tcp:400:kworker.0 00000100:00100000:0.0:1789136340.981067:0:24846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c3fe03c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bb852e64-3f46-4395-9dea-0822b7213ac8+5:2389:x1876044644797696:12345-192.168.201.31@tcp:400:kworker.0 Request processed in 24us (428us total) trans 0 rc 0/0 00000100:00100000:0.0:1789136340.981074:0:24846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 21 00000100:00100000:0.0:1789136340.981085:0:24846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 22 00000100:00100000:0.0:1789136340.981091:0:24846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c3ff5680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a4039233-0823-4bef-b733-24ab7c889e38+5:2389:x1876044644798208:12345-192.168.201.31@tcp:400:kworker.0 00000100:00100000:0.0:1789136340.981113:0:24846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c3ff5680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a4039233-0823-4bef-b733-24ab7c889e38+5:2389:x1876044644798208:12345-192.168.201.31@tcp:400:kworker.0 Request processed in 22us (434us total) trans 0 rc 0/0 00000100:00100000:0.0:1789136340.981119:0:24846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 22 00000100:00100000:0.0:1789136340.981140:0:23325:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644797184 00000100:00100000:0.0:1789136340.981144:0:23325:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644797184 00000100:00100000:0.0:1789136340.981168:0:23325:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 165 00000100:00100000:0.0:1789136340.981174:0:23325:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7c4ffc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:27cf2c08-90ce-45f0-9821-89831e8ff070+13:2389:x1876044644797184:12345-192.168.201.31@tcp:400:kworker.0 00000100:00100000:0.0:1789136340.981200:0:23325:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7c4ffc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:27cf2c08-90ce-45f0-9821-89831e8ff070+13:2389:x1876044644797184:12345-192.168.201.31@tcp:400:kworker.0 Request processed in 26us (602us total) trans 0 rc 0/0 00000100:00100000:0.0:1789136340.981206:0:23325:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 165 00000100:00100000:0.0:1789136340.981403:0:23334:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644797312 00000100:00100000:0.0:1789136340.981407:0:23334:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644797312 00000100:00100000:3.0:1789136340.981420:0:23333:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644797824 00000100:00100000:3.0:1789136340.981423:0:23333:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644797824 00000100:00100000:0.0:1789136340.981429:0:23334:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644797440 00000100:00100000:0.0:1789136340.981431:0:23334:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644797440 00000100:00100000:3.0:1789136340.981442:0:23333:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644797952 00000100:00100000:3.0:1789136340.981445:0:23333:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644797952 00000100:00100000:0.0:1789136340.981454:0:23334:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 66 00000100:00100000:0.0:1789136340.981459:0:23334:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c47612c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bb852e64-3f46-4395-9dea-0822b7213ac8+26:2389:x1876044644797312:12345-192.168.201.31@tcp:400:kworker.0 00000100:00100000:3.0:1789136340.981461:0:23333:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 67 00000100:00100000:3.0:1789136340.981466:0:23333:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c4761680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a4039233-0823-4bef-b733-24ab7c889e38+6:2389:x1876044644797824:12345-192.168.201.31@tcp:400:kworker.0 00000100:00080000:1.0:1789136340.981916:0:23328:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1789136340.981921:0:23328:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789136340.981924:0:23328:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789136340.981927:0:23328:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789136340.981982:0:23332:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 4 min 3 max 116 00000100:00100000:0.0:1789136340.982101:0:23334:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c47612c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bb852e64-3f46-4395-9dea-0822b7213ac8+26:2389:x1876044644797312:12345-192.168.201.31@tcp:400:kworker.0 Request processed in 639us (1641us total) trans 0 rc 0/0 00000100:00100000:0.0:1789136340.982109:0:23334:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 66 00000100:00100000:1.0:1789136340.982353:0:23332:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_004' 00000100:00100000:1.0:1789136340.983178:0:23334:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 68 00000100:00100000:1.0:1789136340.983194:0:23334:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c3fe0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bb852e64-3f46-4395-9dea-0822b7213ac8+5:2389:x1876044644797440:12345-192.168.201.31@tcp:400:kworker.0 00000100:00100000:3.0:1789136340.993497:0:23333:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c4761680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a4039233-0823-4bef-b733-24ab7c889e38+6:2389:x1876044644797824:12345-192.168.201.31@tcp:400:kworker.0 Request processed in 12015us (12930us total) trans 0 rc 0/0 00000100:00100000:3.0:1789136340.993513:0:23333:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 67 00000100:00100000:3.0:1789136340.993558:0:23333:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 69 00000100:00100000:3.0:1789136340.993573:0:23333:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c3ff7c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a4039233-0823-4bef-b733-24ab7c889e38+5:2389:x1876044644797952:12345-192.168.201.31@tcp:400:kworker.0 00000100:00100000:3.0:1789136340.993702:0:23333:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c3ff7c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a4039233-0823-4bef-b733-24ab7c889e38+5:2389:x1876044644797952:12345-192.168.201.31@tcp:400:kworker.0 Request processed in 63us (12972us total) trans 0 rc 0/0 00000100:00100000:3.0:1789136340.993780:0:23333:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 69 00000100:00100000:1.0:1789136341.013714:0:23334:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c3fe0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bb852e64-3f46-4395-9dea-0822b7213ac8+5:2389:x1876044644797440:12345-192.168.201.31@tcp:400:kworker.0 Request processed in 30510us (33078us total) trans 0 rc 0/0 00000100:00100000:1.0:1789136341.013735:0:23334:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 68 00000100:00100000:1.0:1789136341.352068:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789136341.352092:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c3ce9680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1876044666943488:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789136341.352168:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789136341.352218:0:24848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666943488 00000100:00100000:1.0:1789136341.352225:0:24848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666943488 00000100:00100000:1.0:1789136341.352287:0:24848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1789136341.352297:0:24848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7c86dcf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3638:x1876044666943488:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789136341.352339:0:24848:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3915853824 avail 3684331520 00000100:00100000:1.0:1789136341.352396:0:24848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7c86dcf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3638:x1876044666943488:12345-0@lo:13:osp-pre-0-0.0 Request processed in 100us (227us total) trans 0 rc 0/0 00000100:00100000:1.0:1789136341.352403:0:24848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00080000:1.0:1789136341.352425:0:23328:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789136341.352533:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c3ce9680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1876044666943488:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789136341.353416:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7fcf47840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1876044666943616:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1789136341.353454:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789136341.353515:0:24848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666943616 00000100:00100000:2.0:1789136341.353520:0:24848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666943616 00000100:00100000:2.0:1789136341.353579:0:24848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1789136341.353588:0:24848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7d55ad2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1876044666943616:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1789136341.353611:0:24848:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3915853824 avail 3684331520 00000100:00100000:2.0:1789136341.353649:0:24848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7d55ad2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1876044666943616:12345-0@lo:13:osp-pre-0-1.0 Request processed in 63us (194us total) trans 0 rc 0/0 00000100:00100000:2.0:1789136341.353656:0:24848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1789136341.353842:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7fcf47840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1876044666943616:0@lo:13:osp-pre-0-1.0 00000100:00080000:3.0:1789136341.353881:0:23328:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1789136341.736929:0:23320:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789136341.867045:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7fcf46580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1876044666943744:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1789136341.867118:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789136341.867211:0:24848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666943744 00000100:00100000:2.0:1789136341.867219:0:24848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666943744 00000100:00100000:2.0:1789136341.867284:0:24848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1789136341.867295:0:24848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7d55ae580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1876044666943744:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1789136341.867337:0:24848:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923501056 avail 3691978752 00000100:00100000:2.0:1789136341.867387:0:24848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7d55ae580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1876044666943744:12345-0@lo:13:osp-pre-1-1.0 Request processed in 94us (269us total) trans 0 rc 0/0 00000100:00100000:2.0:1789136341.867395:0:24848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00080000:3.0:1789136341.867457:0:23328:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789136341.867494:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7fcf46580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1876044666943744:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1789136341.868496:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7d55ade00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1876044666943872:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789136341.868545:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789136341.868572:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7fa39ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3638:1876044666944384:0@lo:400:kworker.0 00000100:00100000:3.0:1789136341.868601:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789136341.868670:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c109a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3638:1876044666944896:0@lo:400:kworker.0 00000100:00100000:3.0:1789136341.868696:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789136341.868718:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:3.0:1789136341.868725:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7fa3983c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b11da215-324d-4c8d-90a5-0b7f26186c4c:3638:1876044666944000:0@lo:400:kworker.0 00000100:00100000:3.0:1789136341.868752:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789136341.868786:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7fa39b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1876044666944512:0@lo:400:kworker.0 00000100:00100000:3.0:1789136341.868812:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789136341.868831:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c109b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3638:1876044666945024:0@lo:400:kworker.0 00000100:00100000:3.0:1789136341.868881:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789136341.868915:0:23333:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666944384 00000100:00100000:3.0:1789136341.868921:0:23333:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666944384 00000100:00100000:3.0:1789136341.868961:0:23333:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666944896 00000100:00100000:3.0:1789136341.868964:0:23333:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666944896 00000100:00100000:3.0:1789136341.868991:0:23333:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666945024 00000100:00100000:3.0:1789136341.868994:0:23333:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666945024 00000100:00100000:3.0:1789136341.869011:0:23333:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1789136341.869018:0:23333:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c3d92940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1876044666944384:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789136341.869069:0:23333:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c3d92940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1876044666944384:12345-0@lo:400:kworker.0 Request processed in 51us (466us total) trans 0 rc 0/0 00000100:00100000:3.0:1789136341.869087:0:23333:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1789136341.869104:0:23333:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1789136341.869110:0:23333:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c3d92d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3638:x1876044666944896:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789136341.869139:0:23333:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c3d92d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3638:x1876044666944896:12345-0@lo:400:kworker.0 Request processed in 30us (443us total) trans 0 rc 0/0 00000100:00100000:3.0:1789136341.869145:0:23333:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1789136341.869155:0:23333:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1789136341.869160:0:23333:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c3d91680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3638:x1876044666945024:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789136341.869186:0:23333:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c3d91680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3638:x1876044666945024:12345-0@lo:400:kworker.0 Request processed in 26us (305us total) trans 0 rc 0/0 00000100:00100000:3.0:1789136341.869192:0:23333:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1789136341.869214:0:23327:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666944000 00000100:00100000:3.0:1789136341.869217:0:23327:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666944000 00000100:00100000:3.0:1789136341.869242:0:23327:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 166 00000100:00100000:3.0:1789136341.869249:0:23327:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7c4ffd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b11da215-324d-4c8d-90a5-0b7f26186c4c+24:3638:x1876044666944000:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789136341.869278:0:23327:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7c4ffd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b11da215-324d-4c8d-90a5-0b7f26186c4c+24:3638:x1876044666944000:12345-0@lo:400:kworker.0 Request processed in 29us (524us total) trans 0 rc 0/0 00000100:00100000:3.0:1789136341.869284:0:23327:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 166 00000100:00100000:3.0:1789136341.869308:0:23338:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666944512 00000100:00100000:3.0:1789136341.869326:0:23338:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666944512 00000100:00100000:3.0:1789136341.869353:0:23338:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1789136341.869360:0:23338:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c3d93c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3638:x1876044666944512:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789136341.869391:0:23338:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c3d93c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3638:x1876044666944512:12345-0@lo:400:kworker.0 Request processed in 32us (579us total) trans 0 rc 0/0 00000100:00100000:3.0:1789136341.869397:0:23338:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1789136341.869441:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7fa398f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1876044666944128:0@lo:400:kworker.0 00000100:00100000:3.0:1789136341.869478:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789136341.869497:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7fa39bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3640:1876044666944640:0@lo:400:kworker.0 00000100:00100000:3.0:1789136341.869519:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789136341.869533:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c1098f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3640:1876044666945152:0@lo:400:kworker.0 00000100:00100000:3.0:1789136341.869553:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789136341.869572:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1789136341.869578:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7fa399680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1876044666944256:0@lo:400:kworker.0 00000100:00100000:3.0:1789136341.869601:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789136341.869620:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a6c109b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3640:1876044666944768:0@lo:400:kworker.0 00000100:00100000:3.0:1789136341.869655:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789136341.869684:0:23339:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666944128 00000100:00100000:3.0:1789136341.869687:0:23339:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666944128 00000100:00100000:3.0:1789136341.869711:0:23339:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1789136341.869717:0:23339:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7c69eb840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3640:x1876044666944128:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789136341.869757:0:23339:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7c69eb840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3640:x1876044666944128:12345-0@lo:400:kworker.0 Request processed in 41us (280us total) trans 0 rc 0/0 00000100:00100000:3.0:1789136341.869763:0:23339:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1789136341.869780:0:24846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666944256 00000100:00100000:3.0:1789136341.869782:0:24846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666944256 00000100:00100000:3.0:1789136341.869811:0:24846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1789136341.869818:0:24846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7c69e83c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3640:x1876044666944256:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789136341.869847:0:24846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7c69e83c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3640:x1876044666944256:12345-0@lo:400:kworker.0 Request processed in 30us (245us total) trans 0 rc 0/0 00000100:00100000:3.0:1789136341.869878:0:24846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1789136341.869899:0:23332:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666944640 00000100:00100000:3.0:1789136341.869908:0:23332:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666944640 00000100:00100000:3.0:1789136341.869932:0:23332:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666945152 00000100:00100000:3.0:1789136341.869935:0:23332:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666945152 00000100:00100000:3.0:1789136341.869952:0:23332:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666944768 00000100:00100000:3.0:1789136341.869954:0:23332:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666944768 00000100:00100000:3.0:1789136341.869967:0:23332:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1789136341.869973:0:23332:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7c69ea580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3640:x1876044666944640:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789136341.870007:0:23332:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7c69ea580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3640:x1876044666944640:12345-0@lo:400:kworker.0 Request processed in 34us (487us total) trans 0 rc 0/0 00000100:00100000:3.0:1789136341.870013:0:23332:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1789136341.870024:0:23332:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1789136341.870031:0:23332:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7c69e9a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3640:x1876044666945152:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789136341.870057:0:23332:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7c69e9a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3640:x1876044666945152:12345-0@lo:400:kworker.0 Request processed in 27us (503us total) trans 0 rc 0/0 00000100:00100000:3.0:1789136341.870063:0:23332:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1789136341.870073:0:23332:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1789136341.870078:0:23332:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c454b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3640:x1876044666944768:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789136341.870103:0:23332:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c454b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3640:x1876044666944768:12345-0@lo:400:kworker.0 Request processed in 25us (448us total) trans 0 rc 0/0 00000100:00100000:3.0:1789136341.870108:0:23332:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00080000:3.0:1789136341.870129:0:23328:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789136341.870134:0:23328:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789136341.870135:0:23328:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1789136341.870150:0:24848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666943872 00000100:00100000:3.0:1789136341.870153:0:24848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666943872 00000100:00100000:3.0:1789136341.870175:0:24848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1789136341.870181:0:24848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c1099e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1876044666943872:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789136341.870196:0:24848:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923501056 avail 3691978752 00000100:00100000:3.0:1789136341.870244:0:24848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c1099e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1876044666943872:12345-0@lo:13:osp-pre-1-0.0 Request processed in 62us (1699us total) trans 0 rc 0/0 00000100:00100000:3.0:1789136341.870250:0:24848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1789136341.870284:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7fa399680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1876044666944256:0@lo:400:kworker.0 00000100:00100000:3.0:1789136341.870294:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c109b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3640:1876044666944768:0@lo:400:kworker.0 00000100:00100000:3.0:1789136341.870304:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7fa398f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1876044666944128:0@lo:400:kworker.0 00000100:00100000:3.0:1789136341.870325:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7fa39bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3640:1876044666944640:0@lo:400:kworker.0 00010000:00080000:3.0:1789136341.870337:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90a6c1098f00 x1876044666945152/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789136357 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789136341.870346:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c1098f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3640:1876044666945152:0@lo:400:kworker.0 00000100:00100000:3.0:1789136341.870384:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7fa3983c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b11da215-324d-4c8d-90a5-0b7f26186c4c:3638:1876044666944000:0@lo:400:kworker.0 00000100:00100000:3.0:1789136341.870394:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7fa39b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1876044666944512:0@lo:400:kworker.0 00000100:00100000:3.0:1789136341.870403:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c109b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3638:1876044666945024:0@lo:400:kworker.0 00000100:00100000:3.0:1789136341.870416:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7d55ade00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1876044666943872:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789136341.870426:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7fa39ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3638:1876044666944384:0@lo:400:kworker.0 00010000:00080000:3.0:1789136341.870435:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90a6c109a1c0 x1876044666944896/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789136357 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789136341.870444:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a6c109a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3638:1876044666944896:0@lo:400:kworker.0 00000100:00100000:1.0:1789136341.870582:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789136341.870591:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7c86dc780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1876044666945280:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1789136341.870645:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789136341.870676:0:24077:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666945280 00000100:00100000:1.0:1789136341.870680:0:24077:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666945280 00000100:00100000:1.0:1789136341.870707:0:24077:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1789136341.870714:0:24077:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c55f4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3640:x1876044666945280:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1789136341.870740:0:24077:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446289408 avail 1300049920 00000100:00100000:1.0:1789136341.870782:0:24077:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c55f4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3640:x1876044666945280:12345-0@lo:41:osp-pre-0-1.0 Request processed in 68us (137us total) trans 0 rc 0/0 00000100:00100000:1.0:1789136341.870789:0:24077:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1789136341.870824:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7c86dc780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1876044666945280:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1789136341.874598:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789136341.874626:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90a7fcf452c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1876044666945408:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1789136341.874698:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789136341.874843:0:23338:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044666945408 00000100:00100000:2.0:1789136341.874884:0:23338:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044666945408 00000100:00100000:2.0:1789136341.874932:0:23338:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1789136341.874942:0:23338:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c55f4b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3639:x1876044666945408:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1789136341.874980:0:23338:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:2.0:1789136341.875033:0:23338:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c55f4b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3639:x1876044666945408:12345-0@lo:41:osp-pre-1-0.0 Request processed in 92us (334us total) trans 0 rc 0/0 00000100:00100000:2.0:1789136341.875040:0:23338:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1789136341.875084:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90a7fcf452c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1876044666945408:0@lo:41:osp-pre-1-0.0 00000001:02000400:2.0:1789136341.902703:0:26426:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: sanity-pcc test_1d: @@@@@@ FAIL: /mnt/lustre/d1d.sanity-pcc/f1d.sanity-pcc expected pcc state: readwrite, but got: none 00000040:00080000:2.0:1789136342.696073:0:23370:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:2.0:1789136342.696083:0:23370:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x14:0x0] at index 3 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1789136342.696106:0:23370:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x14:0x0] index 2 count 2 00000040:00080000:2.0:1789136342.696114:0:23370:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 4 count 2 00010000:00010000:0.0:1789136342.762798:0:23321:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789136343.035254:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:0.0:1789136343.035321:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:1.0:1789136343.035447:0:24847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644798464 00000100:00100000:1.0:1789136343.035466:0:24847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644798464 00000100:00100000:3.0:1789136343.035513:0:24850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876044644798336 00000100:00100000:3.0:1789136343.035522:0:24850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876044644798336 00002000:00100000:3.0:1789136343.035591:0:24850:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x42:0x0] (0->8) req@ffff90a6c3ff4f00 x1876044644798336/t0(0) o4->bb852e64-3f46-4395-9dea-0822b7213ac8@192.168.201.31@tcp:19/0 lens 504/0 e 0 to 0 dl 1789136354 ref 1 fl New:/600/ffffffff rc 0/-1 job:'bash.0' uid:0 gid:0 projid:100 00002000:00100000:3.0:1789136343.035628:0:24850:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90a6c3ff4f00 with x1876044644798336 ext(0->8) 00000100:00100000:1.0:1789136343.035660:0:24847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 31 00000100:00100000:1.0:1789136343.035673:0:24847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c3ff5e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:bb852e64-3f46-4395-9dea-0822b7213ac8+9:2390:x1876044644798464:12345-192.168.201.31@tcp:16:kworker.0 00000100:00100000:1.0:1789136343.035847:0:24847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c3ff5e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:bb852e64-3f46-4395-9dea-0822b7213ac8+9:2390:x1876044644798464:12345-192.168.201.31@tcp:16:kworker.0 Request processed in 176us (607us total) trans 0 rc 0/0 00000100:00100000:1.0:1789136343.035895:0:24847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 31 00002000:00010000:3.0:1789136343.036059:0:24850:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90a6c3ff4f00 00000100:00100000:3.0:1789136343.036143:0:24850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 0 00000100:00100000:3.0:1789136343.036154:0:24850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6c3ff4f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:bb852e64-3f46-4395-9dea-0822b7213ac8+8:2390:x1876044644798336:12345-192.168.201.31@tcp:4:bash.0 00000100:00080000:0.0:1789136343.040166:0:23328:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789136343.048065:0:24850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6c3ff4f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:bb852e64-3f46-4395-9dea-0822b7213ac8+10:2390:x1876044644798336:12345-192.168.201.31@tcp:4:bash.0 Request processed in 11902us (12732us total) trans 12884901895 rc 0/0 00000100:00100000:0.0:1789136343.048092:0:24850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 0 00002000:00100000:0.0:1789136343.048108:0:24850:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x42:0x0] (0->8) req@ffff90a6c3ff4f00 x1876044644798336/t12884901895(0) o4->bb852e64-3f46-4395-9dea-0822b7213ac8@192.168.201.31@tcp:19/0 lens 504/448 e 0 to 0 dl 1789136354 ref 1 fl Complete:/600/0 rc 0/0 job:'bash.0' uid:0 gid:0 projid:100 00002000:00100000:0.0:1789136343.048120:0:24850:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff90a6c3ff4f00 with x1876044644798336 ext(0->8) 00002000:00010000:0.0:1789136343.048127:0:24850:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff90a6c3ff4f00 Debug log: 15089 lines, 15089 kept, 0 dropped, 0 bad.