00010000:00010000:2.0F:1788574415.233605:0:15396:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0F:1788574415.571226:0:7676:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 5bc00dcd-c724-4b6b-a75b-9c8606e9461b 00000020:00000080:3.0:1788574415.571247:0:7676:0:(genops.c:885:class_export_put()) final put ffff90a683b2b800/5bc00dcd-c724-4b6b-a75b-9c8606e9461b 00000020:00000080:0.0F:1788574415.571648:0:13890:0:(genops.c:844:class_export_destroy()) destroying export ffff90a683b2b800/5bc00dcd-c724-4b6b-a75b-9c8606e9461b for lustre-OST0001 00000020:00000080:0.0:1788574415.571692:0:13890:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff90a683b29000 for lustre-OST0001 00010000:00010000:3.0:1788574416.259812:0:14332:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788574416.322511:0:14378:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:2.0:1788574416.322520:0:14378:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788574416.322554:0:14378:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:2.0:1788574416.322559:0:14378:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00010000:00010000:1.0F:1788574417.287583:0:14333:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1788574417.627220:0:6739:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 5bc00dcd-c724-4b6b-a75b-9c8606e9461b 00000020:00000080:2.0:1788574417.627228:0:6739:0:(genops.c:885:class_export_put()) final put ffff90a683b2d800/5bc00dcd-c724-4b6b-a75b-9c8606e9461b 00000001:00100000:2.0:1788574417.627252:0:6739:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 5767af78-1871-405c-8c59-f96bc15eec86 00000020:00000080:2.0:1788574417.627256:0:6739:0:(genops.c:885:class_export_put()) final put ffff90a683b2f800/5767af78-1871-405c-8c59-f96bc15eec86 00000020:00000080:2.0:1788574417.627274:0:489:0:(genops.c:844:class_export_destroy()) destroying export ffff90a683b2d800/5bc00dcd-c724-4b6b-a75b-9c8606e9461b for lustre-OST0000 00000020:00000080:2.0:1788574417.627322:0:489:0:(genops.c:844:class_export_destroy()) destroying export ffff90a683b2f800/5767af78-1871-405c-8c59-f96bc15eec86 for lustre-OST0000 00000020:00000080:2.0:1788574417.627338:0:489:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff90a683b2b000 for lustre-OST0000 00000020:00000080:2.0:1788574417.627344:0:489:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff90a683b2d000 for lustre-OST0000 00000100:00100000:1.0:1788574417.881163:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:3.0:1788574417.881239:0:14346:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727763200 00000100:00100000:3.0:1788574417.881252:0:14346:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727763200 00000100:00100000:3.0:1788574417.881341:0:14346:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 54 00000100:00100000:3.0:1788574417.881352:0:14346:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7a7845180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5767af78-1871-405c-8c59-f96bc15eec86+12:14408:x1875455727763200:12345-192.168.201.57@tcp:60:lhsmtool_posix.0 00000100:00100000:3.0:1788574417.881496:0:14346:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7a7845180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5767af78-1871-405c-8c59-f96bc15eec86+12:14408:x1875455727763200:12345-192.168.201.57@tcp:60:lhsmtool_posix.0 Request processed in 145us (339us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574417.881504:0:14346:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 54 00000100:00080000:0.0:1788574417.881621:0:14340:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788574417.896204:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:0.0:1788574417.896289:0:14347:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727763456 00000100:00100000:0.0:1788574417.896301:0:14347:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727763456 00000100:00100000:0.0:1788574417.896364:0:14347:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 12 00000100:00100000:0.0:1788574417.896390:0:14347:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7bb288a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5767af78-1871-405c-8c59-f96bc15eec86+12:14408:x1875455727763456:12345-192.168.201.57@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1788574417.896703:0:14347:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7bb288a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5767af78-1871-405c-8c59-f96bc15eec86+13:14408:x1875455727763456:12345-192.168.201.57@tcp:35:lhsmtool_posix.0 Request processed in 314us (509us total) trans 8589934623 rc 0/0 00000100:00100000:0.0:1788574417.896712:0:14347:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 12 00010000:00010000:1.0:1788574418.307703:0:15396:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788574418.738214:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:2.0:1788574418.738282:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:2.0:1788574418.738322:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:0.0:1788574418.738516:0:14338:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727763584 00000100:00100000:0.0:1788574418.738526:0:14338:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727763584 00000100:00100000:0.0:1788574418.738593:0:14338:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 128 00000100:00100000:0.0:1788574418.738606:0:14338:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a78e16d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:125108d1-8047-4740-b3d2-4049e113b9ae+13:2353:x1875455727763584:12345-192.168.201.57@tcp:400:kworker.0 00000100:00100000:0.0:1788574418.738705:0:14338:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a78e16d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:125108d1-8047-4740-b3d2-4049e113b9ae+13:2353:x1875455727763584:12345-192.168.201.57@tcp:400:kworker.0 Request processed in 101us (507us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574418.738713:0:14338:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 128 00000100:00100000:3.0:1788574418.739354:0:15030:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727763840 00000100:00100000:3.0:1788574418.739360:0:15030:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727763840 00000100:00100000:3.0:1788574418.739445:0:15030:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 27 00000100:00100000:3.0:1788574418.739453:0:15030:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7bb289c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5767af78-1871-405c-8c59-f96bc15eec86+5:2353:x1875455727763840:12345-192.168.201.57@tcp:400:kworker.0 00000100:00100000:3.0:1788574418.739495:0:15030:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7bb289c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5767af78-1871-405c-8c59-f96bc15eec86+5:2353:x1875455727763840:12345-192.168.201.57@tcp:400:kworker.0 Request processed in 44us (1212us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574418.739502:0:15030:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 27 00000100:00100000:1.0:1788574418.739680:0:15051:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727763712 00000100:00100000:1.0:1788574418.739685:0:15051:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727763712 00000100:00100000:1.0:1788574418.739724:0:15051:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 40 00000100:00100000:1.0:1788574418.739732:0:15051:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7bb288700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5767af78-1871-405c-8c59-f96bc15eec86+13:2353:x1875455727763712:12345-192.168.201.57@tcp:400:kworker.0 00000100:00100000:1.0:1788574418.739768:0:15051:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7bb288700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5767af78-1871-405c-8c59-f96bc15eec86+13:2353:x1875455727763712:12345-192.168.201.57@tcp:400:kworker.0 Request processed in 37us (1446us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574418.739775:0:15051:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 40 00000100:00100000:2.0:1788574418.740010:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:1.0:1788574418.740410:0:14346:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727763968 00000100:00100000:1.0:1788574418.740417:0:14346:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727763968 00000100:00100000:1.0:1788574418.740464:0:14346:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 41 00000100:00100000:1.0:1788574418.740473:0:14346:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7bb289180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5bc00dcd-c724-4b6b-a75b-9c8606e9461b+6:2353:x1875455727763968:12345-192.168.201.57@tcp:400:kworker.0 00000100:00100000:1.0:1788574418.740517:0:14346:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7bb289180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5bc00dcd-c724-4b6b-a75b-9c8606e9461b+6:2353:x1875455727763968:12345-192.168.201.57@tcp:400:kworker.0 Request processed in 46us (2150us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574418.740524:0:14346:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 41 00000100:00080000:0.0:1788574418.740737:0:14340:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788574418.740745:0:14340:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788574419.072825:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788574419.072858:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a7a7845500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1875455747669632:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788574419.072951:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788574419.074165:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a7a72ba300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3312:1875455747670144:0@lo:400:kworker.0 00000100:00100000:3.0:1788574419.074210:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788574419.074240:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1788574419.074246:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a7a72b8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:3cd60e94-2a59-4e1b-b761-ea9d2ceff3ab:3312:1875455747669760:0@lo:400:kworker.0 00000100:00100000:3.0:1788574419.074278:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788574419.074302:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a7a72b8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3312:1875455747670272:0@lo:400:kworker.0 00000100:00100000:3.0:1788574419.074340:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788574419.074363:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a7a72b9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3315:1875455747670016:0@lo:400:kworker.0 00000100:00100000:3.0:1788574419.074414:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788574419.074431:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788574419.074436:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a7a72bad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1875455747669888:0@lo:400:kworker.0 00000100:00100000:3.0:1788574419.074460:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788574419.074487:0:14339:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747669760 00000100:00100000:3.0:1788574419.074496:0:14339:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747669760 00000100:00100000:3.0:1788574419.074540:0:14339:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:3.0:1788574419.074561:0:14339:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a78e16ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3cd60e94-2a59-4e1b-b761-ea9d2ceff3ab+19:3312:x1875455747669760:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788574419.074816:0:14345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747670144 00000100:00100000:1.0:1788574419.074823:0:14345:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747670144 00000100:00100000:1.0:1788574419.074865:0:14345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747670272 00000100:00100000:1.0:1788574419.074868:0:14345:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747670272 00000100:00100000:1.0:1788574419.074898:0:14345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747670016 00000100:00100000:1.0:1788574419.074901:0:14345:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747670016 00000100:00100000:1.0:1788574419.074914:0:14345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1788574419.074920:0:14345:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7a72baa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1875455747670144:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788574419.074959:0:14345:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7a72baa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1875455747670144:12345-0@lo:400:kworker.0 Request processed in 38us (748us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574419.074966:0:14345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1788574419.074989:0:14345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1788574419.074995:0:14345:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7a72b9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1875455747670272:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788574419.075036:0:14345:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7a72b9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1875455747670272:12345-0@lo:400:kworker.0 Request processed in 42us (696us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574419.075042:0:14345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1788574419.075052:0:14345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1788574419.075058:0:14345:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7a72bb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1875455747670016:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788574419.075087:0:14345:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7a72bb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1875455747670016:12345-0@lo:400:kworker.0 Request processed in 30us (673us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574419.075092:0:14345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00080000:1.0:1788574419.075123:0:14340:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788574419.075142:0:15029:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747669888 00000100:00100000:1.0:1788574419.075146:0:15029:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747669888 00000100:00100000:1.0:1788574419.075175:0:15029:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1788574419.075181:0:15029:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a792458e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3315:x1875455747669888:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788574419.075208:0:15029:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a792458e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3315:x1875455747669888:12345-0@lo:400:kworker.0 Request processed in 28us (747us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574419.075213:0:15029:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00080000:1.0:1788574419.075228:0:14340:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788574419.075264:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a7a72b8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:3cd60e94-2a59-4e1b-b761-ea9d2ceff3ab:3312:1875455747669760:0@lo:400:kworker.0 00000100:00100000:1.0:1788574419.075280:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a7a72b8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3312:1875455747670272:0@lo:400:kworker.0 00000100:00100000:1.0:1788574419.075288:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a7a72ba300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3312:1875455747670144:0@lo:400:kworker.0 00000100:00100000:3.0:1788574419.076083:0:14339:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a78e16ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3cd60e94-2a59-4e1b-b761-ea9d2ceff3ab+19:3312:x1875455747669760:12345-0@lo:400:kworker.0 Request processed in 1518us (1798us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574419.076094:0:14339:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00100000:3.0:1788574419.076171:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a7a72bad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1875455747669888:0@lo:400:kworker.0 00000100:00100000:3.0:1788574419.076182:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a7a72b9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3315:1875455747670016:0@lo:400:kworker.0 00000100:00100000:0.0:1788574419.082085:0:15031:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747669632 00000100:00100000:0.0:1788574419.082109:0:15031:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747669632 00000100:00100000:0.0:1788574419.082202:0:15031:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1788574419.082213:0:15031:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7a72b8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1875455747669632:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788574419.082263:0:15031:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 6815744 granted 61276160 pending 0 free 3851419648 avail 3849322496 00000100:00100000:0.0:1788574419.082383:0:15031:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7a72b8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1875455747669632:12345-0@lo:13:osp-pre-1-0.0 Request processed in 156us (9416us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574419.082390:0:15031:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00080000:0.0:1788574419.082424:0:14340:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788574419.082473:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a7a7845500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1875455747669632:0@lo:13:osp-pre-1-0.0 00000001:00080000:0.0:1788574419.128076:0:5879:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934623 is committed 00000020:00080000:0.0:1788574419.128101:0:5879:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 4294967527 batchid updated 00000020:00080000:2.0:1788574419.128154:0:14382:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4294967527 00000020:00080000:2.0:1788574419.128177:0:14382:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4294967527 00010000:00010000:3.0:1788574419.328542:0:14332:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788574419.584798:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788574419.584823:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a6839d1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1875455747670400:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788574419.584902:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788574419.584990:0:15031:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747670400 00000100:00100000:2.0:1788574419.584999:0:15031:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747670400 00000100:00100000:2.0:1788574419.585059:0:15031:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1788574419.585069:0:15031:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a792459880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1875455747670400:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788574419.585102:0:15031:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788574419.585165:0:15031:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a792459880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1875455747670400:12345-0@lo:13:osp-pre-0-0.0 Request processed in 97us (262us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574419.585172:0:15031:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1788574419.585781:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a6839d1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1875455747670400:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1788574420.352628:0:14333:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788574421.389546:0:15396:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788574422.400594:0:14332:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788574423.434361:0:14333:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788574423.852824:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:3.0:1788574423.852891:0:14345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727764224 00000100:00100000:3.0:1788574423.852902:0:14345:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727764224 00000100:00100000:3.0:1788574423.853008:0:14345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 45 00000100:00100000:3.0:1788574423.853028:0:14345:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7bb288000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5767af78-1871-405c-8c59-f96bc15eec86+12:2355:x1875455727764224:12345-192.168.201.57@tcp:400:kworker.0 00000100:00100000:3.0:1788574423.853111:0:14345:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7bb288000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5767af78-1871-405c-8c59-f96bc15eec86+12:2355:x1875455727764224:12345-192.168.201.57@tcp:400:kworker.0 Request processed in 86us (295us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574423.853128:0:14345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 45 00000100:00080000:2.0:1788574423.853266:0:14340:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788574423.853508:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:3.0:1788574423.853563:0:14337:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727764096 00000100:00100000:3.0:1788574423.853569:0:14337:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727764096 00000100:00100000:3.0:1788574423.853604:0:14337:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 130 00000100:00100000:3.0:1788574423.853613:0:14337:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a78e16f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:125108d1-8047-4740-b3d2-4049e113b9ae+13:2356:x1875455727764096:12345-192.168.201.57@tcp:400:kworker.0 00000100:00100000:3.0:1788574423.853648:0:14337:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a78e16f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:125108d1-8047-4740-b3d2-4049e113b9ae+13:2356:x1875455727764096:12345-192.168.201.57@tcp:400:kworker.0 Request processed in 36us (141us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574423.853654:0:14337:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 130 00000100:00100000:1.0:1788574423.869576:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:1.0:1788574423.869628:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:1.0:1788574423.869673:0:15051:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727764480 00000100:00100000:1.0:1788574423.869684:0:15051:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727764480 00000100:00100000:1.0:1788574423.869749:0:15051:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 46 00000100:00100000:1.0:1788574423.869759:0:15051:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7a7846300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5bc00dcd-c724-4b6b-a75b-9c8606e9461b+6:2355:x1875455727764480:12345-192.168.201.57@tcp:400:kworker.0 00000100:00100000:1.0:1788574423.869838:0:15051:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7a7846300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5bc00dcd-c724-4b6b-a75b-9c8606e9461b+6:2355:x1875455727764480:12345-192.168.201.57@tcp:400:kworker.0 Request processed in 79us (209us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574423.869845:0:15051:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 46 00000100:00080000:1.0:1788574423.869869:0:14340:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788574423.870114:0:15030:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727764352 00000100:00100000:2.0:1788574423.870119:0:15030:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727764352 00000100:00100000:2.0:1788574423.870176:0:15030:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 29 00000100:00100000:2.0:1788574423.870184:0:15030:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7a7844000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5767af78-1871-405c-8c59-f96bc15eec86+5:2356:x1875455727764352:12345-192.168.201.57@tcp:400:kworker.0 00000100:00100000:2.0:1788574423.870215:0:15030:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7a7844000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5767af78-1871-405c-8c59-f96bc15eec86+5:2356:x1875455727764352:12345-192.168.201.57@tcp:400:kworker.0 Request processed in 33us (653us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574423.870222:0:15030:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 29 00000100:00080000:1.0:1788574423.870679:0:14340:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788574424.202783:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a6839d0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:3cd60e94-2a59-4e1b-b761-ea9d2ceff3ab:3315:1875455747670528:0@lo:400:kworker.0 00000100:00100000:0.0:1788574424.202873:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788574424.202921:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a6839d1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3315:1875455747671040:0@lo:400:kworker.0 00000100:00100000:0.0:1788574424.202962:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788574424.202989:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788574424.202994:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a6839d1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3315:1875455747670912:0@lo:400:kworker.0 00000100:00100000:0.0:1788574424.203014:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788574424.203040:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a6839d3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1875455747670784:0@lo:400:kworker.0 00000100:00100000:0.0:1788574424.203066:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788574424.203081:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1788574424.203086:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a6839d3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1875455747670656:0@lo:400:kworker.0 00000100:00100000:0.0:1788574424.203105:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788574424.203117:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a6839d0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3313:1875455747671168:0@lo:400:kworker.0 00000100:00100000:0.0:1788574424.203134:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788574424.203166:0:14339:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747670528 00000100:00100000:0.0:1788574424.203176:0:14339:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747670528 00000100:00100000:0.0:1788574424.203224:0:14339:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:0.0:1788574424.203233:0:14339:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a78e16e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3cd60e94-2a59-4e1b-b761-ea9d2ceff3ab+19:3315:x1875455747670528:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788574424.203280:0:14339:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a78e16e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3cd60e94-2a59-4e1b-b761-ea9d2ceff3ab+19:3315:x1875455747670528:12345-0@lo:400:kworker.0 Request processed in 47us (406us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574424.203288:0:14339:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:0.0:1788574424.203339:0:14345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747671040 00000100:00100000:0.0:1788574424.203342:0:14345:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747671040 00000100:00100000:0.0:1788574424.203395:0:14345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747670912 00000100:00100000:0.0:1788574424.203398:0:14345:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747670912 00000100:00100000:0.0:1788574424.203409:0:14345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747671168 00000100:00100000:0.0:1788574424.203412:0:14345:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747671168 00000100:00100000:0.0:1788574424.203425:0:14345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1788574424.203430:0:14345:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6839d0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1875455747671040:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788574424.203970:0:14345:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6839d0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1875455747671040:12345-0@lo:400:kworker.0 Request processed in 536us (1003us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574424.203979:0:14345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1788574424.203997:0:14345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1788574424.204006:0:14345:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6839d3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1875455747670912:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788574424.204039:0:14345:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6839d3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1875455747670912:12345-0@lo:400:kworker.0 Request processed in 36us (1024us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574424.204045:0:14345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1788574424.204056:0:14345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1788574424.204062:0:14345:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7933ba300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1875455747671168:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788574424.204110:0:14345:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7933ba300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1875455747671168:12345-0@lo:400:kworker.0 Request processed in 47us (974us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574424.204116:0:14345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1788574424.204172:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a6839d1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3315:1875455747670912:0@lo:400:kworker.0 00000100:00100000:0.0:1788574424.204185:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a6839d0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:3cd60e94-2a59-4e1b-b761-ea9d2ceff3ab:3315:1875455747670528:0@lo:400:kworker.0 00000100:00100000:0.0:1788574424.204196:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a6839d1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3315:1875455747671040:0@lo:400:kworker.0 00000100:00100000:1.0:1788574424.204689:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788574424.204704:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a7a7845c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1875455747671296:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788574424.204760:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788574424.204810:0:15029:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747670784 00000100:00100000:1.0:1788574424.204818:0:15029:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747670784 00000100:00100000:1.0:1788574424.205144:0:15029:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747670656 00000100:00100000:1.0:1788574424.205148:0:15029:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747670656 00000100:00100000:1.0:1788574424.205362:0:15029:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1788574424.205615:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a6839d0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3313:1875455747671168:0@lo:400:kworker.0 00000100:00100000:1.0:1788574424.207284:0:15029:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6839d2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3313:x1875455747670784:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788574424.207678:0:15029:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6839d2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3313:x1875455747670784:12345-0@lo:400:kworker.0 Request processed in 411us (4608us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574424.207688:0:15029:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1788574424.207725:0:15029:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1788574424.207735:0:15029:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6839d3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3313:x1875455747670656:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788574424.207768:0:15029:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6839d3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3313:x1875455747670656:12345-0@lo:400:kworker.0 Request processed in 36us (4662us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574424.207775:0:15029:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00080000:1.0:1788574424.207805:0:14340:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788574424.207825:0:14340:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788574424.207829:0:14340:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788574424.207881:0:15032:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747671296 00000100:00100000:1.0:1788574424.207890:0:15032:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747671296 00000100:00100000:1.0:1788574424.207946:0:15032:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1788574424.207953:0:15032:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7a7845880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1875455747671296:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788574424.207993:0:15032:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 6815744 granted 61276160 pending 0 free 3851419648 avail 3849322496 00000100:00100000:1.0:1788574424.208035:0:15032:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7a7845880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1875455747671296:12345-0@lo:13:osp-pre-1-0.0 Request processed in 82us (3275us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574424.208042:0:15032:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1788574424.208099:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a7a7845c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1875455747671296:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788574424.208226:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a6839d3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1875455747670656:0@lo:400:kworker.0 00000100:00100000:3.0:1788574424.208236:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a6839d3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1875455747670784:0@lo:400:kworker.0 00010000:00010000:2.0:1788574424.448592:0:15396:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788574424.704768:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788574424.704796:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a7933b9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1875455747671424:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788574424.704869:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788574424.705061:0:15032:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747671424 00000100:00100000:0.0:1788574424.705069:0:15032:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747671424 00000100:00100000:0.0:1788574424.705141:0:15032:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1788574424.705152:0:15032:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a79245b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1875455747671424:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788574424.705193:0:15032:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788574424.705238:0:15032:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a79245b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1875455747671424:12345-0@lo:13:osp-pre-0-0.0 Request processed in 87us (368us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574424.705245:0:15032:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1788574424.705409:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a7933b9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1875455747671424:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1788574425.473004:0:14332:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788574426.496602:0:14333:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788574426.571514:0:14378:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:1.0:1788574426.571525:0:14378:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788574426.571708:0:14378:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:1.0:1788574426.571717:0:14378:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00010000:00010000:1.0:1788574427.521791:0:15396:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788574428.546557:0:14332:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788574428.979704:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:3.0:1788574428.979997:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:3.0:1788574428.980021:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:3.0:1788574428.980044:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:3.0:1788574428.980075:0:15029:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727764864 00000100:00100000:3.0:1788574428.980085:0:15029:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727764864 00000100:00100000:3.0:1788574428.980157:0:15029:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 32 00000100:00100000:3.0:1788574428.980170:0:15029:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a792459180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5767af78-1871-405c-8c59-f96bc15eec86+5:2356:x1875455727764864:12345-192.168.201.57@tcp:400:kworker.0 00000100:00100000:3.0:1788574428.980268:0:15029:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a792459180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5767af78-1871-405c-8c59-f96bc15eec86+5:2356:x1875455727764864:12345-192.168.201.57@tcp:400:kworker.0 Request processed in 99us (220us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574428.980278:0:15029:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 32 00000100:00080000:3.0:1788574428.980303:0:14340:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788574428.983656:0:14344:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727764736 00000100:00100000:1.0:1788574428.983679:0:14344:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727764736 00000100:00080000:3.0:1788574428.983943:0:14340:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788574428.988550:0:14344:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727764992 00000100:00100000:1.0:1788574428.988568:0:14344:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727764992 00000100:00100000:3.0:1788574428.988635:0:15051:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 50 00000100:00100000:3.0:1788574428.988652:0:15051:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a79245b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5767af78-1871-405c-8c59-f96bc15eec86+12:2355:x1875455727764736:12345-192.168.201.57@tcp:400:kworker.0 00000100:00100000:3.0:1788574428.989929:0:15051:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a79245b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5767af78-1871-405c-8c59-f96bc15eec86+12:2355:x1875455727764736:12345-192.168.201.57@tcp:400:kworker.0 Request processed in 1273us (9923us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574428.991399:0:14344:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 51 00000100:00100000:1.0:1788574428.991432:0:14344:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a792459500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5bc00dcd-c724-4b6b-a75b-9c8606e9461b+6:2355:x1875455727764992:12345-192.168.201.57@tcp:400:kworker.0 00000100:00100000:1.0:1788574428.991550:0:14344:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a792459500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5bc00dcd-c724-4b6b-a75b-9c8606e9461b+6:2355:x1875455727764992:12345-192.168.201.57@tcp:400:kworker.0 Request processed in 134us (11526us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574428.991560:0:14344:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 51 00000100:00080000:1.0:1788574428.991614:0:14340:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788574428.993596:0:14338:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727764608 00000100:00100000:0.0:1788574428.993618:0:14338:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727764608 00000100:00100000:0.0:1788574428.993752:0:14339:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 132 00000100:00100000:0.0:1788574428.993764:0:14339:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a78e16cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:125108d1-8047-4740-b3d2-4049e113b9ae+13:2356:x1875455727764608:12345-192.168.201.57@tcp:400:kworker.0 00000100:00100000:0.0:1788574428.993875:0:14339:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a78e16cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:125108d1-8047-4740-b3d2-4049e113b9ae+13:2356:x1875455727764608:12345-192.168.201.57@tcp:400:kworker.0 Request processed in 113us (14188us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574428.993882:0:14339:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 132 00000100:00100000:3.0:1788574428.994302:0:15051:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 50 00000100:00100000:2.0:1788574429.314268:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788574429.314294:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a7bb28a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1875455747671552:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788574429.314414:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788574429.325131:0:15032:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747671552 00000100:00100000:0.0:1788574429.325149:0:15032:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747671552 00000100:00100000:0.0:1788574429.325220:0:15032:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1788574429.325232:0:15032:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7bb28ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1875455747671552:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788574429.325272:0:15032:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 6815744 granted 61276160 pending 0 free 3851419648 avail 3849322496 00000100:00100000:0.0:1788574429.325364:0:15032:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7bb28ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1875455747671552:12345-0@lo:13:osp-pre-1-0.0 Request processed in 134us (10949us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574429.325387:0:15032:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00080000:0.0:1788574429.325409:0:14340:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788574429.325449:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a7bb28a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1875455747671552:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788574429.326965:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a7933baa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:3cd60e94-2a59-4e1b-b761-ea9d2ceff3ab:3312:1875455747671680:0@lo:400:kworker.0 00000100:00100000:0.0:1788574429.327057:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788574429.327101:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a7933bad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3312:1875455747672192:0@lo:400:kworker.0 00000100:00100000:0.0:1788574429.327125:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788574429.327152:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788574429.327157:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a7933b9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1875455747671808:0@lo:400:kworker.0 00000100:00100000:0.0:1788574429.327185:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788574429.327212:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a7933bb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3315:1875455747672064:0@lo:400:kworker.0 00000100:00100000:0.0:1788574429.327239:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788574429.327258:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788574429.327263:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a7933b9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3315:1875455747671936:0@lo:400:kworker.0 00000100:00100000:0.0:1788574429.327283:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788574429.327309:0:14337:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747671680 00000100:00100000:0.0:1788574429.327315:0:14337:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747671680 00000100:00100000:0.0:1788574429.327688:0:14337:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:0.0:1788574429.327700:0:14337:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a78e16c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3cd60e94-2a59-4e1b-b761-ea9d2ceff3ab+19:3312:x1875455747671680:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788574429.327748:0:14337:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a78e16c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3cd60e94-2a59-4e1b-b761-ea9d2ceff3ab+19:3312:x1875455747671680:12345-0@lo:400:kworker.0 Request processed in 50us (691us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574429.327755:0:14337:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:0.0:1788574429.327784:0:14344:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747672192 00000100:00100000:0.0:1788574429.327787:0:14344:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747672192 00000100:00100000:0.0:1788574429.327813:0:14344:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747672064 00000100:00100000:0.0:1788574429.327815:0:14344:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747672064 00000100:00100000:0.0:1788574429.327825:0:14344:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747671936 00000100:00100000:0.0:1788574429.327827:0:14344:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747671936 00000100:00100000:0.0:1788574429.327847:0:14344:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1788574429.327854:0:14344:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7933bbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1875455747672192:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788574429.327934:0:14344:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7933bbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1875455747672192:12345-0@lo:400:kworker.0 Request processed in 80us (806us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574429.327949:0:14344:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1788574429.327961:0:14344:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1788574429.327967:0:14344:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6839d3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1875455747672064:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788574429.327997:0:14344:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6839d3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1875455747672064:12345-0@lo:400:kworker.0 Request processed in 30us (757us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574429.328003:0:14344:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1788574429.328013:0:14344:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1788574429.328018:0:14344:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6839d3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1875455747671936:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788574429.328041:0:14344:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6839d3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1875455747671936:12345-0@lo:400:kworker.0 Request processed in 23us (757us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574429.328046:0:14344:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1788574429.328061:0:15030:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747671808 00000100:00100000:0.0:1788574429.328064:0:15030:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747671808 00000100:00100000:0.0:1788574429.332101:0:15030:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1788574429.332123:0:15030:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7933b9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3312:x1875455747671808:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788574429.332241:0:15030:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7933b9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3312:x1875455747671808:12345-0@lo:400:kworker.0 Request processed in 126us (5054us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574429.332249:0:15030:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00080000:1.0:1788574429.339485:0:14340:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788574429.339496:0:14340:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788574429.339559:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a7933b9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1875455747671808:0@lo:400:kworker.0 00000100:00100000:1.0:1788574429.339573:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a7933baa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:3cd60e94-2a59-4e1b-b761-ea9d2ceff3ab:3312:1875455747671680:0@lo:400:kworker.0 00000100:00100000:1.0:1788574429.339584:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a7933bad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3312:1875455747672192:0@lo:400:kworker.0 00000100:00100000:1.0:1788574429.339633:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a7933b9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3315:1875455747671936:0@lo:400:kworker.0 00000100:00100000:1.0:1788574429.339647:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a7933bb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3315:1875455747672064:0@lo:400:kworker.0 00010000:00010000:3.0:1788574429.568552:0:14333:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788574429.827309:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a6839d0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1875455747672320:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788574429.827430:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788574429.827735:0:15032:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747672320 00000100:00100000:0.0:1788574429.827744:0:15032:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747672320 00000100:00100000:0.0:1788574429.827799:0:15032:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1788574429.827809:0:15032:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a792458380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1875455747672320:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788574429.827854:0:15032:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788574429.827908:0:15032:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a792458380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1875455747672320:12345-0@lo:13:osp-pre-0-0.0 Request processed in 100us (478us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574429.827932:0:15032:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1788574429.828303:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a6839d0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1875455747672320:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1788574430.595048:0:15396:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1788574431.112276:0:17291:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1d: Test Project ID with remote access ========================================================== 22:13:49 (1788574429) 00010000:00010000:0.0:1788574431.616816:0:14332:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788574432.640573:0:14333:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788574433.664607:0:15396:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788574434.098422:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:3.0:1788574434.098485:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:0.0:1788574434.098725:0:14338:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727765120 00000100:00100000:0.0:1788574434.098737:0:14338:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727765120 00000100:00100000:0.0:1788574434.098844:0:14338:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 134 00000100:00100000:0.0:1788574434.098856:0:14338:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a784f43c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:125108d1-8047-4740-b3d2-4049e113b9ae+13:2353:x1875455727765120:12345-192.168.201.57@tcp:400:kworker.0 00000100:00100000:0.0:1788574434.098956:0:14338:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a784f43c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:125108d1-8047-4740-b3d2-4049e113b9ae+13:2353:x1875455727765120:12345-192.168.201.57@tcp:400:kworker.0 Request processed in 101us (545us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574434.098964:0:14338:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 134 00000100:00100000:1.0:1788574434.099035:0:14344:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727765248 00000100:00100000:1.0:1788574434.099042:0:14344:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727765248 00000100:00100000:1.0:1788574434.099101:0:14344:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 55 00000100:00100000:1.0:1788574434.099111:0:14344:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a792458a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5767af78-1871-405c-8c59-f96bc15eec86+12:2353:x1875455727765248:12345-192.168.201.57@tcp:400:kworker.0 00000100:00100000:1.0:1788574434.099148:0:14344:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a792458a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5767af78-1871-405c-8c59-f96bc15eec86+12:2353:x1875455727765248:12345-192.168.201.57@tcp:400:kworker.0 Request processed in 39us (663us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574434.099154:0:14344:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 55 00000100:00080000:0.0:1788574434.100013:0:14340:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788574434.110951:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:1.0:1788574434.111065:0:14346:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727765504 00000100:00100000:1.0:1788574434.111076:0:14346:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727765504 00000100:00100000:1.0:1788574434.111153:0:14346:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 56 00000100:00100000:1.0:1788574434.111164:0:14346:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a79245aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5bc00dcd-c724-4b6b-a75b-9c8606e9461b+6:2353:x1875455727765504:12345-192.168.201.57@tcp:400:kworker.0 00000100:00100000:1.0:1788574434.111238:0:14346:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a79245aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5bc00dcd-c724-4b6b-a75b-9c8606e9461b+6:2353:x1875455727765504:12345-192.168.201.57@tcp:400:kworker.0 Request processed in 76us (299us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574434.111247:0:14346:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 56 00000100:00080000:0.0:1788574434.111321:0:14340:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788574434.114967:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:1.0:1788574434.115281:0:15029:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727765376 00000100:00100000:1.0:1788574434.115307:0:15029:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727765376 00000100:00100000:1.0:1788574434.115459:0:15029:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 23 00000100:00100000:1.0:1788574434.115471:0:15029:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a79245a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5767af78-1871-405c-8c59-f96bc15eec86+5:2352:x1875455727765376:12345-192.168.201.57@tcp:9:kworker.0 00000020:00000080:1.0:1788574434.115520:0:15029:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x10531a153b536cba 00000100:00080000:1.0:1788574434.116086:0:15029:0:(import.c:65:import_set_state_nolock()) ffff90a683b2e000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1788574434.116148:0:15029:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934605 00010000:00010000:2.0:1788574434.116154:0:14332:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1788574434.116550:0:14340:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788574434.116705:0:15029:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a79245a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5767af78-1871-405c-8c59-f96bc15eec86+2:2352:x1875455727765376:12345-192.168.201.57@tcp:9:kworker.0 Request processed in 1232us (1749us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574434.116715:0:15029:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 23 00000100:00100000:0.0:1788574434.433208:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a7a7845c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:3cd60e94-2a59-4e1b-b761-ea9d2ceff3ab:3314:1875455747672448:0@lo:400:kworker.0 00000100:00100000:0.0:1788574434.433304:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788574434.433385:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788574434.433392:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a7bb289500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1875455747672576:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788574434.433419:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788574434.433449:0:15032:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747672576 00000100:00100000:0.0:1788574434.433455:0:15032:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747672576 00000100:00100000:0.0:1788574434.433499:0:15032:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1788574434.433507:0:15032:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6839d1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1875455747672576:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788574434.433539:0:15032:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3851419648 avail 3849322496 00000100:00100000:0.0:1788574434.433577:0:15032:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6839d1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1875455747672576:12345-0@lo:13:osp-pre-1-0.0 Request processed in 70us (156us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574434.433583:0:15032:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00080000:0.0:1788574434.433601:0:14340:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788574434.433653:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a7bb289500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1875455747672576:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788574434.434046:0:14339:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747672448 00000100:00100000:0.0:1788574434.434051:0:14339:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747672448 00000100:00100000:0.0:1788574434.434080:0:14339:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:0.0:1788574434.434085:0:14339:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a784f40450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3cd60e94-2a59-4e1b-b761-ea9d2ceff3ab+19:3314:x1875455747672448:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788574434.434126:0:14339:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a784f40450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3cd60e94-2a59-4e1b-b761-ea9d2ceff3ab+19:3314:x1875455747672448:12345-0@lo:400:kworker.0 Request processed in 42us (823us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574434.434132:0:14339:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:0.0:1788574434.434166:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a7a7845c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:3cd60e94-2a59-4e1b-b761-ea9d2ceff3ab:3314:1875455747672448:0@lo:400:kworker.0 00000100:00100000:1.0:1788574434.439012:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a7a7845c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1875455747672704:0@lo:400:kworker.0 00000100:00100000:1.0:1788574434.439113:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788574434.439165:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788574434.439171:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a7a7845500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3312:1875455747672832:0@lo:400:kworker.0 00000100:00100000:1.0:1788574434.439199:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788574434.439234:0:16578:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747672704 00000100:00100000:1.0:1788574434.439243:0:16578:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747672704 00000100:00100000:1.0:1788574434.439304:0:16578:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1788574434.439313:0:16578:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7933bad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3312:x1875455747672704:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788574434.439386:0:16578:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7933bad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3312:x1875455747672704:12345-0@lo:400:kworker.0 Request processed in 54us (253us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574434.439394:0:16578:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1788574434.439437:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a7a7845c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1875455747672704:0@lo:400:kworker.0 00000100:00080000:1.0:1788574434.439461:0:14340:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788574434.439473:0:14344:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747672832 00000100:00100000:1.0:1788574434.439476:0:14344:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747672832 00000100:00100000:1.0:1788574434.439503:0:14344:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1788574434.439510:0:14344:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7933baa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1875455747672832:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788574434.439565:0:14344:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7933baa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1875455747672832:12345-0@lo:400:kworker.0 Request processed in 55us (364us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574434.439572:0:14344:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1788574434.439597:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a7a7845500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3312:1875455747672832:0@lo:400:kworker.0 00000100:00100000:1.0:1788574434.439616:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a7933bb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3314:1875455747672960:0@lo:400:kworker.0 00000100:00100000:1.0:1788574434.439641:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788574434.439859:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788574434.439870:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a7933b9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3314:1875455747673088:0@lo:400:kworker.0 00000100:00100000:1.0:1788574434.439897:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788574434.439977:0:14345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747672960 00000100:00100000:1.0:1788574434.439982:0:14345:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747672960 00000100:00100000:1.0:1788574434.440010:0:14345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747673088 00000100:00100000:1.0:1788574434.440013:0:14345:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747673088 00000100:00100000:1.0:1788574434.440029:0:14345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1788574434.440036:0:14345:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7933b9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1875455747672960:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788574434.440073:0:14345:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7933b9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1875455747672960:12345-0@lo:400:kworker.0 Request processed in 38us (431us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574434.440080:0:14345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1788574434.440091:0:14345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1788574434.440097:0:14345:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7a7845500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1875455747673088:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788574434.440124:0:14345:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7a7845500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1875455747673088:12345-0@lo:400:kworker.0 Request processed in 27us (226us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574434.440129:0:14345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00080000:1.0:1788574434.440144:0:14340:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788574434.440168:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a7933b9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3314:1875455747673088:0@lo:400:kworker.0 00000100:00100000:1.0:1788574434.440192:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a7933bb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3314:1875455747672960:0@lo:400:kworker.0 00010000:00010000:3.0:1788574434.688583:0:14333:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788574434.944937:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a6839d0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1875455747673216:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788574434.945023:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788574434.945209:0:15032:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747673216 00000100:00100000:0.0:1788574434.945218:0:15032:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747673216 00000100:00100000:0.0:1788574434.945266:0:15032:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1788574434.945276:0:15032:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7a7845c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1875455747673216:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788574434.945317:0:15032:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788574434.945402:0:15032:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7a7845c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1875455747673216:12345-0@lo:13:osp-pre-0-0.0 Request processed in 128us (378us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574434.945419:0:15032:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1788574434.945553:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a6839d0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1875455747673216:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788574435.497248:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:2.0:1788574435.501625:0:14348:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727765760 00000100:00100000:2.0:1788574435.501660:0:14348:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727765760 00000100:00100000:2.0:1788574435.501777:0:14348:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 13 00000100:00100000:2.0:1788574435.501790:0:14348:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a79245bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5767af78-1871-405c-8c59-f96bc15eec86+12:15292:x1875455727765760:12345-192.168.201.57@tcp:35:umount.0 00000001:00080000:2.0:1788574435.503856:0:14348:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934624 00000100:00100000:2.0:1788574435.505274:0:14348:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a79245bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5767af78-1871-405c-8c59-f96bc15eec86+14:15292:x1875455727765760:12345-192.168.201.57@tcp:35:umount.0 Request processed in 3464us (8023us total) trans 8589934625 rc 0/0 00000100:00100000:2.0:1788574435.505291:0:14348:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 13 00000020:00080000:2.0:1788574435.505299:0:14348:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1788574435.509407:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:3.0:1788574435.509476:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:1.0:1788574435.509551:0:14330:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727765888 00000100:00100000:1.0:1788574435.509566:0:14330:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727765888 00000100:00100000:1.0:1788574435.509657:0:14330:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727766016 00000100:00100000:1.0:1788574435.509661:0:14330:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727766016 00000100:00100000:1.0:1788574435.509686:0:14330:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 3 00000100:00100000:1.0:1788574435.509697:0:14330:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a792458700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:125108d1-8047-4740-b3d2-4049e113b9ae+14:2356:x1875455727765888:12345-192.168.201.57@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788574435.509715:0:14330:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788574435.509754:0:14330:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90a79e984200/0x10531a153b536c97 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801000000000 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce3b64 expref: 14 pid: 14337 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574435.510023:0:14330:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788574435.510110:0:14330:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a792458700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:125108d1-8047-4740-b3d2-4049e113b9ae+13:2356:x1875455727765888:12345-192.168.201.57@tcp:103:ldlm_bl.0 Request processed in 412us (746us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574435.510119:0:14330:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 3 00000100:00100000:1.0:1788574435.510143:0:14330:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 4 00000100:00100000:1.0:1788574435.510151:0:14330:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7a7603850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:125108d1-8047-4740-b3d2-4049e113b9ae+12:2356:x1875455727766016:12345-192.168.201.57@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788574435.510159:0:14330:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788574435.510169:0:14330:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90a790a20a00/0x10531a153b536c9e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce3b8e expref: 12 pid: 14337 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574435.510179:0:14330:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788574435.510212:0:14330:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7a7603850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:125108d1-8047-4740-b3d2-4049e113b9ae+11:2356:x1875455727766016:12345-192.168.201.57@tcp:103:ldlm_bl.0 Request processed in 62us (736us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574435.510219:0:14330:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 4 00000100:00100000:3.0:1788574435.513683:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:2.0:1788574435.513995:0:14329:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727766144 00000100:00100000:2.0:1788574435.514019:0:14329:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727766144 00000100:00100000:2.0:1788574435.514077:0:14329:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 5 00000100:00100000:2.0:1788574435.514087:0:14329:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a792459c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:125108d1-8047-4740-b3d2-4049e113b9ae+11:2354:x1875455727766144:12345-192.168.201.57@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788574435.514103:0:14329:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788574435.514122:0:14329:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90a7829d7000/0x10531a153b536d3f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce3c2f expref: 11 pid: 14338 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574435.514140:0:14329:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788574435.514196:0:14329:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a792459c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:125108d1-8047-4740-b3d2-4049e113b9ae+10:2354:x1875455727766144:12345-192.168.201.57@tcp:103:ldlm_bl.0 Request processed in 111us (525us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574435.514204:0:14329:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 5 00000100:00100000:3.0:1788574435.531491:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:1.0:1788574435.531751:0:14345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727767040 00000100:00100000:1.0:1788574435.531763:0:14345:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727767040 00000100:00100000:1.0:1788574435.531857:0:14345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 55 00000100:00100000:1.0:1788574435.531870:0:14345:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a79245ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5767af78-1871-405c-8c59-f96bc15eec86+14:2352:x1875455727767040:12345-192.168.201.57@tcp:39:umount.0 00000020:00000080:1.0:1788574435.531915:0:14345:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x10531a153b536cac 00000020:00010000:1.0:1788574435.531936:0:14345:0:(genops.c:1921:obd_stale_export_put()) Put export ffff90a6811b6000: total 0 00000100:00080000:1.0:1788574435.531942:0:14345:0:(import.c:65:import_set_state_nolock()) ffff90a682201000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1788574435.531977:0:14345:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934625 00000020:00010000:3.0:1788574435.532024:0:15396:0:(genops.c:1907:obd_stale_export_get()) Get export ffff90a6811b6000: total 0 00010000:00010000:3.0:1788574435.532030:0:15396:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788574435.532099:0:15396:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff90a6811b6000, canceled 0 locks, left on hash table 7. 00010000:00010000:3.0:1788574435.532139:0:15396:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff90a7b2398900) 00010000:00010000:3.0:1788574435.532143:0:15396:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788574435.532152:0:15396:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a68116be00/0x10531a153b536d77 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce3c3d expref: 13 pid: 14344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574435.532256:0:15396:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90a784e37800) 00010000:00010000:3.0:1788574435.532317:0:15396:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788574435.532450:0:15396:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a7829d6200/0x10531a153b536daf lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce3c4b expref: 13 pid: 14346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574435.532475:0:15396:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff90a7b2398d00) 00010000:00010000:3.0:1788574435.532478:0:15396:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788574435.532483:0:15396:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a68116b800/0x10531a153b536d5b lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce3c36 expref: 13 pid: 14345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574435.532554:0:15396:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff90a784e37b00) 00010000:00010000:3.0:1788574435.532558:0:15396:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1788574435.532564:0:15396:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a68116b200/0x10531a153b536e34 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce3c75 expref: 10 pid: 14345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574435.532586:0:15396:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff90a782d70600) 00010000:00010000:3.0:1788574435.532588:0:15396:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1788574435.532593:0:15396:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a79e985a00/0x10531a153b536f30 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce3cc2 expref: 9 pid: 14346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788574435.532606:0:14345:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a79245ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5767af78-1871-405c-8c59-f96bc15eec86+9:2352:x1875455727767040:12345-192.168.201.57@tcp:39:umount.0 Request processed in 738us (1131us total) trans 8589934626 rc 0/0 00000100:00100000:1.0:1788574435.532615:0:14345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 55 00010000:00010000:3.0:1788574435.533429:0:15396:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff90a784e37400) 00010000:00010000:3.0:1788574435.533433:0:15396:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1788574435.533457:0:15396:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a78165b400/0x10531a153b536eb2 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce3c9f expref: 7 pid: 14346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574435.533476:0:15396:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff90a784e37400) 00010000:00010000:3.0:1788574435.533479:0:15396:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788574435.533483:0:15396:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a78165be00/0x10531a153b536ed5 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce3cad expref: 6 pid: 14346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574435.533497:0:15396:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff90a6811b6000, canceled 7 locks, left on hash table 0. 00010000:00010000:3.0:1788574435.533585:0:15396:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788574435.533588:0:15396:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788574435.533590:0:15396:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788574435.712821:0:14332:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1788574436.084076:0:7676:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 5767af78-1871-405c-8c59-f96bc15eec86 00000020:00000080:0.0:1788574436.084093:0:7676:0:(genops.c:885:class_export_put()) final put ffff90a683b29800/5767af78-1871-405c-8c59-f96bc15eec86 00000020:00000080:1.0:1788574436.084275:0:489:0:(genops.c:844:class_export_destroy()) destroying export ffff90a683b29800/5767af78-1871-405c-8c59-f96bc15eec86 for lustre-OST0001 00000020:00000080:1.0:1788574436.084336:0:489:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff90a683b2e000 for lustre-OST0001 00010000:00010000:3.0:1788574436.736552:0:14333:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788574436.801793:0:14378:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:0.0:1788574436.801806:0:14378:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788574436.801869:0:14378:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:0.0:1788574436.801875:0:14378:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00010000:00010000:3.0:1788574437.760630:0:15396:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788574438.116230:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:3.0:1788574438.116284:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:3.0:1788574438.116321:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:2.0:1788574438.116721:0:14329:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727767296 00000100:00100000:2.0:1788574438.116735:0:14329:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727767296 00000100:00100000:2.0:1788574438.116802:0:14329:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727767552 00000100:00100000:2.0:1788574438.116805:0:14329:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727767552 00000100:00100000:2.0:1788574438.116818:0:14329:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727767424 00000100:00100000:2.0:1788574438.116819:0:14329:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727767424 00000100:00100000:2.0:1788574438.116836:0:14329:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 6 00000100:00100000:2.0:1788574438.116847:0:14329:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a79245b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:125108d1-8047-4740-b3d2-4049e113b9ae+12:2356:x1875455727767296:12345-192.168.201.57@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788574438.116870:0:14329:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788574438.116898:0:14329:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90a790a21c00/0x10531a153b536ccf lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce3bc6 expref: 12 pid: 14337 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574438.116925:0:14329:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788574438.116993:0:14329:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a79245b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:125108d1-8047-4740-b3d2-4049e113b9ae+11:2356:x1875455727767296:12345-192.168.201.57@tcp:103:ldlm_bl.0 Request processed in 146us (776us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574438.117001:0:14329:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 6 00000100:00100000:2.0:1788574438.117050:0:14329:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 7 00000100:00100000:2.0:1788574438.117056:0:14329:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a792459f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:125108d1-8047-4740-b3d2-4049e113b9ae+10:2356:x1875455727767552:12345-192.168.201.57@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788574438.117065:0:14329:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788574438.117075:0:14329:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90a68116b400/0x10531a153b536d38 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce3c28 expref: 10 pid: 14338 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574438.117084:0:14329:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788574438.117103:0:14329:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a792459f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:125108d1-8047-4740-b3d2-4049e113b9ae+9:2356:x1875455727767552:12345-192.168.201.57@tcp:103:ldlm_bl.0 Request processed in 47us (819us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574438.117109:0:14329:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 7 00000100:00100000:2.0:1788574438.117122:0:14329:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 8 00000100:00100000:2.0:1788574438.117128:0:14329:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a792458000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:125108d1-8047-4740-b3d2-4049e113b9ae+8:2356:x1875455727767424:12345-192.168.201.57@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788574438.117136:0:14329:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788574438.117145:0:14329:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90a68116a000/0x10531a153b536cd6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce3bf0 expref: 8 pid: 14338 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574438.117153:0:14329:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788574438.117169:0:14329:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a792458000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:125108d1-8047-4740-b3d2-4049e113b9ae+7:2356:x1875455727767424:12345-192.168.201.57@tcp:103:ldlm_bl.0 Request processed in 41us (848us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574438.117175:0:14329:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 8 00000100:00100000:2.0:1788574438.126330:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:1.0:1788574438.130162:0:14346:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727767680 00000100:00100000:1.0:1788574438.130186:0:14346:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727767680 00000100:00100000:1.0:1788574438.130311:0:14346:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 56 00000100:00100000:1.0:1788574438.130326:0:14346:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7bb28a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5bc00dcd-c724-4b6b-a75b-9c8606e9461b+6:2352:x1875455727767680:12345-192.168.201.57@tcp:39:umount.0 00000020:00000080:1.0:1788574438.130410:0:14346:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x10531a153b536ce4 00000020:00010000:1.0:1788574438.130420:0:14346:0:(genops.c:1921:obd_stale_export_put()) Put export ffff90a68134b800: total 0 00000100:00080000:1.0:1788574438.130425:0:14346:0:(import.c:65:import_set_state_nolock()) ffff90a68134b000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1788574438.130458:0:14346:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934626 00000100:00100000:1.0:1788574438.130757:0:14346:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7bb28a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5bc00dcd-c724-4b6b-a75b-9c8606e9461b+5:2352:x1875455727767680:12345-192.168.201.57@tcp:39:umount.0 Request processed in 435us (4436us total) trans 8589934627 rc 0/0 00000100:00100000:1.0:1788574438.130766:0:14346:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 56 00000100:00080000:2.0:1788574438.131270:0:14340:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000020:00010000:2.0:1788574438.131285:0:14332:0:(genops.c:1907:obd_stale_export_get()) Get export ffff90a68134b800: total 0 00010000:00010000:2.0:1788574438.131335:0:14332:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff90a68134b800, canceled 0 locks, left on hash table 1. 00010000:00010000:2.0:1788574438.131406:0:14332:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90a784e37800) 00010000:00010000:2.0:1788574438.131410:0:14332:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788574438.131421:0:14332:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a68116b600/0x10531a153b536dbd lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce3c52 expref: 4 pid: 14345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574438.131457:0:14332:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff90a68134b800, canceled 1 locks, left on hash table 0. 00010000:00010000:2.0:1788574438.131471:0:14332:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788574438.131473:0:14332:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788574438.131475:0:14332:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788574438.169433:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:2.0:1788574438.169572:0:14337:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727767936 00000100:00100000:2.0:1788574438.169584:0:14337:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727767936 00000100:00100000:2.0:1788574438.169644:0:14337:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 136 00000100:00100000:2.0:1788574438.169656:0:14337:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a784f41450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:125108d1-8047-4740-b3d2-4049e113b9ae+7:2352:x1875455727767936:12345-192.168.201.57@tcp:251:umount.0 00000020:00000080:2.0:1788574438.169746:0:14337:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x10531a153b536c89 00000020:00010000:2.0:1788574438.169756:0:14337:0:(genops.c:1921:obd_stale_export_put()) Put export ffff90a68134c800: total 0 00000100:00080000:2.0:1788574438.169761:0:14337:0:(import.c:65:import_set_state_nolock()) ffff90a68134a000 : changing import state from FULL to CLOSED 00000100:00100000:2.0:1788574438.169858:0:14337:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a784f41450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:125108d1-8047-4740-b3d2-4049e113b9ae+3:2352:x1875455727767936:12345-192.168.201.57@tcp:251:umount.0 Request processed in 205us (438us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574438.169867:0:14337:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 136 00000020:00010000:3.0:1788574438.170649:0:14333:0:(genops.c:1907:obd_stale_export_get()) Get export ffff90a68134c800: total 0 00010000:00010000:3.0:1788574438.170719:0:14333:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff90a68134c800, canceled 0 locks, left on hash table 1. 00010000:00010000:3.0:1788574438.170756:0:14333:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90a790a21e00/0x10531a153b536c90 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801000000000 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce3b5d expref: 2 pid: 14338 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574438.170773:0:14333:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff90a68134c800, canceled 1 locks, left on hash table 0. 00000020:00000080:3.0:1788574438.170780:0:14333:0:(genops.c:885:class_export_put()) final put ffff90a68134c800/125108d1-8047-4740-b3d2-4049e113b9ae 00010000:00010000:3.0:1788574438.170803:0:14333:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788574438.170807:0:14333:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788574438.170808:0:14333:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1788574438.170922:0:13890:0:(genops.c:844:class_export_destroy()) destroying export ffff90a68134c800/125108d1-8047-4740-b3d2-4049e113b9ae for MGS 00000020:00000080:0.0:1788574438.170964:0:13890:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff90a68134a000 for MGS 00010000:00010000:1.0:1788574438.786494:0:15396:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788574439.563015:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a7bb28b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1875455747673344:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788574439.563089:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788574439.563176:0:15032:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747673344 00000100:00100000:2.0:1788574439.563185:0:15032:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747673344 00000100:00100000:2.0:1788574439.563251:0:15032:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1788574439.563260:0:15032:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7bb28b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1875455747673344:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788574439.563294:0:15032:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3851419648 avail 3849322496 00000100:00100000:2.0:1788574439.563337:0:15032:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7bb28b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1875455747673344:12345-0@lo:13:osp-pre-1-0.0 Request processed in 77us (248us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574439.563344:0:15032:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00080000:2.0:1788574439.563381:0:14340:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788574439.563427:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a7bb28b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1875455747673344:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788574439.580711:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a792458700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1875455747673600:0@lo:400:kworker.0 00000100:00100000:3.0:1788574439.580814:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788574439.580878:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:3.0:1788574439.580885:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a79245a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:3cd60e94-2a59-4e1b-b761-ea9d2ceff3ab:3315:1875455747673472:0@lo:400:kworker.0 00000100:00100000:3.0:1788574439.580914:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788574439.580938:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a7bbebd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3315:1875455747673984:0@lo:400:kworker.0 00000100:00100000:3.0:1788574439.580962:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788574439.580990:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a7bbebca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3312:1875455747673728:0@lo:400:kworker.0 00000100:00100000:3.0:1788574439.581011:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788574439.581038:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788574439.581044:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a7bbebf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3312:1875455747673856:0@lo:400:kworker.0 00000100:00100000:3.0:1788574439.581065:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788574439.581099:0:15028:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747673600 00000100:00100000:3.0:1788574439.581108:0:15028:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747673600 00000100:00100000:3.0:1788574439.581166:0:15028:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1788574439.581175:0:15028:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7bbebd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3315:x1875455747673600:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788574439.581357:0:15028:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7bbebd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3315:x1875455747673600:12345-0@lo:400:kworker.0 Request processed in 182us (542us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574439.581364:0:15028:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1788574439.581410:0:14338:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747673472 00000100:00100000:3.0:1788574439.581414:0:14338:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747673472 00000100:00100000:3.0:1788574439.581438:0:14338:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:3.0:1788574439.581444:0:14338:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a784f40c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3cd60e94-2a59-4e1b-b761-ea9d2ceff3ab+19:3315:x1875455747673472:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788574439.581472:0:14338:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a784f40c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3cd60e94-2a59-4e1b-b761-ea9d2ceff3ab+19:3315:x1875455747673472:12345-0@lo:400:kworker.0 Request processed in 29us (558us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574439.581478:0:14338:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:3.0:1788574439.581503:0:14344:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747673984 00000100:00100000:3.0:1788574439.581512:0:14344:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747673984 00000100:00100000:3.0:1788574439.581601:0:14344:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747673728 00000100:00100000:3.0:1788574439.581605:0:14344:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747673728 00000100:00100000:3.0:1788574439.581619:0:14344:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747673856 00000100:00100000:3.0:1788574439.581620:0:14344:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747673856 00000100:00100000:3.0:1788574439.581633:0:14344:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1788574439.581638:0:14344:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7bbebf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1875455747673984:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788574439.581681:0:14344:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7bbebf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1875455747673984:12345-0@lo:400:kworker.0 Request processed in 42us (717us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574439.581688:0:14344:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1788574439.581702:0:14344:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1788574439.581708:0:14344:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7bbebdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1875455747673728:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788574439.581741:0:14344:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7bbebdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1875455747673728:12345-0@lo:400:kworker.0 Request processed in 33us (728us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574439.581747:0:14344:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1788574439.581758:0:14344:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1788574439.581763:0:14344:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7bbebe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1875455747673856:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788574439.581784:0:14344:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7bbebe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1875455747673856:12345-0@lo:400:kworker.0 Request processed in 22us (719us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574439.581789:0:14344:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00080000:3.0:1788574439.581803:0:14340:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788574439.581808:0:14340:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788574439.581832:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a79245a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:3cd60e94-2a59-4e1b-b761-ea9d2ceff3ab:3315:1875455747673472:0@lo:400:kworker.0 00000100:00100000:3.0:1788574439.581846:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a7bbebd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3315:1875455747673984:0@lo:400:kworker.0 00000100:00100000:3.0:1788574439.581855:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a792458700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1875455747673600:0@lo:400:kworker.0 00000100:00100000:3.0:1788574439.581889:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a7bbebf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3312:1875455747673856:0@lo:400:kworker.0 00000100:00100000:3.0:1788574439.581907:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a7bbebca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3312:1875455747673728:0@lo:400:kworker.0 00000001:00100000:3.0:1788574439.626022:0:5879:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 5bc00dcd-c724-4b6b-a75b-9c8606e9461b 00000001:00080000:3.0:1788574439.626040:0:5879:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934627 is committed 00000020:00000080:3.0:1788574439.626045:0:5879:0:(genops.c:885:class_export_put()) final put ffff90a68134b800/5bc00dcd-c724-4b6b-a75b-9c8606e9461b 00000001:00100000:3.0:1788574439.626063:0:5879:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 5767af78-1871-405c-8c59-f96bc15eec86 00000001:00080000:3.0:1788574439.626068:0:5879:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934626 is committed 00000020:00000080:3.0:1788574439.626079:0:5879:0:(genops.c:885:class_export_put()) final put ffff90a6811b6000/5767af78-1871-405c-8c59-f96bc15eec86 00000020:00000080:3.0:1788574439.626093:0:489:0:(genops.c:844:class_export_destroy()) destroying export ffff90a68134b800/5bc00dcd-c724-4b6b-a75b-9c8606e9461b for lustre-MDT0000 00000020:00000080:3.0:1788574439.626153:0:489:0:(genops.c:844:class_export_destroy()) destroying export ffff90a6811b6000/5767af78-1871-405c-8c59-f96bc15eec86 for lustre-MDT0000 00000020:00000080:3.0:1788574439.626186:0:489:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff90a68134b000 for lustre-MDT0000 00000020:00000080:3.0:1788574439.626850:0:489:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff90a682201000 for lustre-MDT0000 00010000:00010000:1.0:1788574439.811471:0:14332:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788574440.067196:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788574440.067221:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a6839d1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1875455747674112:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788574440.067319:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788574440.067409:0:15032:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747674112 00000100:00100000:0.0:1788574440.067418:0:15032:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747674112 00000100:00100000:0.0:1788574440.067464:0:15032:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1788574440.067474:0:15032:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6839d0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1875455747674112:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788574440.067525:0:15032:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788574440.067571:0:15032:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6839d0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1875455747674112:12345-0@lo:13:osp-pre-0-0.0 Request processed in 98us (252us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574440.067578:0:15032:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1788574440.067626:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a6839d1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1875455747674112:0@lo:13:osp-pre-0-0.0 00000020:01000004:2.0:1788574440.445808:0:17489:0:(tgt_mount.c:2195:server_umount_begin()) umount -f 00000020:01000004:0.0:1788574440.463962:0:17489:0:(tgt_mount.c:2065:server_put_super()) server put_super lustre-MDT0000 00010000:00010000:0.0:1788574440.464027:0:17489:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.157@tcp lock: ffff90a7c2159c00/0x10531a153b5369b8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x10531a153b5369bf expref: -99 pid: 14326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574440.464046:0:17489:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.157@tcp lock: ffff90a7c2159c00/0x10531a153b5369b8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x10531a153b5369bf expref: -99 pid: 14326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574440.464054:0:17489:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.157@tcp lock: ffff90a7c2159c00/0x10531a153b5369b8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0x10531a153b5369bf expref: -99 pid: 14326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574440.464062:0:17489:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.157@tcp lock: ffff90a7c2159c00/0x10531a153b5369b8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0x10531a153b5369bf expref: -99 pid: 14326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574440.464089:0:17489:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:0.0:1788574440.464095:0:17489:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:0.0:1788574440.464118:0:17489:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1788574440.464123:0:17489:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 3 00000100:00080000:0.0:1788574440.464129:0:17489:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00080000:0.0:1788574440.464171:0:17489:0:(import.c:65:import_set_state_nolock()) ffff90a785314800 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00010000:00010000:3.0:1788574440.464262:0:14333:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788574440.464269:0:14333:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.157@tcp lock: ffff90a7c2159c00/0x10531a153b5369b8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0x10531a153b5369bf expref: -99 pid: 14326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574440.464277:0:14333:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a7c2159c00 already unused, calling callback (ffffffffc1bbcc20) 10000000:00010000:3.0:1788574440.464282:0:14333:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.157@tcp lock: ffff90a7c2159c00/0x10531a153b5369b8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0x10531a153b5369bf expref: -99 pid: 14326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574440.464291:0:14333:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.157@tcp lock: ffff90a7c2159c00/0x10531a153b5369b8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1008400000000 nid: local remote: 0x10531a153b5369bf expref: -99 pid: 14326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788574440.464299:0:14333:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.157@tcp lock: ffff90a7c2159c00/0x10531a153b5369b8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1009400000000 nid: local remote: 0x10531a153b5369bf expref: -99 pid: 14326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788574440.464305:0:14333:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1788574440.464308:0:14333:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:3.0:1788574440.464310:0:14333:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:3.0:1788574440.464360:0:14333:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.157@tcp lock: ffff90a7c2159c00/0x10531a153b5369b8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x10531a153b5369bf expref: -99 pid: 14326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574440.464398:0:14333:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788574440.464423:0:14333:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.157@tcp lock: ffff90a7c2159c00/0x10531a153b5369b8 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x10531a153b5369bf expref: -99 pid: 14326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574440.464431:0:14333:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.157@tcp lock: ffff90a7c2159c00/0x10531a153b5369b8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x10531a153b5369bf expref: -99 pid: 14326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574440.464447:0:14333:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788574440.464449:0:14333:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788574440.464451:0:14333:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788574440.464460:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788574440.464478:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a7bbebca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:3cd60e94-2a59-4e1b-b761-ea9d2ceff3ab:3313:1875455747674368:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788574440.464564:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788574440.464659:0:14329:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747674368 00000100:00100000:3.0:1788574440.464668:0:14329:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747674368 00000100:00100000:3.0:1788574440.464720:0:14329:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788574440.464731:0:14329:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7bbebf480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3cd60e94-2a59-4e1b-b761-ea9d2ceff3ab+19:3313:x1875455747674368:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788574440.464745:0:14329:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788574440.464761:0:14329:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90a7c2159200/0x10531a153b5369bf lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x10531a153b5369b8 expref: 19 pid: 14337 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574440.464774:0:14329:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788574440.464809:0:14329:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7bbebf480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3cd60e94-2a59-4e1b-b761-ea9d2ceff3ab+18:3313:x1875455747674368:12345-0@lo:103:ldlm_bl.0 Request processed in 79us (261us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574440.464816:0:14329:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788574440.464856:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a7bbebca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:3cd60e94-2a59-4e1b-b761-ea9d2ceff3ab:3313:1875455747674368:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788574440.465543:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a6839d1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3311:1875455747674240:0@lo:39:umount.0 00000100:00100000:1.0:1788574440.465588:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788574440.465684:0:14344:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747674240 00000100:00100000:3.0:1788574440.465690:0:14344:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747674240 00000100:00100000:3.0:1788574440.465731:0:14344:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1788574440.465739:0:14344:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7a7846680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1875455747674240:12345-0@lo:39:umount.0 00000020:00000080:3.0:1788574440.465762:0:14344:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x10531a153b5369e9 00000100:00080000:3.0:1788574440.465770:0:14344:0:(import.c:65:import_set_state_nolock()) ffff90a7bba11800 : changing import state from FULL to CLOSED 00000100:00100000:3.0:1788574440.465830:0:14344:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7a7846680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+1:3311:x1875455747674240:12345-0@lo:39:umount.0 Request processed in 92us (241us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574440.465838:0:14344:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000020:00000080:3.0:1788574440.465845:0:14344:0:(genops.c:885:class_export_put()) final put ffff90a785f02000/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:3.0:1788574440.465869:0:13890:0:(genops.c:844:class_export_destroy()) destroying export ffff90a785f02000/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000 00000020:00000080:3.0:1788574440.465932:0:13890:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff90a7bba11800 for lustre-MDT0000 00010000:00010000:1.0:1788574440.466110:0:15396:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1788574440.466138:0:3311:0:(import.c:65:import_set_state_nolock()) ffff90a785314800 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:1.0:1788574440.466156:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a6839d1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3311:1875455747674240:0@lo:39:umount.0 00000100:00080000:0.0:1788574440.466215:0:17489:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1788574440.466219:0:17489:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:0.0:1788574440.466224:0:17489:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:0.0:1788574440.467748:0:17489:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.157@tcp lock: ffff90a79e984e00/0x10531a153b53691e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x10531a153b536925 expref: -99 pid: 14326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574440.467768:0:17489:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.157@tcp lock: ffff90a79e984e00/0x10531a153b53691e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x10531a153b536925 expref: -99 pid: 14326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574440.467776:0:17489:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.157@tcp lock: ffff90a79e984e00/0x10531a153b53691e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0x10531a153b536925 expref: -99 pid: 14326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574440.467783:0:17489:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.157@tcp lock: ffff90a79e984e00/0x10531a153b53691e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0x10531a153b536925 expref: -99 pid: 14326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574440.467798:0:17489:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788574440.467804:0:17489:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.157@tcp lock: ffff90a7bfa4d600/0x10531a153b536bb0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x10531a153b536bb7 expref: -99 pid: 14341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574440.467810:0:17489:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.157@tcp lock: ffff90a7bfa4d600/0x10531a153b536bb0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x10531a153b536bb7 expref: -99 pid: 14341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574440.467816:0:17489:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.157@tcp lock: ffff90a7bfa4d600/0x10531a153b536bb0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x10531a153b536bb7 expref: -99 pid: 14341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574440.467821:0:17489:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.157@tcp lock: ffff90a7bfa4d600/0x10531a153b536bb0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x10531a153b536bb7 expref: -99 pid: 14341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574440.467835:0:17489:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1788574440.467856:0:17489:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.157@tcp lock: ffff90a790a21600/0x10531a153b536d2a lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x10531a153b536d31 expref: -99 pid: 14341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574440.467863:0:17489:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.157@tcp lock: ffff90a790a21600/0x10531a153b536d2a lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x10531a153b536d31 expref: -99 pid: 14341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574440.467870:0:17489:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.157@tcp lock: ffff90a790a21600/0x10531a153b536d2a lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x10531a153b536d31 expref: -99 pid: 14341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574440.467876:0:17489:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.157@tcp lock: ffff90a790a21600/0x10531a153b536d2a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x10531a153b536d31 expref: -99 pid: 14341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574440.467886:0:17489:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:0.0:1788574440.467903:0:17489:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.157@tcp lock: ffff90a79e984000/0x10531a153b536910 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x10531a153b536917 expref: -99 pid: 14326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574440.467909:0:17489:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.157@tcp lock: ffff90a79e984000/0x10531a153b536910 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x10531a153b536917 expref: -99 pid: 14326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574440.467915:0:17489:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.157@tcp lock: ffff90a79e984000/0x10531a153b536910 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x10531a153b536917 expref: -99 pid: 14326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574440.467922:0:17489:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.157@tcp lock: ffff90a79e984000/0x10531a153b536910 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x10531a153b536917 expref: -99 pid: 14326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574440.467928:0:17489:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 10000000:01000000:0.0:1788574440.467931:0:17489:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0000 (0) 00000020:01000004:0.0:1788574440.467959:0:17489:0:(tgt_mount.c:2115:server_put_super()) stopping lustre-MDT0000 00000020:01000000:0.0:1788574440.467963:0:17489:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000 (flags='F') 00000020:00000080:0.0:1788574440.467968:0:17489:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788574440.467974:0:17489:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000: forcing exports to disconnect: 2/5 00000020:00080000:0.0:1788574440.467985:0:17489:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff90a6811b5800 lustre-MDT0000-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1788574440.467991:0:17489:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff90a78c27c800 lustre-MDT0000-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1788574440.467996:0:17489:0:(genops.c:1553:class_disconnect_exports()) OBD device 5 (ffff90a79328b380) has exports, disconnecting them 00000020:00080000:0.0:1788574440.468001:0:17489:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff90a6811b5800), last request at 1788574439 00000020:00000080:0.0:1788574440.468007:0:17489:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x10531a153b536ba2 00000100:00080000:0.0:1788574440.468025:0:17489:0:(import.c:65:import_set_state_nolock()) ffff90a6811b1000 : changing import state from FULL to CLOSED 00000020:00080000:0.0:1788574440.468082:0:17489:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff90a6811b5800): rc 0 00000020:00000080:0.0:1788574440.468085:0:17489:0:(genops.c:885:class_export_put()) final put ffff90a6811b5800/lustre-MDT0000-lwp-OST0001_UUID 00000020:00080000:0.0:1788574440.468094:0:17489:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff90a78c27c800), last request at 1788574439 00000020:00000080:0.0:1788574440.468097:0:17489:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x10531a153b536a6e 00000100:00080000:0.0:1788574440.468102:0:17489:0:(import.c:65:import_set_state_nolock()) ffff90a78c27a000 : changing import state from FULL to CLOSED 00000020:00080000:0.0:1788574440.468108:0:17489:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff90a78c27c800): rc 0 00000020:00000080:0.0:1788574440.468110:0:17489:0:(genops.c:885:class_export_put()) final put ffff90a78c27c800/lustre-MDT0000-lwp-OST0000_UUID 00000004:00000080:0.0:1788574440.468117:0:17489:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=400866e7 len=0 karg=ffffb3a241957ae0 00000100:00080000:0.0:1788574440.468140:0:17489:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:0.0:1788574440.468143:0:17489:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934593 gen 3 00000004:00080000:0.0:1788574440.468157:0:17489:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:0.0:1788574440.468234:0:17489:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:0.0:1788574440.468261:0:17489:0:(import.c:65:import_set_state_nolock()) ffff90a791da2800 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00080000:0.0:1788574440.468276:0:17489:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:0.0:1788574440.468278:0:17489:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934597 gen 3 00000004:00080000:0.0:1788574440.468295:0:17489:0:(osp_dev.c:1634:osp_import_event()) got inactive 00010000:00010000:1.0:1788574440.468497:0:14332:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:1.0:1788574440.468506:0:14332:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.157@tcp lock: ffff90a79e984e00/0x10531a153b53691e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0x10531a153b536925 expref: -99 pid: 14326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574440.468514:0:14332:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a79e984e00 already unused, calling callback (ffffffffc1bbcc20) 10000000:00010000:1.0:1788574440.468519:0:14332:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.157@tcp lock: ffff90a79e984e00/0x10531a153b53691e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0x10531a153b536925 expref: -99 pid: 14326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574440.468528:0:14332:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.157@tcp lock: ffff90a79e984e00/0x10531a153b53691e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1008400000000 nid: local remote: 0x10531a153b536925 expref: -99 pid: 14326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788574440.468535:0:14332:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.157@tcp lock: ffff90a79e984e00/0x10531a153b53691e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1009400000000 nid: local remote: 0x10531a153b536925 expref: -99 pid: 14326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788574440.468540:0:14332:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1788574440.468543:0:14332:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0000: stopping, won't requeue 10000000:01000000:1.0:1788574440.468545:0:14332:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0000 00010000:00010000:1.0:1788574440.468576:0:14332:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.157@tcp lock: ffff90a79e984e00/0x10531a153b53691e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x10531a153b536925 expref: -99 pid: 14326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574440.468582:0:14332:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788574440.468607:0:14332:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.157@tcp lock: ffff90a79e984e00/0x10531a153b53691e lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x10531a153b536925 expref: -99 pid: 14326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574440.468626:0:14332:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.157@tcp lock: ffff90a79e984e00/0x10531a153b53691e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x10531a153b536925 expref: -99 pid: 14326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574440.468638:0:14332:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1788574440.468642:0:14332:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.157@tcp lock: ffff90a7bfa4d600/0x10531a153b536bb0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x10531a153b536bb7 expref: -99 pid: 14341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574440.468660:0:14332:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a7bfa4d600 already unused, calling callback (ffffffffc1bbcc20) 10000000:00010000:1.0:1788574440.468664:0:14332:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.157@tcp lock: ffff90a7bfa4d600/0x10531a153b536bb0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x10531a153b536bb7 expref: -99 pid: 14341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574440.468671:0:14332:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.157@tcp lock: ffff90a7bfa4d600/0x10531a153b536bb0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x10531a153b536bb7 expref: -99 pid: 14341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788574440.468676:0:14332:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.157@tcp lock: ffff90a7bfa4d600/0x10531a153b536bb0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x10531a153b536bb7 expref: -99 pid: 14341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788574440.468680:0:14332:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:1.0:1788574440.468682:0:14332:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 10000000:01000000:1.0:1788574440.468684:0:14332:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00010000:00010000:1.0:1788574440.468698:0:14332:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.157@tcp lock: ffff90a7bfa4d600/0x10531a153b536bb0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x10531a153b536bb7 expref: -99 pid: 14341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574440.468703:0:14332:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788574440.468718:0:14332:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.157@tcp lock: ffff90a7bfa4d600/0x10531a153b536bb0 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x10531a153b536bb7 expref: -99 pid: 14341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574440.468723:0:14332:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.157@tcp lock: ffff90a7bfa4d600/0x10531a153b536bb0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x10531a153b536bb7 expref: -99 pid: 14341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574440.468746:0:14332:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788574440.468750:0:14332:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.157@tcp lock: ffff90a790a21600/0x10531a153b536d2a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x10531a153b536d31 expref: -99 pid: 14341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574440.468755:0:14332:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a790a21600 already unused, calling callback (ffffffffc1bbcc20) 10000000:00010000:1.0:1788574440.468758:0:14332:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.157@tcp lock: ffff90a790a21600/0x10531a153b536d2a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x10531a153b536d31 expref: -99 pid: 14341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574440.468766:0:14332:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.157@tcp lock: ffff90a790a21600/0x10531a153b536d2a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x10531a153b536d31 expref: -99 pid: 14341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788574440.468773:0:14332:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.157@tcp lock: ffff90a790a21600/0x10531a153b536d2a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x10531a153b536d31 expref: -99 pid: 14341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788574440.468779:0:14332:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:1.0:1788574440.468782:0:14332:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:1.0:1788574440.468783:0:14332:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:1.0:1788574440.468799:0:14332:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.157@tcp lock: ffff90a790a21600/0x10531a153b536d2a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x10531a153b536d31 expref: -99 pid: 14341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574440.468805:0:14332:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788574440.468811:0:14332:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.157@tcp lock: ffff90a790a21600/0x10531a153b536d2a lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x10531a153b536d31 expref: -99 pid: 14341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574440.468817:0:14332:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.157@tcp lock: ffff90a790a21600/0x10531a153b536d2a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x10531a153b536d31 expref: -99 pid: 14341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574440.468826:0:14332:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788574440.468829:0:14332:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.157@tcp lock: ffff90a79e984000/0x10531a153b536910 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x10531a153b536917 expref: -99 pid: 14326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574440.468842:0:14332:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a79e984000 already unused, calling callback (ffffffffc1bbcc20) 10000000:00010000:1.0:1788574440.468845:0:14332:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.157@tcp lock: ffff90a79e984000/0x10531a153b536910 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x10531a153b536917 expref: -99 pid: 14326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574440.468852:0:14332:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.157@tcp lock: ffff90a79e984000/0x10531a153b536910 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x10531a153b536917 expref: -99 pid: 14326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788574440.468858:0:14332:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.157@tcp lock: ffff90a79e984000/0x10531a153b536910 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x10531a153b536917 expref: -99 pid: 14326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788574440.468863:0:14332:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:1.0:1788574440.468865:0:14332:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 10000000:01000000:1.0:1788574440.468867:0:14332:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 00010000:00010000:1.0:1788574440.468882:0:14332:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.157@tcp lock: ffff90a79e984000/0x10531a153b536910 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x10531a153b536917 expref: -99 pid: 14326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574440.468887:0:14332:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788574440.468893:0:14332:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.157@tcp lock: ffff90a79e984000/0x10531a153b536910 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x10531a153b536917 expref: -99 pid: 14326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574440.468898:0:14332:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.157@tcp lock: ffff90a79e984000/0x10531a153b536910 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x10531a153b536917 expref: -99 pid: 14326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574440.468909:0:14332:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788574440.468910:0:14332:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788574440.468912:0:14332:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788574440.468935:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a7a72b9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:3cd60e94-2a59-4e1b-b761-ea9d2ceff3ab:3312:1875455747675008:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788574440.469025:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788574440.469089:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788574440.469104:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a7a7847480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:3cd60e94-2a59-4e1b-b761-ea9d2ceff3ab:3312:1875455747674624:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788574440.469131:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788574440.469159:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a7933bb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:3cd60e94-2a59-4e1b-b761-ea9d2ceff3ab:3314:1875455747674752:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788574440.469182:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788574440.469198:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788574440.469204:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a7933b9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:3cd60e94-2a59-4e1b-b761-ea9d2ceff3ab:3314:1875455747674880:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788574440.469224:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788574440.469256:0:14331:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747675008 00000100:00100000:1.0:1788574440.469266:0:14331:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747675008 00000100:00100000:1.0:1788574440.469309:0:14331:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747674624 00000100:00100000:1.0:1788574440.469313:0:14331:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747674624 00000100:00100000:1.0:1788574440.469461:0:14331:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747674752 00000100:00100000:1.0:1788574440.469465:0:14331:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747674752 00000100:00100000:1.0:1788574440.469477:0:14331:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747674880 00000100:00100000:1.0:1788574440.469480:0:14331:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747674880 00000100:00100000:1.0:1788574440.469496:0:14331:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1788574440.469507:0:14331:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7a72bad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3cd60e94-2a59-4e1b-b761-ea9d2ceff3ab+21:3312:x1875455747675008:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788574440.469521:0:14331:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788574440.469540:0:14331:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90a7829d7a00/0x10531a153b536917 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x10531a153b536910 expref: 21 pid: 14339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574440.469558:0:14331:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788574440.469598:0:14331:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7a72bad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3cd60e94-2a59-4e1b-b761-ea9d2ceff3ab+20:3312:x1875455747675008:12345-0@lo:103:ldlm_bl.0 Request processed in 93us (572us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574440.469605:0:14331:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1788574440.469623:0:14331:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788574440.469629:0:14331:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7a7603c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3cd60e94-2a59-4e1b-b761-ea9d2ceff3ab+19:3312:x1875455747674624:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788574440.469637:0:14331:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788574440.469665:0:14331:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90a7829d7600/0x10531a153b536925 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x10531a153b53691e expref: 19 pid: 14337 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574440.469673:0:14331:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788574440.469698:0:14331:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7a7603c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3cd60e94-2a59-4e1b-b761-ea9d2ceff3ab+18:3312:x1875455747674624:12345-0@lo:103:ldlm_bl.0 Request processed in 69us (566us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574440.469705:0:14331:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788574440.469745:0:14331:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788574440.469750:0:14331:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7a72ba300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3cd60e94-2a59-4e1b-b761-ea9d2ceff3ab+17:3314:x1875455747674752:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788574440.469757:0:14331:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788574440.469765:0:14331:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90a7829d7200/0x10531a153b536bb7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x10531a153b536bb0 expref: 17 pid: 14337 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574440.469776:0:14331:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788574440.469800:0:14331:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7a72ba300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3cd60e94-2a59-4e1b-b761-ea9d2ceff3ab+16:3314:x1875455747674752:12345-0@lo:103:ldlm_bl.0 Request processed in 50us (617us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574440.469805:0:14331:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788574440.469817:0:14331:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1788574440.469823:0:14331:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7a72b8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3cd60e94-2a59-4e1b-b761-ea9d2ceff3ab+15:3314:x1875455747674880:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788574440.469829:0:14331:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788574440.469837:0:14331:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90a7829d6a00/0x10531a153b536d31 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x10531a153b536d2a expref: 15 pid: 14337 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574440.469846:0:14331:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788574440.469867:0:14331:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7a72b8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3cd60e94-2a59-4e1b-b761-ea9d2ceff3ab+14:3314:x1875455747674880:12345-0@lo:103:ldlm_bl.0 Request processed in 45us (643us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574440.469873:0:14331:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00010000:00010000:1.0:1788574440.469895:0:15396:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788574440.469935:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a7933b9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:3cd60e94-2a59-4e1b-b761-ea9d2ceff3ab:3314:1875455747674880:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788574440.469943:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a7933bb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:3cd60e94-2a59-4e1b-b761-ea9d2ceff3ab:3314:1875455747674752:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788574440.469972:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a6839d0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3311:1875455747674496:0@lo:9:umount.0 00000100:00100000:1.0:1788574440.470007:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788574440.470042:0:16578:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747674496 00000100:00100000:1.0:1788574440.470045:0:16578:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747674496 00000100:00100000:1.0:1788574440.470077:0:16578:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1788574440.470085:0:16578:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7a72bad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3311:x1875455747674496:12345-0@lo:9:umount.0 00000020:00000080:1.0:1788574440.470110:0:16578:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x10531a153b536a8a 00000100:00080000:1.0:1788574440.470119:0:16578:0:(import.c:65:import_set_state_nolock()) ffff90a6811b1800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1788574440.470154:0:16578:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934593 00000100:00100000:1.0:1788574440.470554:0:16578:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7a72bad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+2:3311:x1875455747674496:12345-0@lo:9:umount.0 Request processed in 469us (545us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574440.470561:0:16578:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00080000:1.0:1788574440.470602:0:3311:0:(import.c:65:import_set_state_nolock()) ffff90a791da2800 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:1.0:1788574440.470614:0:3311:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:1.0:1788574440.470616:0:3311:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1788574440.470619:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a6839d0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3311:1875455747674496:0@lo:9:umount.0 00000100:00100000:1.0:1788574440.470665:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a7a7847480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:3cd60e94-2a59-4e1b-b761-ea9d2ceff3ab:3312:1875455747674624:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788574440.470674:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a7a72b9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:3cd60e94-2a59-4e1b-b761-ea9d2ceff3ab:3312:1875455747675008:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788574440.470694:0:14332:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1788574440.471021:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff90a6811b5800/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000 00000020:00000080:3.0:1788574440.471075:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff90a78c27c800/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000 00000020:00000080:3.0:1788574440.471101:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff90a6811b1000 for lustre-MDT0000 00000020:00000080:3.0:1788574440.471105:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff90a78c27a000 for lustre-MDT0000 00010000:00010000:3.0:1788574440.471117:0:14333:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1788574440.471216:0:17489:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:0.0:1788574440.471244:0:17489:0:(import.c:65:import_set_state_nolock()) ffff90a791d0f800 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000020:00080000:0.0:1788574440.471300:0:17489:0:(genops.c:1558:class_disconnect_exports()) OBD device 5 (ffff90a79328b380) has no exports 00000100:00100000:3.0:1788574440.471532:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a6839d0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3311:1875455747675136:0@lo:9:umount.0 00000100:00100000:3.0:1788574440.471583:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788574440.471673:0:15028:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747675136 00000100:00100000:0.0:1788574440.471680:0:15028:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747675136 00000100:00100000:0.0:1788574440.471762:0:15028:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1788574440.471781:0:15028:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7bbebca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3311:x1875455747675136:12345-0@lo:9:umount.0 00000020:00000080:0.0:1788574440.471804:0:15028:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x10531a153b536bbe 00000100:00080000:0.0:1788574440.471813:0:15028:0:(import.c:65:import_set_state_nolock()) ffff90a682205000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1788574440.471838:0:15028:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934605 00000100:00100000:0.0:1788574440.472128:0:15028:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7bbebca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+2:3311:x1875455747675136:12345-0@lo:9:umount.0 Request processed in 346us (543us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574440.472134:0:15028:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00010000:00010000:1.0:1788574440.472241:0:15396:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1788574440.476725:0:3311:0:(import.c:65:import_set_state_nolock()) ffff90a791d0f800 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:3.0:1788574440.476746:0:3311:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:3.0:1788574440.476748:0:3311:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1788574440.476754:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a6839d0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3311:1875455747675136:0@lo:9:umount.0 00000020:00080000:0.0:1788574440.486822:0:17489:0:(genops.c:1558:class_disconnect_exports()) OBD device 5 (ffff90a79328b380) has no exports 00000020:00000080:0.0:1788574440.566339:0:17489:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x10531a153b53696b 00000020:00000080:0.0:1788574440.566600:0:17489:0:(genops.c:885:class_export_put()) final put ffff90a785295800/lustre-QMT0000_UUID 00000020:01000000:0.0:1788574440.566621:0:17489:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-QMT0000 (flags='') 00000020:00000080:1.0:1788574440.566744:0:13890:0:(genops.c:844:class_export_destroy()) destroying export ffff90a785295800/lustre-QMT0000_UUID for lustre-QMT0000 00000020:00000080:1.0:1788574440.566774:0:17489:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788574440.566785:0:17489:0:(obd_config.c:956:class_cleanup()) lustre-QMT0000: forcing exports to disconnect: 0/1 00000020:00080000:1.0:1788574440.566790:0:17489:0:(genops.c:1558:class_disconnect_exports()) OBD device 7 (ffff90a791dcb380) has no exports 00000020:00000080:1.0:1788574440.567244:0:17489:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x10531a153b536964 00000020:00000080:1.0:1788574440.567252:0:17489:0:(genops.c:885:class_export_put()) final put ffff90a785293000/lustre-MDT0000-osd_UUID 00000020:00000080:3.0:1788574440.567567:0:13890:0:(genops.c:844:class_export_destroy()) destroying export ffff90a785293000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1788574440.567627:0:17489:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788574440.567637:0:17489:0:(obd_config.c:883:class_detach()) detach on obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:1.0:1788574440.567640:0:17489:0:(genops.c:885:class_export_put()) final put ffff90a79b17c800/lustre-QMT0000_UUID 00000020:00000080:1.0:1788574440.567643:0:17489:0:(genops.c:844:class_export_destroy()) destroying export ffff90a79b17c800/lustre-QMT0000_UUID for lustre-QMT0000 00000020:01000000:1.0:1788574440.567659:0:17489:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-QMT0000 (lustre-QMT0000_UUID) 00000020:01000000:1.0:1788574440.567808:0:17489:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff90a782cfb480 - data ffff90a7b1c41870/ffff90a68138a400 00000020:01000000:1.0:1788574440.568045:0:17489:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff90a7933a9d80 - data ffff90a7b1fb20d8/ffff90a79fb45c00 00000001:00000004:2.0:1788574440.599250:0:17489:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934627 00000100:00080000:2.0:1788574440.694553:0:17489:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:2.0:1788574440.694566:0:17489:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934593 gen 4 00000004:00080000:2.0:1788574440.694594:0:17489:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1788574440.694597:0:17489:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:1.0:1788574440.695529:0:14366:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:1.0:1788574440.695537:0:14366:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xa:0x0] index 1 count 1 00000040:00080000:1.0:1788574440.695551:0:14366:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 2 count 2 00000100:00080000:2.0:1788574440.697052:0:17489:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:2.0:1788574440.697060:0:17489:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934597 gen 4 00000004:00080000:2.0:1788574440.697085:0:17489:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1788574440.697087:0:17489:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:1.0:1788574440.699440:0:14368:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:1.0:1788574440.699450:0:14368:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xc:0x0] index 2 count 1 00000040:00080000:1.0:1788574440.699464:0:14368:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 2 count 2 00000020:00000080:0.0:1788574440.778161:0:17489:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x10531a153b536933 00000020:00000080:0.0:1788574440.778289:0:17489:0:(genops.c:885:class_export_put()) final put ffff90a792317000/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1788574440.779459:0:17489:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x10531a153b536948 00000020:00000080:0.0:1788574440.779467:0:17489:0:(genops.c:885:class_export_put()) final put ffff90a7bb2d1000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:0.0:1788574440.779474:0:17489:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-mdtlov (flags='') 00000020:00000080:0.0:1788574440.779482:0:17489:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788574440.779491:0:17489:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1788574440.779495:0:17489:0:(genops.c:1558:class_disconnect_exports()) OBD device 4 (ffff90a7932899c0) has no exports 00000004:01000000:0.0:1788574440.779668:0:17489:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:0.0:1788574440.779677:0:17489:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x10531a153b536995 00000020:00000080:0.0:1788574440.779682:0:17489:0:(genops.c:885:class_export_put()) final put ffff90a791d09800/lustre-MDT0000-mdtlov_UUID 00000020:01000000:0.0:1788574440.779686:0:17489:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0000 (flags='') 00000020:00000080:0.0:1788574440.779690:0:17489:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788574440.779694:0:17489:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:0.0:1788574440.779697:0:17489:0:(genops.c:1558:class_disconnect_exports()) OBD device 9 (ffff90a79f8fb380) has no exports 00000020:00000080:0.0:1788574440.779702:0:17489:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x10531a153b53698e 00000020:00000080:0.0:1788574440.779705:0:17489:0:(genops.c:885:class_export_put()) final put ffff90a791d0d000/lustre-MDT0000-osd_UUID 00000020:00000080:2.0:1788574440.780014:0:13890:0:(genops.c:844:class_export_destroy()) destroying export ffff90a792317000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:2.0:1788574440.780036:0:13890:0:(genops.c:844:class_export_destroy()) destroying export ffff90a7bb2d1000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:00000080:2.0:1788574440.780047:0:13890:0:(genops.c:844:class_export_destroy()) destroying export ffff90a791d09800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:00000080:2.0:1788574440.780052:0:13890:0:(genops.c:844:class_export_destroy()) destroying export ffff90a791d0d000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:0.0:1788574440.781006:0:17489:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0000: client import never connected 00000100:00080000:0.0:1788574440.781013:0:17489:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:0.0:1788574440.781017:0:17489:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934597 gen 5 00000004:00080000:0.0:1788574440.781037:0:17489:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1788574440.781039:0:17489:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1788574440.781089:0:17489:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788574440.781098:0:17489:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1788574440.781105:0:17489:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x10531a153b536980 00000020:00000080:0.0:1788574440.781113:0:17489:0:(genops.c:885:class_export_put()) final put ffff90a791d0e000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:0.0:1788574440.781118:0:17489:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0000 (flags='') 00000020:00000080:0.0:1788574440.781131:0:17489:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788574440.781135:0:17489:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:0.0:1788574440.781139:0:17489:0:(genops.c:1558:class_disconnect_exports()) OBD device 8 (ffff90a792418000) has no exports 00000020:00000080:0.0:1788574440.781145:0:17489:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x10531a153b536979 00000020:00000080:0.0:1788574440.781149:0:17489:0:(genops.c:885:class_export_put()) final put ffff90a791da7000/lustre-MDT0000-osd_UUID 00010000:01000000:0.0:1788574440.781738:0:17489:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0000: client import never connected 00000100:00080000:0.0:1788574440.781742:0:17489:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:0.0:1788574440.781744:0:17489:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934593 gen 5 00000004:00080000:0.0:1788574440.781749:0:17489:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1788574440.781750:0:17489:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1788574440.781778:0:17489:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788574440.781782:0:17489:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1788574440.781810:0:17489:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788574440.781813:0:17489:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1788574440.781817:0:17489:0:(genops.c:885:class_export_put()) final put ffff90a792311000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1788574440.781821:0:17489:0:(genops.c:844:class_export_destroy()) destroying export ffff90a792311000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:0.0:1788574440.781832:0:17489:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-mdtlov (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1788574440.782073:0:13890:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff90a791d0f800 for lustre-OST0001-osc-MDT0000 00000020:00000080:2.0:1788574440.782086:0:13890:0:(genops.c:885:class_export_put()) final put ffff90a791d0c800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1788574440.782088:0:13890:0:(genops.c:844:class_export_destroy()) destroying export ffff90a791d0c800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:01000000:2.0:1788574440.782093:0:13890:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1788574440.782160:0:13890:0:(genops.c:844:class_export_destroy()) destroying export ffff90a791d0e000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:00000080:2.0:1788574440.782164:0:13890:0:(genops.c:844:class_export_destroy()) destroying export ffff90a791da7000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:2.0:1788574440.782169:0:13890:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff90a791da2800 for lustre-OST0000-osc-MDT0000 00000020:00000080:2.0:1788574440.782183:0:13890:0:(genops.c:885:class_export_put()) final put ffff90a791da1800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1788574440.782185:0:13890:0:(genops.c:844:class_export_destroy()) destroying export ffff90a791da1800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:01000000:2.0:1788574440.782188:0:13890:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1788574440.782489:0:17489:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x10531a153b53694f 00000020:00000080:0.0:1788574440.782496:0:17489:0:(genops.c:885:class_export_put()) final put ffff90a7bb2d7000/lustre-MDD0000_UUID 00000020:01000000:0.0:1788574440.782514:0:17489:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDD0000 (flags='') 00000020:00000080:0.0:1788574440.782518:0:17489:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788574440.782523:0:17489:0:(obd_config.c:956:class_cleanup()) lustre-MDD0000: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1788574440.782527:0:17489:0:(genops.c:1558:class_disconnect_exports()) OBD device 6 (ffff90a79328cd40) has no exports 00000020:00000080:0.0:1788574440.782545:0:17489:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788574440.782549:0:17489:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000020:00000080:0.0:1788574440.782561:0:17489:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x10531a153b536956 00000020:00000080:0.0:1788574440.782565:0:17489:0:(genops.c:885:class_export_put()) final put ffff90a7bb2d6000/lustre-MDT0000-osd_UUID 00000020:01000004:0.0:1788574440.782573:0:17489:0:(tgt_mount.c:187:server_put_mount()) put mount ffff90a78528f000 from lustre-MDT0000, refs=3 00000020:01000004:0.0:1788574440.782575:0:17489:0:(obd_mount.c:710:lustre_put_lsi()) put ffff90a78528f000 3 00000020:01000004:0.0:1788574440.782578:0:17489:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff90a78528f000 from lustre-MDT0000 00000020:00000080:0.0:1788574440.782596:0:17489:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788574440.782600:0:17489:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:00000080:0.0:1788574440.782603:0:17489:0:(genops.c:885:class_export_put()) final put ffff90a792314800/lustre-MDT0000_UUID 00000020:00000080:0.0:1788574440.782604:0:17489:0:(genops.c:844:class_export_destroy()) destroying export ffff90a792314800/lustre-MDT0000_UUID for lustre-MDT0000 00000020:01000000:0.0:1788574440.782614:0:17489:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000 (lustre-MDT0000_UUID) 00000020:01000004:0.0:1788574440.782639:0:17489:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 2 references. 00000020:01000004:0.0:1788574440.782653:0:17489:0:(tgt_mount.c:255:server_stop_mgs()) Stop MGS service MGS 00000020:01000000:0.0:1788574440.782656:0:17489:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGS (flags='F') 00000020:00000080:0.0:1788574440.782659:0:17489:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788574440.782661:0:17489:0:(obd_config.c:956:class_cleanup()) MGS: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1788574440.782668:0:17489:0:(genops.c:1819:print_export_data()) MGS: ACTIVE ffff90a7a752c000 3cd60e94-2a59-4e1b-b761-ea9d2ceff3ab 0@lo 13 (0 0 8) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1788574440.782673:0:17489:0:(genops.c:1553:class_disconnect_exports()) OBD device 1 (ffff90a7924b99c0) has exports, disconnecting them 00000020:00080000:0.0:1788574440.782678:0:17489:0:(genops.c:1528:class_disconnect_export_list()) MGS: disconnecting export at 0@lo (ffff90a7a752c000), last request at 1788574343 00000020:00000080:0.0:1788574440.782695:0:17489:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x10531a153b5368fb 00000020:00010000:0.0:1788574440.782698:0:17489:0:(genops.c:1921:obd_stale_export_put()) Put export ffff90a7a752c000: total 2 00000100:00080000:0.0:1788574440.782702:0:17489:0:(import.c:65:import_set_state_nolock()) ffff90a7a7528000 : changing import state from FULL to CLOSED 00000020:00080000:0.0:1788574440.782722:0:17489:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff90a7a752c000): rc 0 00000020:00080000:0.0:1788574440.782726:0:17489:0:(genops.c:1558:class_disconnect_exports()) OBD device 1 (ffff90a7924b99c0) has no exports 00000020:00010000:1.0:1788574440.782911:0:14332:0:(genops.c:1907:obd_stale_export_get()) Get export ffff90a7a752c000: total 2 00010000:00010000:1.0:1788574440.782916:0:14332:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788574440.782947:0:14332:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff90a7a752c000, canceled 0 locks, left on hash table 8. 00010000:00010000:1.0:1788574440.782979:0:14332:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90a7829d6000/0x10531a153b536b63 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x10531a153b536b5c expref: 9 pid: 14339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574440.782995:0:14332:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90a7bfb08200/0x10531a153b536a21 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x10531a153b536a1a expref: 8 pid: 14337 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574440.783009:0:14332:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90a7bfa4d400/0x10531a153b536b8d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x10531a153b536b86 expref: 7 pid: 14338 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574440.783019:0:14332:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90a7829d7e00/0x10531a153b536a2f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x10531a153b536a28 expref: 6 pid: 14338 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574440.783029:0:14332:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90a7bfb09600/0x10531a153b536a59 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x10531a153b536a52 expref: 5 pid: 14338 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574440.783048:0:14332:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90a7c2158200/0x10531a153b536909 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x10531a153b536902 expref: 4 pid: 14338 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574440.783062:0:14332:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90a68116a200/0x10531a153b536d23 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x10531a153b536d1c expref: 3 pid: 14338 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574440.783071:0:14332:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90a790a21200/0x10531a153b536d15 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x10531a153b536d0e expref: 2 pid: 14337 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574440.783081:0:14332:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff90a7a752c000, canceled 8 locks, left on hash table 0. 00000020:00000080:1.0:1788574440.783093:0:14332:0:(genops.c:885:class_export_put()) final put ffff90a7a752c000/3cd60e94-2a59-4e1b-b761-ea9d2ceff3ab 00010000:00010000:1.0:1788574440.783099:0:14332:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788574440.783100:0:14332:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788574440.783102:0:14332:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1788574440.783597:0:13890:0:(genops.c:844:class_export_destroy()) destroying export ffff90a7bb2d7000/lustre-MDD0000_UUID for lustre-MDD0000 00000020:00000080:1.0:1788574440.783603:0:13890:0:(genops.c:885:class_export_put()) final put ffff90a7bb2d0800/lustre-MDD0000_UUID 00000020:00000080:1.0:1788574440.783605:0:13890:0:(genops.c:844:class_export_destroy()) destroying export ffff90a7bb2d0800/lustre-MDD0000_UUID for lustre-MDD0000 00000020:01000000:1.0:1788574440.783613:0:13890:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0000 (lustre-MDD0000_UUID) 00000020:00000080:1.0:1788574440.783737:0:13890:0:(genops.c:844:class_export_destroy()) destroying export ffff90a7bb2d6000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1788574440.783741:0:13890:0:(genops.c:844:class_export_destroy()) destroying export ffff90a7a752c000/3cd60e94-2a59-4e1b-b761-ea9d2ceff3ab for MGS 00000020:00000080:1.0:1788574440.783760:0:13890:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff90a7a7528000 for MGS 00000100:00100000:3.0:1788574440.783848:0:14338:0:(service.c:3183:ptlrpc_main()) ll_mgs_0001: service thread [ffff90a7a0258600:14338] 1 exiting: rc = 0 00000100:00100000:3.0:1788574440.784024:0:14337:0:(service.c:3183:ptlrpc_main()) ll_mgs_0000: service thread [ffff90a79e7bf200:14337] 0 exiting: rc = 1 00000100:00100000:0.0:1788574440.784792:0:14339:0:(service.c:3183:ptlrpc_main()) ll_mgs_0002: service thread [ffff90a7a0259800:14339] 2 exiting: rc = 0 00000100:00100000:2.0:1788574440.786222:0:17489:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788574440.786235:0:17489:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788574440.786243:0:17489:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788574440.786267:0:17489:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788574440.786273:0:17489:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788574440.786279:0:17489:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788574440.786286:0:17489:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788574440.786293:0:17489:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788574440.786300:0:17489:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788574440.786320:0:17489:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788574440.786327:0:17489:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788574440.786333:0:17489:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788574440.786340:0:17489:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788574440.786347:0:17489:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788574440.786354:0:17489:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788574440.786360:0:17489:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788574440.786427:0:17489:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788574440.786433:0:17489:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788574440.786439:0:17489:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788574440.786443:0:17489:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788574440.786449:0:17489:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788574440.786454:0:17489:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788574440.786459:0:17489:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788574440.786465:0:17489:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788574440.786471:0:17489:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788574440.786477:0:17489:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788574440.786483:0:17489:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788574440.786489:0:17489:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788574440.786494:0:17489:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788574440.786498:0:17489:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788574440.786505:0:17489:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788574440.786511:0:17489:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788574440.786516:0:17489:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788574440.786524:0:17489:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788574440.786529:0:17489:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788574440.786534:0:17489:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788574440.786539:0:17489:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788574440.786543:0:17489:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788574440.786556:0:17489:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788574440.786560:0:17489:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788574440.786565:0:17489:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788574440.786570:0:17489:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788574440.786576:0:17489:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788574440.786581:0:17489:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788574440.786586:0:17489:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788574440.786592:0:17489:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788574440.786598:0:17489:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788574440.786604:0:17489:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788574440.786611:0:17489:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788574440.786616:0:17489:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788574440.786621:0:17489:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788574440.786627:0:17489:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788574440.786632:0:17489:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788574440.786637:0:17489:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788574440.786655:0:17489:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788574440.786660:0:17489:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788574440.786665:0:17489:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788574440.786671:0:17489:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788574440.786677:0:17489:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788574440.786683:0:17489:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788574440.786689:0:17489:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788574440.786695:0:17489:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788574440.786701:0:17489:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788574440.786707:0:17489:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 20000000:01000000:2.0:1788574440.787140:0:17489:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:2.0:1788574440.787144:0:17489:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 00000020:01000000:2.0:1788574440.788750:0:17489:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff90a79220f8a0 - data ffff90a792afd798/ffff90a681181000 00000020:01000000:2.0:1788574440.788859:0:17489:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff90a7922f4600 - data ffff90a792a771b0/ffff90a7bfb24800 00000020:00000080:2.0:1788574440.790021:0:17489:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x10531a153b5368df 00000020:00000080:2.0:1788574440.790032:0:17489:0:(genops.c:885:class_export_put()) final put ffff90a6823e0800/lustre-MDT0000-osd_UUID 00000020:01000004:2.0:1788574440.790108:0:17489:0:(tgt_mount.c:187:server_put_mount()) put mount ffff90a78528f000 from MGS, refs=2 00000020:01000004:2.0:1788574440.790112:0:17489:0:(obd_mount.c:710:lustre_put_lsi()) put ffff90a78528f000 2 00000020:01000004:2.0:1788574440.790130:0:17489:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff90a78528f000 from MGS 00000020:00000080:2.0:1788574440.790161:0:17489:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788574440.790169:0:17489:0:(obd_config.c:883:class_detach()) detach on obd MGS (uuid MGS) 00000020:00000080:2.0:1788574440.790450:0:17489:0:(genops.c:885:class_export_put()) final put ffff90a6823e7000/MGS 00000020:00000080:2.0:1788574440.790454:0:17489:0:(genops.c:844:class_export_destroy()) destroying export ffff90a6823e7000/MGS for MGS 00000020:01000000:2.0:1788574440.790461:0:17489:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGS (MGS) 00000020:01000000:2.0:1788574440.790525:0:17489:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0000 (flags='F') 00000020:00000080:2.0:1788574440.790529:0:17489:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788574440.790535:0:17489:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-MDT0000: forcing exports to disconnect: 1/3 00000020:00080000:2.0:1788574440.790544:0:17489:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-MDT0000: ACTIVE ffff90a785313000 lustre-MDT0000-lwp-MDT0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1788574440.790551:0:17489:0:(genops.c:1553:class_disconnect_exports()) OBD device 10 (ffff90a7924b8000) has exports, disconnecting them 00000020:00080000:2.0:1788574440.790558:0:17489:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0000: disconnecting export at 0@lo (ffff90a785313000), last request at 1788574344 00000020:00000080:2.0:1788574440.790563:0:17489:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x10531a153b5369cd 00000020:00080000:2.0:1788574440.790572:0:17489:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff90a785313000): rc 0 00000020:00000080:2.0:1788574440.790580:0:17489:0:(genops.c:885:class_export_put()) final put ffff90a785313000/lustre-MDT0000-lwp-MDT0000 00000020:00000080:0.0:1788574440.790998:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff90a6823e0800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:0.0:1788574440.791400:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff90a785313000/lustre-MDT0000-lwp-MDT0000 for lustre-MDT0000-lwp-MDT0000 00010000:01000000:2.0:1788574440.792507:0:17489:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0000: client import never connected 00000100:00080000:2.0:1788574440.792514:0:17489:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1788574440.792518:0:17489:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:2.0:1788574440.792524:0:17489:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1788574440.792745:0:17489:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788574440.792755:0:17489:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000020:01000004:2.0:1788574440.792761:0:17489:0:(obd_mount.c:710:lustre_put_lsi()) put ffff90a78528f000 1 00000020:00000080:2.0:1788574440.792768:0:17489:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x10531a153b5368d1 00000020:00000080:2.0:1788574440.792776:0:17489:0:(genops.c:885:class_export_put()) final put ffff90a6823e4800/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1788574440.793681:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff90a785314800 for lustre-MDT0000-lwp-MDT0000 00000020:00000080:0.0:1788574440.793693:0:8:0:(genops.c:885:class_export_put()) final put ffff90a785f00800/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:0.0:1788574440.793697:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff90a785f00800/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000-lwp-MDT0000 00000020:01000000:0.0:1788574440.793705:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0000 (lustre-MDT0000-lwp-MDT0000_UUID) 00000020:01000000:2.0:1788574440.794099:0:17489:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osd (flags='') 00000020:00000080:2.0:1788574440.794106:0:17489:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788574440.794124:0:17489:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-osd: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1788574440.794131:0:17489:0:(genops.c:1558:class_disconnect_exports()) OBD device 0 (ffff90a793288000) has no exports 00000020:00000080:0.0:1788574440.797723:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff90a6823e4800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1788574440.822021:0:17489:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788574440.822039:0:17489:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00000020:00000080:1.0:1788574440.822046:0:17489:0:(genops.c:885:class_export_put()) final put ffff90a78528d000/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1788574440.822051:0:17489:0:(genops.c:844:class_export_destroy()) destroying export ffff90a78528d000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:1.0:1788574440.822062:0:17489:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osd (lustre-MDT0000-osd_UUID) 00000020:01000004:1.0:1788574440.822227:0:17489:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff90a78528e000 00000020:01000000:1.0:1788574440.822248:0:17489:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MDS (flags='F') 00000020:00000080:1.0:1788574440.822261:0:17489:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788574440.822266:0:17489:0:(obd_config.c:956:class_cleanup()) MDS: forcing exports to disconnect: 0/1 00000020:00080000:1.0:1788574440.822270:0:17489:0:(genops.c:1558:class_disconnect_exports()) OBD device 3 (ffff90a7924bb380) has no exports 00000100:00100000:1.0:1788574440.822392:0:14345:0:(service.c:3183:ptlrpc_main()) mdt00_001: service thread [ffff90a7bb7e5e00:14345] 1 exiting: rc = 0 00000100:00100000:1.0:1788574440.822516:0:14346:0:(service.c:3183:ptlrpc_main()) mdt00_002: service thread [ffff90a68313f800:14346] 2 exiting: rc = 0 00000100:00100000:0.0:1788574440.827709:0:15051:0:(service.c:3183:ptlrpc_main()) mdt00_003: service thread [ffff90a79220da00:15051] 3 exiting: rc = 0 00000100:00100000:3.0:1788574440.828037:0:14344:0:(service.c:3183:ptlrpc_main()) mdt00_000: service thread [ffff90a7bb7e5400:14344] 0 exiting: rc = 1 00000100:00100000:1.0:1788574440.828873:0:17489:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574440.828987:0:17489:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574440.828994:0:17489:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574440.829006:0:17489:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574440.829012:0:17489:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574440.829019:0:17489:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574440.829025:0:17489:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574440.829031:0:17489:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574440.829037:0:17489:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574440.829042:0:17489:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574440.829048:0:17489:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574440.829053:0:17489:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574440.829059:0:17489:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574440.829064:0:17489:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574440.829069:0:17489:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574440.829075:0:17489:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574440.829080:0:17489:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574440.829085:0:17489:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574440.829091:0:17489:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574440.829097:0:17489:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574440.829105:0:17489:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574440.829111:0:17489:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574440.829230:0:17489:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574440.829237:0:17489:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574440.829243:0:17489:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574440.829249:0:17489:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574440.829255:0:17489:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574440.829261:0:17489:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574440.829267:0:17489:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574440.829272:0:17489:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574440.829289:0:17489:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574440.829294:0:17489:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574440.829300:0:17489:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574440.829305:0:17489:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574440.829523:0:17489:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574440.829530:0:17489:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574440.829536:0:17489:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574440.829542:0:17489:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574440.829548:0:17489:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574440.829554:0:17489:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574440.829560:0:17489:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574440.829566:0:17489:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574440.829573:0:17489:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574440.829578:0:17489:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574440.829583:0:17489:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574440.829589:0:17489:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574440.829594:0:17489:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574440.829600:0:17489:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574440.829606:0:17489:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574440.829611:0:17489:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574440.829617:0:17489:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574440.829623:0:17489:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574440.829629:0:17489:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574440.829634:0:17489:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574440.829651:0:17489:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574440.829657:0:17489:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574440.829663:0:17489:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574440.829669:0:17489:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574440.829676:0:17489:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574440.829682:0:17489:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574440.829689:0:17489:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574440.829695:0:17489:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574440.829701:0:17489:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574440.829707:0:17489:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788574440.840798:0:14348:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_001: service thread [ffff90a79ea12200:14348] 1 exiting: rc = 0 00000100:00100000:3.0:1788574440.841689:0:14347:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_000: service thread [ffff90a78691b600:14347] 0 exiting: rc = 1 00000100:00100000:1.0:1788574440.841988:0:17489:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574440.842012:0:17489:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574440.842019:0:17489:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574440.842024:0:17489:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574440.842029:0:17489:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574440.842034:0:17489:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574440.842040:0:17489:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574440.842046:0:17489:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574440.842052:0:17489:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574440.842058:0:17489:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574440.842064:0:17489:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574440.842070:0:17489:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574440.842075:0:17489:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574440.842080:0:17489:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574440.842086:0:17489:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574440.842091:0:17489:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574440.842096:0:17489:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574440.842101:0:17489:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574440.842108:0:17489:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574440.842126:0:17489:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574440.842133:0:17489:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574440.842139:0:17489:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574440.842144:0:17489:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574440.842150:0:17489:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574440.842155:0:17489:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574440.842160:0:17489:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574440.842167:0:17489:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574440.842180:0:17489:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574440.842186:0:17489:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574440.842192:0:17489:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574440.842197:0:17489:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574440.842201:0:17489:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574440.842207:0:17489:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574440.842211:0:17489:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574440.842215:0:17489:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574440.842220:0:17489:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574440.842232:0:17489:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574440.842238:0:17489:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574440.842243:0:17489:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574440.842249:0:17489:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574440.842254:0:17489:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574440.842259:0:17489:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574440.842268:0:17489:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574440.842272:0:17489:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574440.842277:0:17489:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574440.842282:0:17489:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574440.842287:0:17489:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574440.842292:0:17489:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574440.842298:0:17489:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574440.842302:0:17489:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574440.842308:0:17489:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574440.842313:0:17489:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574440.842318:0:17489:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574440.842322:0:17489:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574440.842561:0:17489:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574440.842567:0:17489:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574440.842572:0:17489:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574440.842577:0:17489:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574440.842583:0:17489:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574440.842588:0:17489:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574440.842595:0:17489:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574440.842600:0:17489:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574440.842606:0:17489:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574440.842612:0:17489:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574440.843935:0:14350:0:(service.c:3183:ptlrpc_main()) mdt_out00_001: service thread [ffff90a793358200:14350] 1 exiting: rc = 0 00000100:00100000:2.0:1788574440.845924:0:14349:0:(service.c:3183:ptlrpc_main()) mdt_out00_000: service thread [ffff90a7a73ea000:14349] 0 exiting: rc = 1 00000100:00100000:1.0:1788574440.846591:0:17489:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574440.846601:0:17489:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574440.846611:0:17489:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574440.846618:0:17489:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574440.846624:0:17489:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574440.846631:0:17489:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574440.846636:0:17489:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574440.846668:0:17489:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574440.846690:0:17489:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574440.846697:0:17489:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574440.846704:0:17489:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574440.846710:0:17489:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574440.846716:0:17489:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574440.846723:0:17489:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574440.846728:0:17489:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574440.846735:0:17489:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574440.846741:0:17489:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574440.846747:0:17489:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574440.846753:0:17489:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574440.846759:0:17489:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574440.846780:0:17489:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574440.846788:0:17489:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574440.846793:0:17489:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574440.846799:0:17489:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574440.846805:0:17489:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574440.846811:0:17489:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574440.846819:0:17489:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574440.846828:0:17489:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574440.846833:0:17489:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574440.846838:0:17489:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574440.846844:0:17489:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574440.846852:0:17489:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574440.846870:0:17489:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574440.846887:0:17489:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574440.846894:0:17489:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574440.846901:0:17489:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574440.846907:0:17489:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574440.846912:0:17489:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574440.846919:0:17489:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574440.846924:0:17489:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574440.846930:0:17489:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574440.846935:0:17489:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574440.846948:0:17489:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574440.846954:0:17489:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574440.846974:0:17489:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574440.846982:0:17489:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574440.846991:0:17489:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574440.847000:0:17489:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574440.847006:0:17489:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574440.847013:0:17489:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574440.847018:0:17489:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574440.847024:0:17489:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574440.847032:0:17489:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574440.847038:0:17489:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574440.847044:0:17489:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574440.847050:0:17489:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574440.847070:0:17489:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574440.847077:0:17489:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574440.847083:0:17489:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574440.847089:0:17489:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574440.847095:0:17489:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574440.847101:0:17489:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574440.847107:0:17489:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574440.847122:0:17489:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574440.866269:0:14352:0:(service.c:3183:ptlrpc_main()) mdt_seqs_0001: service thread [ffff90a793358c00:14352] 1 exiting: rc = 0 00000100:00100000:0.0:1788574440.866495:0:14351:0:(service.c:3183:ptlrpc_main()) mdt_seqs_0000: service thread [ffff90a793358800:14351] 0 exiting: rc = 1 00000100:00100000:1.0:1788574440.866871:0:17489:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574440.866890:0:17489:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574440.866896:0:17489:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574440.866903:0:17489:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574440.866908:0:17489:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574440.866913:0:17489:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574440.866918:0:17489:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574440.866923:0:17489:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574440.866928:0:17489:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574440.866935:0:17489:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574440.866942:0:17489:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574440.866948:0:17489:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574440.866974:0:17489:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574440.866981:0:17489:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574440.866996:0:17489:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574440.867003:0:17489:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574440.867008:0:17489:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574440.867013:0:17489:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574440.867019:0:17489:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574440.867024:0:17489:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574440.867030:0:17489:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574440.867035:0:17489:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574440.867041:0:17489:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574440.867047:0:17489:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574440.867052:0:17489:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574440.867057:0:17489:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574440.867065:0:17489:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574440.867070:0:17489:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574440.867076:0:17489:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574440.867081:0:17489:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574440.867086:0:17489:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574440.867092:0:17489:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574440.867098:0:17489:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574440.867102:0:17489:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574440.867107:0:17489:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574440.867113:0:17489:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574440.867118:0:17489:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574440.867123:0:17489:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574440.867129:0:17489:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574440.867135:0:17489:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574440.867141:0:17489:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574440.867146:0:17489:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574440.867154:0:17489:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574440.867160:0:17489:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574440.867166:0:17489:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574440.867570:0:17489:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574440.867577:0:17489:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574440.867590:0:17489:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574440.867595:0:17489:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574440.867600:0:17489:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574440.867605:0:17489:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574440.867609:0:17489:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574440.867614:0:17489:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574440.867619:0:17489:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574440.867625:0:17489:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574440.867630:0:17489:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574440.867636:0:17489:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574440.867653:0:17489:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574440.867659:0:17489:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574440.867664:0:17489:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574440.867669:0:17489:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574440.867673:0:17489:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574440.867679:0:17489:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574440.867684:0:17489:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574440.868867:0:14354:0:(service.c:3183:ptlrpc_main()) mdt_seqm_0001: service thread [ffff90a7922f2c00:14354] 1 exiting: rc = 0 00000100:00100000:1.0:1788574440.869161:0:14353:0:(service.c:3183:ptlrpc_main()) mdt_seqm_0000: service thread [ffff90a7922f3400:14353] 0 exiting: rc = 1 00000100:00100000:1.0:1788574440.869239:0:17489:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574440.869246:0:17489:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574440.869251:0:17489:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574440.869256:0:17489:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574440.869261:0:17489:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574440.869266:0:17489:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574440.869272:0:17489:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574440.869277:0:17489:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574440.869283:0:17489:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574440.869287:0:17489:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574440.869293:0:17489:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574440.869297:0:17489:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574440.869302:0:17489:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574440.869320:0:17489:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574440.869326:0:17489:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574440.869331:0:17489:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574440.869337:0:17489:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574440.869353:0:17489:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574440.869358:0:17489:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574440.869363:0:17489:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574440.869390:0:17489:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574440.869395:0:17489:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574440.869400:0:17489:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574440.869404:0:17489:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574440.869409:0:17489:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574440.869414:0:17489:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574440.869419:0:17489:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574440.869424:0:17489:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574440.869429:0:17489:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574440.869434:0:17489:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574440.869439:0:17489:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574440.869443:0:17489:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574440.869447:0:17489:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574440.869452:0:17489:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574440.869456:0:17489:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574440.869461:0:17489:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574440.869466:0:17489:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574440.869470:0:17489:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574440.869476:0:17489:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574440.869481:0:17489:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574440.869486:0:17489:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574440.869492:0:17489:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574440.869497:0:17489:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574440.869502:0:17489:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574440.869507:0:17489:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574440.869513:0:17489:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574440.869518:0:17489:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574440.869523:0:17489:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574440.869528:0:17489:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574440.869533:0:17489:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574440.869538:0:17489:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574440.869542:0:17489:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574440.869566:0:17489:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574440.869571:0:17489:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574440.869575:0:17489:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574440.869580:0:17489:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574440.869585:0:17489:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574440.869590:0:17489:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574440.869595:0:17489:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574440.869600:0:17489:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574440.869605:0:17489:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574440.869610:0:17489:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574440.869615:0:17489:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574440.869620:0:17489:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574440.869967:0:14355:0:(service.c:3183:ptlrpc_main()) mdt_fld_0000: service thread [ffff90a791ceea00:14355] 0 exiting: rc = 1 00000100:00100000:0.0:1788574440.870094:0:14356:0:(service.c:3183:ptlrpc_main()) mdt_fld_0001: service thread [ffff90a793358000:14356] 1 exiting: rc = 0 00000100:00100000:1.0:1788574440.870246:0:17489:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574440.870252:0:17489:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574440.870257:0:17489:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574440.870262:0:17489:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574440.870267:0:17489:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574440.870273:0:17489:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574440.870277:0:17489:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574440.870282:0:17489:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574440.870287:0:17489:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574440.870292:0:17489:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574440.870297:0:17489:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574440.870301:0:17489:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574440.870306:0:17489:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574440.870311:0:17489:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574440.870317:0:17489:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574440.870324:0:17489:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574440.870330:0:17489:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574440.870335:0:17489:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574440.870340:0:17489:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574440.870345:0:17489:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574440.870351:0:17489:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574440.870357:0:17489:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574440.870438:0:17489:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574440.870444:0:17489:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574440.870449:0:17489:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574440.870455:0:17489:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574440.870461:0:17489:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574440.870465:0:17489:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574440.870470:0:17489:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574440.870476:0:17489:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574440.870481:0:17489:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574440.870486:0:17489:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574440.870491:0:17489:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574440.870497:0:17489:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574440.870502:0:17489:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574440.870507:0:17489:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574440.870512:0:17489:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574440.870517:0:17489:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574440.870522:0:17489:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574440.870527:0:17489:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574440.870532:0:17489:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574440.870537:0:17489:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574440.870543:0:17489:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574440.870549:0:17489:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574440.870553:0:17489:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574440.870559:0:17489:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574440.870564:0:17489:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574440.870569:0:17489:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574440.870574:0:17489:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574440.870579:0:17489:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574440.870584:0:17489:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574440.870590:0:17489:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574440.870595:0:17489:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574440.870601:0:17489:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574440.870607:0:17489:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574440.870613:0:17489:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574440.870618:0:17489:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574440.870633:0:17489:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574440.870650:0:17489:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574440.870658:0:17489:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574440.870665:0:17489:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574440.870671:0:17489:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574440.870677:0:17489:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574440.870683:0:17489:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574440.871454:0:14357:0:(service.c:3183:ptlrpc_main()) mdt_io00_000: service thread [ffff90a793358a00:14357] 0 exiting: rc = 1 00000100:00100000:1.0:1788574440.871812:0:14359:0:(service.c:3183:ptlrpc_main()) mdt_io00_002: service thread [ffff90a785146400:14359] 2 exiting: rc = 0 00000100:00100000:3.0:1788574440.872250:0:14358:0:(service.c:3183:ptlrpc_main()) mdt_io00_001: service thread [ffff90a791006e00:14358] 1 exiting: rc = 0 00000100:00100000:0.0:1788574440.873504:0:17489:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574440.873512:0:17489:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574440.873518:0:17489:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574440.873523:0:17489:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574440.873529:0:17489:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574440.873535:0:17489:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574440.873541:0:17489:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574440.873547:0:17489:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574440.873553:0:17489:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574440.873559:0:17489:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574440.873564:0:17489:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574440.873570:0:17489:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574440.873575:0:17489:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574440.873581:0:17489:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574440.873587:0:17489:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574440.873593:0:17489:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574440.873618:0:17489:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574440.873626:0:17489:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574440.873632:0:17489:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574440.873649:0:17489:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574440.873657:0:17489:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574440.873664:0:17489:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574440.873670:0:17489:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574440.873676:0:17489:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574440.873684:0:17489:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574440.873690:0:17489:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574440.873711:0:17489:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574440.873716:0:17489:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574440.873722:0:17489:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574440.873727:0:17489:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574440.873733:0:17489:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574440.873739:0:17489:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574440.873745:0:17489:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574440.873753:0:17489:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574440.873759:0:17489:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574440.873765:0:17489:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574440.873771:0:17489:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574440.873777:0:17489:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574440.873784:0:17489:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574440.873789:0:17489:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574440.873809:0:17489:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574440.873816:0:17489:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574440.873822:0:17489:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574440.873828:0:17489:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574440.873834:0:17489:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574440.873840:0:17489:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574440.873846:0:17489:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574440.873853:0:17489:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574440.873859:0:17489:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574440.873864:0:17489:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574440.873870:0:17489:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574440.873876:0:17489:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574440.873896:0:17489:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574440.873902:0:17489:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574440.873908:0:17489:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574440.873914:0:17489:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574440.873921:0:17489:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574440.873927:0:17489:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574440.873933:0:17489:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574440.873948:0:17489:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574440.873956:0:17489:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574440.873970:0:17489:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574440.873977:0:17489:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574440.873984:0:17489:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:1.0:1788574440.883860:0:17489:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788574440.883878:0:17489:0:(obd_config.c:883:class_detach()) detach on obd MDS (uuid MDS_uuid) 00000020:00000080:1.0:1788574440.883887:0:17489:0:(genops.c:885:class_export_put()) final put ffff90a7bc13f800/MDS_uuid 00000020:00000080:1.0:1788574440.883893:0:17489:0:(genops.c:844:class_export_destroy()) destroying export ffff90a7bc13f800/MDS_uuid for MDS 00000020:01000000:1.0:1788574440.883901:0:17489:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MDS (MDS_uuid) 00000020:02000400:1.0:1788574440.884045:0:17489:0:(tgt_mount.c:2184:server_put_super()) server umount lustre-MDT0000 complete 00000001:00100000:1.0:1788574441.168393:0:7676:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1788574441.168403:0:7676:0:(genops.c:885:class_export_put()) final put ffff90a682204800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1788574441.170523:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff90a682204800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001 00000020:00000080:2.0:1788574441.170619:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff90a682205000 for lustre-OST0001 00010000:00010000:3.0:1788574441.218776:0:14333:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788574442.245654:0:15396:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1788574443.191198:0:6739:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1788574443.191211:0:6739:0:(genops.c:885:class_export_put()) final put ffff90a6811b5000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1788574443.191243:0:489:0:(genops.c:844:class_export_destroy()) destroying export ffff90a6811b5000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000 00000020:00000080:0.0:1788574443.191477:0:489:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff90a6811b1800 for lustre-OST0000 00010000:00010000:1.0:1788574443.291555:0:14332:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788574444.288724:0:14333:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1788574444.586795:0:17641:0:(tgt_mount.c:2195:server_umount_begin()) umount -f 00000020:01000004:2.0:1788574444.603503:0:17641:0:(tgt_mount.c:2065:server_put_super()) server put_super lustre-OST0000 00010000:00010000:2.0:1788574444.603553:0:17641:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.157@tcp lock: ffff90a7bfb09e00/0x10531a153b536a52 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x10531a153b536a59 expref: -99 pid: 15026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574444.603568:0:17641:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.157@tcp lock: ffff90a7bfb09e00/0x10531a153b536a52 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x10531a153b536a59 expref: -99 pid: 15026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574444.603587:0:17641:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.157@tcp lock: ffff90a7bfb09e00/0x10531a153b536a52 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0x10531a153b536a59 expref: -99 pid: 15026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574444.603596:0:17641:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.157@tcp lock: ffff90a7bfb09e00/0x10531a153b536a52 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0x10531a153b536a59 expref: -99 pid: 15026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574444.603620:0:17641:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1788574444.603626:0:17641:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:2.0:1788574444.603650:0:17641:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1788574444.603654:0:17641:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 3 00000100:00080000:2.0:1788574444.603660:0:17641:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00080000:2.0:1788574444.603685:0:17641:0:(import.c:65:import_set_state_nolock()) ffff90a7bb2e8000 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00010000:00010000:1.0:1788574444.603741:0:15396:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788574444.603749:0:15396:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.157@tcp lock: ffff90a7bfb09e00/0x10531a153b536a52 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0x10531a153b536a59 expref: -99 pid: 15026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574444.603757:0:15396:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a7bfb09e00 already unused, calling callback (ffffffffc1bbcc20) 10000000:00010000:1.0:1788574444.603761:0:15396:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.157@tcp lock: ffff90a7bfb09e00/0x10531a153b536a52 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0x10531a153b536a59 expref: -99 pid: 15026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574444.603771:0:15396:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.157@tcp lock: ffff90a7bfb09e00/0x10531a153b536a52 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1008400000000 nid: local remote: 0x10531a153b536a59 expref: -99 pid: 15026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788574444.603779:0:15396:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.157@tcp lock: ffff90a7bfb09e00/0x10531a153b536a52 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1009400000000 nid: local remote: 0x10531a153b536a59 expref: -99 pid: 15026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788574444.603785:0:15396:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1788574444.603800:0:15396:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:1.0:1788574444.603803:0:15396:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:1.0:1788574444.603828:0:15396:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.157@tcp lock: ffff90a7bfb09e00/0x10531a153b536a52 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0x10531a153b536a59 expref: -99 pid: 15026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574444.603835:0:15396:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788574444.603861:0:15396:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.157@tcp lock: ffff90a7bfb09e00/0x10531a153b536a52 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0x10531a153b536a59 expref: -99 pid: 15026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574444.603870:0:15396:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.157@tcp lock: ffff90a7bfb09e00/0x10531a153b536a52 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0x10531a153b536a59 expref: -99 pid: 15026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574444.603882:0:15396:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788574444.603884:0:15396:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788574444.603886:0:15396:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788574444.603893:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788574444.603909:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a7a72b9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:3cd60e94-2a59-4e1b-b761-ea9d2ceff3ab:3312:1875455747675392:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788574444.603973:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788574444.604032:0:14331:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747675392 00000100:00100000:1.0:1788574444.604038:0:14331:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747675392 00000100:00100000:1.0:1788574444.604075:0:14331:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1788574444.604082:0:14331:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7a72b8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0+-99:3312:x1875455747675392:12345-0@lo:103:ldlm_bl.0 00010000:00020000:1.0:1788574444.604089:0:14331:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788574444 with bad export cookie 1176312606165788923 00000100:00100000:3.0:1788574444.609325:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a7bb28b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3311:1875455747675264:0@lo:39:umount.0 00000400:00000100:3.0:1788574444.609428:0:3311:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875455747675264 offset 0 length 224: 4 00000100:00100000:1.0:1788574444.616907:0:14331:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7a72b8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0+-99:3312:x1875455747675392:12345-0@lo:103:ldlm_bl.0 Request processed in 12813us (12922us total) trans 0 rc -107/-107 00000100:00100000:1.0:1788574444.616926:0:14331:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00080000:1.0:1788574444.616992:0:3312:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.201.157@tcp of MGS@0@lo abruptly disconnected: reconnecting 00000100:00080000:1.0:1788574444.616998:0:3312:0:(import.c:65:import_set_state_nolock()) ffff90a7bc13e800 MGS: changing import state from FULL to DISCONN 00000100:02020000:1.0:1788574444.617002:0:3312:0:(import.c:186:ptlrpc_set_import_discon()) MGC192.168.201.157@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail 00000100:00080000:1.0:1788574444.629007:0:3312:0:(import.c:192:ptlrpc_set_import_discon()) import MGS@0@lo for MGC192.168.201.157@tcp not replayable, auto-deactivating 00000100:00080000:1.0:1788574444.629014:0:3312:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:1.0:1788574444.629027:0:3312:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff90a7a72b9c00 x1875455747675392/t0(0) o103->MGC192.168.201.157@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1788574460 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 10000000:01000000:1.0:1788574444.629044:0:3312:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:1.0:1788574444.629047:0:3312:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:1.0:1788574444.629048:0:3312:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:1.0:1788574444.629053:0:3312:0:(import.c:65:import_set_state_nolock()) ffff90a7bc13e800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788574444.629059:0:3312:0:(import.c:545:import_select_connection()) MGC192.168.201.157@tcp: connect to NID 0@lo last attempt 469 00000100:00080000:1.0:1788574444.629069:0:3312:0:(import.c:665:import_select_connection()) MGC192.168.201.157@tcp: import ffff90a7bc13e800 using connection 192.168.201.157@tcp/0@lo 00000100:00100000:1.0:1788574444.629101:0:3312:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff90a7a72bb100 x1875455747675520/t0(0) o250->MGC192.168.201.157@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788574444.629153:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a7a72b9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:3cd60e94-2a59-4e1b-b761-ea9d2ceff3ab:3312:1875455747675392:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788574444.629310:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a7a72bb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:3cd60e94-2a59-4e1b-b761-ea9d2ceff3ab:3311:1875455747675520:0@lo:250:ptlrpcd_00_00.0 00000400:00000100:3.0:1788574444.629362:0:3311:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1875455747675520 offset 0 length 520: 4 00000100:00100000:3.0:1788574444.672931:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788574444.677233:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a7bb28aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3315:1875455747675648:0@lo:400:kworker.0 00000400:00000100:3.0:1788574444.677950:0:3315:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875455747675648 offset 0 length 224: 4 00010000:00010000:1.0:1788574445.316638:0:14332:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788574446.339955:0:14333:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788574447.360633:0:15396:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788574448.384828:0:14332:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788574449.408592:0:14333:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1788574449.792607:0:13890:0:(pinger.c:229:ptlrpc_pinger_process_import()) 3cd60e94-2a59-4e1b-b761-ea9d2ceff3ab->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788574449.792617:0:13890:0:(pinger.c:247:ptlrpc_pinger_process_import()) 3cd60e94-2a59-4e1b-b761-ea9d2ceff3ab->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1788574449.792721:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788574449.798660:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a7bb289f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3314:1875455747675776:0@lo:400:kworker.0 00000400:00000100:1.0:1788574449.798738:0:3314:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875455747675776 offset 0 length 224: 4 00010000:00010000:1.0:1788574450.432760:0:15396:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788574451.456841:0:14332:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788574452.480535:0:14333:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788574453.505269:0:15396:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788574454.532122:0:14332:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788574454.912568:0:3311:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788574444/real 1788574444] req@ffff90a7a72bb100 x1875455747675520/t0(0) o250->MGC192.168.201.157@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1788574454 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'ptlrpcd_00_00.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788574454.912598:0:3311:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff90a7a72bb100 x1875455747675520/t0(0) o250->MGC192.168.201.157@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1788574454 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'ptlrpcd_00_00.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788574454.912606:0:3311:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788574444/real 1788574444] req@ffff90a7bb28b800 x1875455747675264/t0(0) o39->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1788574454 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788574454.912614:0:3311:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff90a7bb28b800 x1875455747675264/t0(0) o39->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1788574454 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788574454.912628:0:3311:0:(import.c:65:import_set_state_nolock()) ffff90a7bc13e800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788574454.912683:0:3311:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-110) 00000100:00100000:0.0:1788574454.912686:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a7a72bb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:3cd60e94-2a59-4e1b-b761-ea9d2ceff3ab:3311:1875455747675520:0@lo:250:ptlrpcd_00_00.0 00000100:00080000:0.0:1788574454.912690:0:3311:0:(import.c:65:import_set_state_nolock()) ffff90a7bb2e8000 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:0.0:1788574454.912748:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a7bb28b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3311:1875455747675264:0@lo:39:umount.0 00000100:00080000:0.0:1788574454.912786:0:13890:0:(pinger.c:229:ptlrpc_pinger_process_import()) 3cd60e94-2a59-4e1b-b761-ea9d2ceff3ab->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788574454.912789:0:13890:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:0.0:1788574454.912792:0:13890:0:(import.c:65:import_set_state_nolock()) ffff90a7bc13e800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788574454.912797:0:13890:0:(import.c:545:import_select_connection()) MGC192.168.201.157@tcp: connect to NID 0@lo last attempt 570 00000100:00080000:0.0:1788574454.912801:0:13890:0:(import.c:630:import_select_connection()) MGC192.168.201.157@tcp: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1788574454.912823:0:13890:0:(import.c:665:import_select_connection()) MGC192.168.201.157@tcp: import ffff90a7bc13e800 using connection 192.168.201.157@tcp/0@lo 00000100:00100000:0.0:1788574454.912848:0:13890:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff90a6839d1500 x1875455747675904/t0(0) o250->MGC192.168.201.157@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788574454.912929:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788574454.912941:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a6839d2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3313:1875455747676032:0@lo:400:kworker.0 00000100:00100000:3.0:1788574454.912943:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a6839d1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:3cd60e94-2a59-4e1b-b761-ea9d2ceff3ab:3311:1875455747675904:0@lo:250:kworker.0 00000400:00000100:3.0:1788574454.912986:0:3311:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1875455747675904 offset 0 length 520: 4 00000400:00000100:0.0:1788574454.912986:0:3313:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875455747676032 offset 0 length 224: 4 00000100:00080000:2.0:1788574454.913566:0:17641:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1788574454.913570:0:17641:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 4 00000100:00100000:2.0:1788574454.913574:0:17641:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:2.0:1788574454.915427:0:17641:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.157@tcp lock: ffff90a7c2159000/0x10531a153b536a28 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x10531a153b536a2f expref: -99 pid: 15026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574454.915852:0:17641:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.157@tcp lock: ffff90a7c2159000/0x10531a153b536a28 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x10531a153b536a2f expref: -99 pid: 15026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574454.915860:0:17641:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.157@tcp lock: ffff90a7c2159000/0x10531a153b536a28 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x10531a153b536a2f expref: -99 pid: 15026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574454.915867:0:17641:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.157@tcp lock: ffff90a7c2159000/0x10531a153b536a28 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x10531a153b536a2f expref: -99 pid: 15026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574454.915972:0:17641:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788574454.915982:0:17641:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.157@tcp lock: ffff90a790a20200/0x10531a153b536d1c lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x10531a153b536d23 expref: -99 pid: 14341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574454.915989:0:17641:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.157@tcp lock: ffff90a790a20200/0x10531a153b536d1c lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x10531a153b536d23 expref: -99 pid: 14341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574454.915995:0:17641:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.157@tcp lock: ffff90a790a20200/0x10531a153b536d1c lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x10531a153b536d23 expref: -99 pid: 14341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574454.916001:0:17641:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.157@tcp lock: ffff90a790a20200/0x10531a153b536d1c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x10531a153b536d23 expref: -99 pid: 14341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574454.920968:0:14333:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788574454.920990:0:14333:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.157@tcp lock: ffff90a7c2159000/0x10531a153b536a28 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x10531a153b536a2f expref: -99 pid: 15026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574454.921002:0:14333:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a7c2159000 already unused, calling callback (ffffffffc1bbcc20) 10000000:00010000:3.0:1788574454.921005:0:14333:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.157@tcp lock: ffff90a7c2159000/0x10531a153b536a28 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x10531a153b536a2f expref: -99 pid: 15026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574454.921014:0:14333:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.157@tcp lock: ffff90a7c2159000/0x10531a153b536a28 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0x10531a153b536a2f expref: -99 pid: 15026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788574454.921040:0:14333:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.157@tcp lock: ffff90a7c2159000/0x10531a153b536a28 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0x10531a153b536a2f expref: -99 pid: 15026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788574454.921044:0:14333:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1788574454.921046:0:14333:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0000: stopping, won't requeue 00010000:00010000:3.0:1788574454.921062:0:14333:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff90a7bc13e800 00010000:00010000:3.0:1788574454.921064:0:14333:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.157@tcp lock: ffff90a7c2159000/0x10531a153b536a28 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000000 nid: local remote: 0x10531a153b536a2f expref: -99 pid: 15026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574454.921068:0:14333:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.157@tcp lock: ffff90a7c2159000/0x10531a153b536a28 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000000 nid: local remote: 0x10531a153b536a2f expref: -99 pid: 15026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574454.921095:0:14333:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788574454.921098:0:14333:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.157@tcp lock: ffff90a790a20200/0x10531a153b536d1c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x10531a153b536d23 expref: -99 pid: 14341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574454.921102:0:14333:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a790a20200 already unused, calling callback (ffffffffc1bbcc20) 10000000:00010000:3.0:1788574454.921103:0:14333:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.157@tcp lock: ffff90a790a20200/0x10531a153b536d1c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x10531a153b536d23 expref: -99 pid: 14341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574454.921107:0:14333:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.157@tcp lock: ffff90a790a20200/0x10531a153b536d1c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x10531a153b536d23 expref: -99 pid: 14341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788574454.921110:0:14333:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.157@tcp lock: ffff90a790a20200/0x10531a153b536d1c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x10531a153b536d23 expref: -99 pid: 14341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788574454.921113:0:14333:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:3.0:1788574454.921114:0:14333:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 00010000:00010000:3.0:1788574454.921116:0:14333:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff90a7bc13e800 00010000:00010000:3.0:1788574454.921121:0:14333:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.157@tcp lock: ffff90a790a20200/0x10531a153b536d1c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x10531a153b536d23 expref: -99 pid: 14341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574454.921126:0:14333:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788574454.921127:0:14333:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788574454.921128:0:14333:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788574454.927184:0:17641:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1788574454.927204:0:17641:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.157@tcp lock: ffff90a790a20200/0x10531a153b536d1c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x10531a153b536d23 expref: -99 pid: 14341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788574454.927227:0:17641:0:(mgc_request.c:130:config_log_put()) dropping config log params 10000000:01000000:2.0:1788574454.927238:0:17641:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0000 10000000:01000000:2.0:1788574454.927239:0:17641:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0000 (0) 00000020:01000004:2.0:1788574454.927285:0:17641:0:(tgt_mount.c:2115:server_put_super()) stopping lustre-OST0000 00000020:01000000:2.0:1788574454.927289:0:17641:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000 (flags='F') 00000020:00000080:2.0:1788574454.927409:0:17641:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788574454.927418:0:17641:0:(obd_config.c:956:class_cleanup()) lustre-OST0000: forcing exports to disconnect: 0/1 00000020:00080000:2.0:1788574454.927422:0:17641:0:(genops.c:1558:class_disconnect_exports()) OBD device 13 (ffff90a791dccd40) has no exports 00000020:00080000:2.0:1788574454.927536:0:17641:0:(genops.c:1558:class_disconnect_exports()) OBD device 13 (ffff90a791dccd40) has no exports 00010000:00010000:1.0:1788574454.929616:0:15396:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:2.0:1788574454.929746:0:17641:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff90a7838d6900 - data ffff90a798ef36c0/ffff90a681393c00 00000020:01000000:2.0:1788574454.930213:0:17641:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff90a792627ae0 - data ffff90a792b16e58/ffff90a6812ecc00 00100000:10000000:2.0:1788574454.941837:0:17641:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0000-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:1.0:1788574454.963693:0:17641:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x10531a153b536a3d 00000020:00000080:1.0:1788574454.963703:0:17641:0:(genops.c:885:class_export_put()) final put ffff90a79924c800/lustre-OST0000-osd_UUID 00000020:01000004:1.0:1788574454.963775:0:17641:0:(tgt_mount.c:187:server_put_mount()) put mount ffff90a7bfbe1000 from lustre-OST0000, refs=2 00000020:01000004:1.0:1788574454.963778:0:17641:0:(obd_mount.c:710:lustre_put_lsi()) put ffff90a7bfbe1000 2 00000020:01000004:1.0:1788574454.963782:0:17641:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff90a7bfbe1000 from lustre-OST0000 00000020:00000080:1.0:1788574454.963820:0:17641:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788574454.963831:0:17641:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:00000080:1.0:1788574454.963835:0:17641:0:(genops.c:885:class_export_put()) final put ffff90a7bb2ef000/lustre-OST0000_UUID 00000020:00000080:1.0:1788574454.963837:0:17641:0:(genops.c:844:class_export_destroy()) destroying export ffff90a7bb2ef000/lustre-OST0000_UUID for lustre-OST0000 00000020:01000000:1.0:1788574454.963855:0:17641:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000 (lustre-OST0000_UUID) 00000020:01000004:1.0:1788574454.963896:0:17641:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 1 references. 00000020:01000000:1.0:1788574454.963900:0:17641:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0000 (flags='F') 00000020:00000080:1.0:1788574454.963904:0:17641:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788574454.963909:0:17641:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-OST0000: forcing exports to disconnect: 1/3 00000020:00080000:1.0:1788574454.963915:0:17641:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-OST0000: ACTIVE ffff90a6812cc000 lustre-MDT0000-lwp-OST0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1788574454.963921:0:17641:0:(genops.c:1553:class_disconnect_exports()) OBD device 14 (ffff90a7a7458000) has exports, disconnecting them 00000020:00080000:1.0:1788574454.963926:0:17641:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0000: disconnecting export at 0@lo (ffff90a6812cc000), last request at 1788574360 00000020:00000080:1.0:1788574454.963941:0:17641:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x10531a153b536a67 00000020:00080000:1.0:1788574454.963949:0:17641:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff90a6812cc000): rc 0 00000020:00000080:1.0:1788574454.963954:0:17641:0:(genops.c:885:class_export_put()) final put ffff90a6812cc000/lustre-MDT0000-lwp-OST0000 00000020:00000080:2.0:1788574454.964225:0:13890:0:(genops.c:844:class_export_destroy()) destroying export ffff90a79924c800/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:3.0:1788574454.965810:0:13890:0:(genops.c:844:class_export_destroy()) destroying export ffff90a6812cc000/lustre-MDT0000-lwp-OST0000 for lustre-MDT0000-lwp-OST0000 00010000:01000000:2.0:1788574454.973694:0:17641:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0000: client import never connected 00000100:00080000:2.0:1788574454.973706:0:17641:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1788574454.973710:0:17641:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 5 00000100:00100000:2.0:1788574454.973720:0:17641:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1788574454.973969:0:17641:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788574454.973978:0:17641:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000020:01000004:2.0:1788574454.973987:0:17641:0:(obd_mount.c:710:lustre_put_lsi()) put ffff90a7bfbe1000 1 00000020:00000080:2.0:1788574454.973994:0:17641:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x10531a153b536a0c 00000020:00000080:2.0:1788574454.974004:0:17641:0:(genops.c:885:class_export_put()) final put ffff90a785e1b800/lustre-OST0000-osd_UUID 00000020:01000000:2.0:1788574454.974010:0:17641:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osd (flags='') 00000020:00000080:2.0:1788574454.974015:0:17641:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788574454.974019:0:17641:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osd: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1788574454.974022:0:17641:0:(genops.c:1558:class_disconnect_exports()) OBD device 11 (ffff90a79f8fcd40) has no exports 00000020:00000080:3.0:1788574454.974196:0:13890:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff90a7bb2e8000 for lustre-MDT0000-lwp-OST0000 00000020:00000080:3.0:1788574454.974205:0:13890:0:(genops.c:885:class_export_put()) final put ffff90a682206000/lustre-MDT0000-lwp-OST0000_UUID 00000020:00000080:3.0:1788574454.974208:0:13890:0:(genops.c:844:class_export_destroy()) destroying export ffff90a682206000/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000-lwp-OST0000 00000020:01000000:3.0:1788574454.974215:0:13890:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0000 (lustre-MDT0000-lwp-OST0000_UUID) 00000020:00000080:3.0:1788574454.974278:0:13890:0:(genops.c:844:class_export_destroy()) destroying export ffff90a785e1b800/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:2.0:1788574454.994159:0:17641:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788574454.994179:0:17641:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00000020:00000080:2.0:1788574454.994185:0:17641:0:(genops.c:885:class_export_put()) final put ffff90a7bfbe0000/lustre-OST0000-osd_UUID 00000020:00000080:2.0:1788574454.994190:0:17641:0:(genops.c:844:class_export_destroy()) destroying export ffff90a7bfbe0000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:01000000:2.0:1788574454.994212:0:17641:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osd (lustre-OST0000-osd_UUID) 00000020:01000004:2.0:1788574454.996656:0:17641:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff90a7bfbe7000 00000020:02000400:2.0:1788574454.996738:0:17641:0:(tgt_mount.c:2184:server_put_super()) server umount lustre-OST0000 complete 00010000:00010000:1.0:1788574455.552691:0:14332:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788574456.577871:0:14333:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788574457.600566:0:15396:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1788574458.112867:0:17794:0:(tgt_mount.c:2195:server_umount_begin()) umount -f 00000020:01000004:1.0:1788574458.129813:0:17794:0:(tgt_mount.c:2065:server_put_super()) server put_super lustre-OST0001 00010000:00010000:1.0:1788574458.129891:0:17794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.157@tcp lock: ffff90a79e985800/0x10531a153b536b86 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x10531a153b536b8d expref: -99 pid: 15748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574458.129906:0:17794:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.157@tcp lock: ffff90a79e985800/0x10531a153b536b86 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x10531a153b536b8d expref: -99 pid: 15748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574458.129913:0:17794:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.157@tcp lock: ffff90a79e985800/0x10531a153b536b86 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x10531a153b536b8d expref: -99 pid: 15748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574458.129921:0:17794:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.157@tcp lock: ffff90a79e985800/0x10531a153b536b86 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x10531a153b536b8d expref: -99 pid: 15748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574458.129994:0:17794:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:1.0:1788574458.130000:0:17794:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:1.0:1788574458.130022:0:17794:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1788574458.130034:0:17794:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff90a7bb28aa00 x1875455747675648/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788574460 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788574458.130056:0:17794:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff90a7bb289f80 x1875455747675776/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788574465 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788574458.130070:0:17794:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff90a6839d2300 x1875455747676032/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788574470 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788574458.130082:0:17794:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 3 00000100:00080000:1.0:1788574458.130088:0:17794:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00080000:1.0:1788574458.130113:0:17794:0:(import.c:65:import_set_state_nolock()) ffff90a79fbb5000 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00000100:00100000:1.0:1788574458.130164:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a7bb289f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3314:1875455747675776:0@lo:400:kworker.0 00000100:00100000:1.0:1788574458.130200:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a6839d2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3313:1875455747676032:0@lo:400:kworker.0 00000100:00100000:3.0:1788574458.130493:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a7bb28aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3315:1875455747675648:0@lo:400:kworker.0 00000100:00100000:3.0:1788574458.130520:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a7a72b9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3311:1875455747676160:0@lo:39:umount.0 00000400:00000100:3.0:1788574458.130568:0:3311:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875455747676160 offset 0 length 224: 4 00010000:00010000:2.0:1788574458.130747:0:14332:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788574458.130762:0:14332:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.157@tcp lock: ffff90a79e985800/0x10531a153b536b86 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x10531a153b536b8d expref: -99 pid: 15748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574458.130770:0:14332:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a79e985800 already unused, calling callback (ffffffffc1bbcc20) 10000000:00010000:2.0:1788574458.130774:0:14332:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.157@tcp lock: ffff90a79e985800/0x10531a153b536b86 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x10531a153b536b8d expref: -99 pid: 15748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574458.130784:0:14332:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.157@tcp lock: ffff90a79e985800/0x10531a153b536b86 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x10531a153b536b8d expref: -99 pid: 15748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788574458.130792:0:14332:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.157@tcp lock: ffff90a79e985800/0x10531a153b536b86 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x10531a153b536b8d expref: -99 pid: 15748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788574458.130799:0:14332:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1788574458.130801:0:14332:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:2.0:1788574458.130804:0:14332:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:2.0:1788574458.130816:0:14332:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff90a7bc13e800 00010000:00010000:2.0:1788574458.130819:0:14332:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.157@tcp lock: ffff90a79e985800/0x10531a153b536b86 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x10531a153b536b8d expref: -99 pid: 15748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574458.130827:0:14332:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.157@tcp lock: ffff90a79e985800/0x10531a153b536b86 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x10531a153b536b8d expref: -99 pid: 15748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574458.130838:0:14332:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788574458.130839:0:14332:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788574458.130841:0:14332:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788574458.624543:0:14333:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788574459.648607:0:15396:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1788574460.032503:0:489:0:(pinger.c:229:ptlrpc_pinger_process_import()) 3cd60e94-2a59-4e1b-b761-ea9d2ceff3ab->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788574460.032517:0:489:0:(pinger.c:247:ptlrpc_pinger_process_import()) 3cd60e94-2a59-4e1b-b761-ea9d2ceff3ab->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00010000:00010000:2.0:1788574460.675414:0:14332:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788574461.696518:0:14333:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788574462.720853:0:15396:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788574463.745630:0:14332:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788574464.768601:0:14333:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1788574465.159250:0:13890:0:(pinger.c:229:ptlrpc_pinger_process_import()) 3cd60e94-2a59-4e1b-b761-ea9d2ceff3ab->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788574465.159261:0:13890:0:(pinger.c:247:ptlrpc_pinger_process_import()) 3cd60e94-2a59-4e1b-b761-ea9d2ceff3ab->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00010000:00010000:1.0:1788574465.794621:0:15396:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788574466.817288:0:14332:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788574467.840570:0:14333:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788574468.352658:0:3311:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788574458/real 1788574458] req@ffff90a7a72b9c00 x1875455747676160/t0(0) o39->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1788574468 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788574468.352693:0:3311:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff90a7a72b9c00 x1875455747676160/t0(0) o39->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1788574468 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1788574468.352713:0:3311:0:(import.c:65:import_set_state_nolock()) ffff90a79fbb5000 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:3.0:1788574468.352744:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a7a72b9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3311:1875455747676160:0@lo:39:umount.0 00000100:00080000:1.0:1788574468.352849:0:17794:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1788574468.352854:0:17794:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 4 00000100:00100000:1.0:1788574468.352859:0:17794:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:1.0:1788574468.353881:0:17794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.157@tcp lock: ffff90a790a21800/0x10531a153b536b5c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x10531a153b536b63 expref: -99 pid: 15748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574468.353899:0:17794:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.157@tcp lock: ffff90a790a21800/0x10531a153b536b5c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x10531a153b536b63 expref: -99 pid: 15748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574468.353925:0:17794:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.157@tcp lock: ffff90a790a21800/0x10531a153b536b5c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x10531a153b536b63 expref: -99 pid: 15748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574468.353932:0:17794:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.157@tcp lock: ffff90a790a21800/0x10531a153b536b5c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x10531a153b536b63 expref: -99 pid: 15748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574468.353965:0:17794:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788574468.353973:0:17794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.157@tcp lock: ffff90a79e984400/0x10531a153b536d0e lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x10531a153b536d15 expref: -99 pid: 14341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574468.353980:0:17794:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.157@tcp lock: ffff90a79e984400/0x10531a153b536d0e lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x10531a153b536d15 expref: -99 pid: 14341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574468.353987:0:17794:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.157@tcp lock: ffff90a79e984400/0x10531a153b536d0e lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x10531a153b536d15 expref: -99 pid: 14341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574468.353993:0:17794:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.157@tcp lock: ffff90a79e984400/0x10531a153b536d0e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x10531a153b536d15 expref: -99 pid: 14341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574468.354015:0:17794:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:01000000:1.0:1788574468.354020:0:17794:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0001 (0) 00000020:01000004:1.0:1788574468.354041:0:17794:0:(tgt_mount.c:2115:server_put_super()) stopping lustre-OST0001 00000020:01000000:1.0:1788574468.354044:0:17794:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001 (flags='F') 00000020:00000080:1.0:1788574468.354049:0:17794:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788574468.354055:0:17794:0:(obd_config.c:956:class_cleanup()) lustre-OST0001: forcing exports to disconnect: 0/1 00000020:00080000:1.0:1788574468.354059:0:17794:0:(genops.c:1558:class_disconnect_exports()) OBD device 16 (ffff90a7a745b380) has no exports 00000020:00080000:1.0:1788574468.354084:0:17794:0:(genops.c:1558:class_disconnect_exports()) OBD device 16 (ffff90a7a745b380) has no exports 00010000:00010000:3.0:1788574468.354257:0:14332:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788574468.354266:0:14332:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.157@tcp lock: ffff90a790a21800/0x10531a153b536b5c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x10531a153b536b63 expref: -99 pid: 15748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574468.354276:0:14332:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a790a21800 already unused, calling callback (ffffffffc1bbcc20) 10000000:00010000:3.0:1788574468.354280:0:14332:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.157@tcp lock: ffff90a790a21800/0x10531a153b536b5c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x10531a153b536b63 expref: -99 pid: 15748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574468.354289:0:14332:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.157@tcp lock: ffff90a790a21800/0x10531a153b536b5c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x10531a153b536b63 expref: -99 pid: 15748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788574468.354297:0:14332:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.157@tcp lock: ffff90a790a21800/0x10531a153b536b5c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x10531a153b536b63 expref: -99 pid: 15748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788574468.354304:0:14332:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1788574468.354306:0:14332:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0001: stopping, won't requeue 10000000:01000000:3.0:1788574468.354308:0:14332:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0001 00010000:00010000:3.0:1788574468.354326:0:14332:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff90a7bc13e800 00010000:00010000:3.0:1788574468.354329:0:14332:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.157@tcp lock: ffff90a790a21800/0x10531a153b536b5c lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x10531a153b536b63 expref: -99 pid: 15748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574468.354336:0:14332:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.157@tcp lock: ffff90a790a21800/0x10531a153b536b5c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x10531a153b536b63 expref: -99 pid: 15748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574468.354351:0:14332:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788574468.354354:0:14332:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.157@tcp lock: ffff90a79e984400/0x10531a153b536d0e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x10531a153b536d15 expref: -99 pid: 14341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574468.354360:0:14332:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a79e984400 already unused, calling callback (ffffffffc1bbcc20) 10000000:00010000:3.0:1788574468.354363:0:14332:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.157@tcp lock: ffff90a79e984400/0x10531a153b536d0e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x10531a153b536d15 expref: -99 pid: 14341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574468.354425:0:14332:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.157@tcp lock: ffff90a79e984400/0x10531a153b536d0e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x10531a153b536d15 expref: -99 pid: 14341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788574468.354432:0:14332:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.157@tcp lock: ffff90a79e984400/0x10531a153b536d0e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x10531a153b536d15 expref: -99 pid: 14341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788574468.354438:0:14332:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:3.0:1788574468.354440:0:14332:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:3.0:1788574468.354441:0:14332:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:3.0:1788574468.354447:0:14332:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff90a7bc13e800 00010000:00010000:3.0:1788574468.354450:0:14332:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.157@tcp lock: ffff90a79e984400/0x10531a153b536d0e lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0x10531a153b536d15 expref: -99 pid: 14341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574468.354456:0:14332:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.157@tcp lock: ffff90a79e984400/0x10531a153b536d0e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0x10531a153b536d15 expref: -99 pid: 14341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574468.354471:0:14332:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788574468.354474:0:14332:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788574468.354475:0:14332:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:1.0:1788574468.355827:0:17794:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff90a7838d6d80 - data ffff90a7b1dc3510/ffff90a681390400 00000020:01000000:1.0:1788574468.355969:0:17794:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff90a7884e6000 - data ffff90a7b6784d80/ffff90a68137f800 00010000:00010000:2.0:1788574468.356394:0:15396:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00100000:10000000:1.0:1788574468.381083:0:17794:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0001-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:1.0:1788574468.444007:0:17794:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x10531a153b536b71 00000020:00000080:1.0:1788574468.444020:0:17794:0:(genops.c:885:class_export_put()) final put ffff90a6812ce800/lustre-OST0001-osd_UUID 00000020:01000004:1.0:1788574468.444147:0:17794:0:(tgt_mount.c:187:server_put_mount()) put mount ffff90a79fbb6000 from lustre-OST0001, refs=2 00000020:01000004:1.0:1788574468.444152:0:17794:0:(obd_mount.c:710:lustre_put_lsi()) put ffff90a79fbb6000 2 00000020:01000004:1.0:1788574468.444155:0:17794:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff90a79fbb6000 from lustre-OST0001 00000020:00000080:1.0:1788574468.444194:0:17794:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788574468.444205:0:17794:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:00000080:1.0:1788574468.444218:0:17794:0:(genops.c:885:class_export_put()) final put ffff90a6811b6800/lustre-OST0001_UUID 00000020:00000080:1.0:1788574468.444221:0:17794:0:(genops.c:844:class_export_destroy()) destroying export ffff90a6811b6800/lustre-OST0001_UUID for lustre-OST0001 00000020:01000000:1.0:1788574468.444234:0:17794:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001 (lustre-OST0001_UUID) 00000100:00080000:1.0:1788574468.444331:0:17794:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import 3cd60e94-2a59-4e1b-b761-ea9d2ceff3ab->MGS 00010000:00010000:1.0:1788574468.444347:0:17794:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.157@tcp lock: ffff90a7c2159800/0x10531a153b536a1a lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x10531a153b536a21 expref: -99 pid: 15026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788574468.444360:0:17794:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.157@tcp lock: ffff90a7c2159800/0x10531a153b536a1a lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x10531a153b536a21 expref: -99 pid: 15026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788574468.444366:0:17794:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 10000000:01000000:1.0:1788574468.444397:0:17794:0:(mgc_request.c:954:mgc_blocking_ast()) log nodemap: disconnecting, won't requeue 10000000:01000000:1.0:1788574468.444400:0:17794:0:(mgc_request.c:130:config_log_put()) dropping config log nodemap 00010000:00010000:1.0:1788574468.444427:0:17794:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff90a7bc13e800 00010000:00010000:1.0:1788574468.444431:0:17794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.157@tcp lock: ffff90a7c2159800/0x10531a153b536a1a lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x10531a153b536a21 expref: -99 pid: 15026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574468.444448:0:17794:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.157@tcp lock: ffff90a7829d6600/0x10531a153b536902 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x10531a153b536909 expref: -99 pid: 14326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788574468.444455:0:17794:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.157@tcp lock: ffff90a7829d6600/0x10531a153b536902 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x10531a153b536909 expref: -99 pid: 14326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788574468.444476:0:17794:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1788574468.444478:0:17794:0:(mgc_request.c:954:mgc_blocking_ast()) log lustre-s: disconnecting, won't requeue 10000000:01000000:1.0:1788574468.444480:0:17794:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-sptlrpc 00010000:00010000:1.0:1788574468.444491:0:17794:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff90a7bc13e800 00010000:00010000:1.0:1788574468.444494:0:17794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.157@tcp lock: ffff90a7829d6600/0x10531a153b536902 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x10531a153b536909 expref: -99 pid: 14326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1788574468.444512:0:17794:0:(import.c:65:import_set_state_nolock()) ffff90a7bc13e800 MGS: changing import state from CONNECTING to CLOSED 10000000:01000000:1.0:1788574468.444517:0:17794:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:1.0:1788574468.444519:0:17794:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:1.0:1788574468.444521:0:17794:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:1.0:1788574468.444528:0:17794:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:1.0:1788574468.444541:0:17794:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff90a6839d1500 x1875455747675904/t0(0) o250->MGC192.168.201.157@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 1788574469 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 10000000:01000000:1.0:1788574468.444559:0:17794:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:1.0:1788574468.444562:0:17794:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 1s for inflight to error out 00000020:00000080:2.0:1788574468.446923:0:13890:0:(genops.c:844:class_export_destroy()) destroying export ffff90a6812ce800/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000100:00100000:2.0:1788574468.447022:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a6839d1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:3cd60e94-2a59-4e1b-b761-ea9d2ceff3ab:3311:1875455747675904:0@lo:250:kworker.0 10000000:01000000:1.0:1788574468.448389:0:17794:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:1.0:1788574468.448421:0:17794:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x10531a153b5368ed 00000020:00000080:1.0:1788574468.448432:0:17794:0:(genops.c:885:class_export_put()) final put ffff90a7bc138800/3cd60e94-2a59-4e1b-b761-ea9d2ceff3ab 00000020:01000000:1.0:1788574468.448453:0:17794:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGC192.168.201.157@tcp (flags='') 00000020:00000080:1.0:1788574468.448460:0:17794:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788574468.448468:0:17794:0:(obd_config.c:956:class_cleanup()) MGC192.168.201.157@tcp: forcing exports to disconnect: 0/3 00000020:00080000:1.0:1788574468.448472:0:17794:0:(genops.c:1558:class_disconnect_exports()) OBD device 2 (ffff90a7924bcd40) has no exports 10000000:01000000:1.0:1788574468.448493:0:14341:0:(mgc_request.c:708:mgc_requeue_thread()) Ending requeue thread 10000000:01000000:1.0:1788574468.448567:0:17794:0:(obd_class.h:670:obd_cleanup_client_import()) MGC192.168.201.157@tcp: client import never connected 00000100:00080000:1.0:1788574468.448572:0:17794:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 10000000:01000000:1.0:1788574468.448575:0:17794:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:1.0:1788574468.448579:0:17794:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 10000000:01000000:1.0:1788574468.448581:0:17794:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:1.0:1788574468.448620:0:17794:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788574468.448626:0:17794:0:(obd_config.c:883:class_detach()) detach on obd MGC192.168.201.157@tcp (uuid 3cd60e94-2a59-4e1b-b761-ea9d2ceff3ab) 00000020:01000000:1.0:1788574468.448645:0:17794:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0001 (flags='F') 00000020:00000080:1.0:1788574468.448648:0:17794:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788574468.448652:0:17794:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-OST0001: forcing exports to disconnect: 1/3 00000020:00080000:1.0:1788574468.448659:0:17794:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-OST0001: ACTIVE ffff90a7a7bf4000 lustre-MDT0000-lwp-OST0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1788574468.448665:0:17794:0:(genops.c:1553:class_disconnect_exports()) OBD device 17 (ffff90a79241cd40) has exports, disconnecting them 00000020:00080000:1.0:1788574468.448669:0:17794:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0001: disconnecting export at 0@lo (ffff90a7a7bf4000), last request at 1788574377 00000020:00000080:1.0:1788574468.448673:0:17794:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x10531a153b536b9b 00000020:00080000:1.0:1788574468.448685:0:17794:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff90a7a7bf4000): rc 0 00000020:00000080:1.0:1788574468.448689:0:17794:0:(genops.c:885:class_export_put()) final put ffff90a7a7bf4000/lustre-MDT0000-lwp-OST0001 00000020:00000080:0.0:1788574468.448863:0:13890:0:(genops.c:844:class_export_destroy()) destroying export ffff90a7bc138800/3cd60e94-2a59-4e1b-b761-ea9d2ceff3ab for MGC192.168.201.157@tcp 00000020:00000080:0.0:1788574468.448876:0:13890:0:(genops.c:844:class_export_destroy()) destroying export ffff90a7a7bf4000/lustre-MDT0000-lwp-OST0001 for lustre-MDT0000-lwp-OST0001 00000020:00000080:0.0:1788574468.450578:0:13890:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff90a7bc13e800 for MGC192.168.201.157@tcp 00000020:00000080:0.0:1788574468.450595:0:13890:0:(genops.c:885:class_export_put()) final put ffff90a7bc13d800/3cd60e94-2a59-4e1b-b761-ea9d2ceff3ab 00000020:00000080:0.0:1788574468.450598:0:13890:0:(genops.c:844:class_export_destroy()) destroying export ffff90a7bc13d800/3cd60e94-2a59-4e1b-b761-ea9d2ceff3ab for MGC192.168.201.157@tcp 00000020:01000000:0.0:1788574468.450605:0:13890:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGC192.168.201.157@tcp (3cd60e94-2a59-4e1b-b761-ea9d2ceff3ab) 00010000:01000000:2.0:1788574468.454592:0:17794:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0001: client import never connected 00000100:00080000:2.0:1788574468.454602:0:17794:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1788574468.454607:0:17794:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 5 00000100:00100000:2.0:1788574468.454615:0:17794:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1788574468.455341:0:17794:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788574468.455351:0:17794:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000020:01000004:2.0:1788574468.455359:0:17794:0:(obd_mount.c:710:lustre_put_lsi()) put ffff90a79fbb6000 1 00000020:00000080:2.0:1788574468.455394:0:17794:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x10531a153b536b55 00000020:00000080:2.0:1788574468.455405:0:17794:0:(genops.c:885:class_export_put()) final put ffff90a68134f800/lustre-OST0001-osd_UUID 00000020:01000000:2.0:1788574468.455413:0:17794:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osd (flags='') 00000020:00000080:2.0:1788574468.455432:0:17794:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788574468.455437:0:17794:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osd: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1788574468.455441:0:17794:0:(genops.c:1558:class_disconnect_exports()) OBD device 15 (ffff90a791dc8000) has no exports 00010000:00010000:3.0:1788574468.459267:0:14333:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-1 blwis in pool) 00010000:00010000:3.0:1788574468.459787:0:14332:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-2 blwis in pool) 00010000:00010000:2.0:1788574468.459933:0:15396:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-3 blwis in pool) 00000100:00100000:2.0:1788574468.460039:0:14328:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_001: service thread [ffff90a7a02dfa00:14328] 1 exiting: rc = 0 00000100:00100000:0.0:1788574468.460406:0:14327:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_000: service thread [ffff90a790b83c00:14327] 0 exiting: rc = 1 00000100:00100000:2.0:1788574468.465010:0:13890:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788574468.466101:0:14330:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_001: service thread [ffff90a7a02dea00:14330] 1 exiting: rc = 0 00000100:00100000:2.0:1788574468.466228:0:14331:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_002: service thread [ffff90a7a02dec00:14331] 2 exiting: rc = 0 00000100:00100000:0.0:1788574468.467481:0:14329:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_000: service thread [ffff90a7a02dfe00:14329] 0 exiting: rc = 1 00000100:00100000:0.0:1788574468.467578:0:13890:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574468.467586:0:13890:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574468.467594:0:13890:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574468.467601:0:13890:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574468.467607:0:13890:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574468.467613:0:13890:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574468.467618:0:13890:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574468.467623:0:13890:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574468.467629:0:13890:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574468.467634:0:13890:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574468.467642:0:13890:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574468.467647:0:13890:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574468.467672:0:13890:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574468.467677:0:13890:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574468.467682:0:13890:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574468.467688:0:13890:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574468.467693:0:13890:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574468.467713:0:13890:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574468.467718:0:13890:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574468.467724:0:13890:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574468.467729:0:13890:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574468.467736:0:13890:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574468.467742:0:13890:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574468.467749:0:13890:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574468.467755:0:13890:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574468.467761:0:13890:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574468.467766:0:13890:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574468.467770:0:13890:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574468.467775:0:13890:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574468.467781:0:13890:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574468.467786:0:13890:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574468.467792:0:13890:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574468.467797:0:13890:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574468.467801:0:13890:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574468.467806:0:13890:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574468.467810:0:13890:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574468.467815:0:13890:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574468.467819:0:13890:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574468.467826:0:13890:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574468.467831:0:13890:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574468.467836:0:13890:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574468.468117:0:13890:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574468.468128:0:13890:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574468.468135:0:13890:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574468.468139:0:13890:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574468.468144:0:13890:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574468.468149:0:13890:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574468.468173:0:13890:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574468.468179:0:13890:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574468.468184:0:13890:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574468.468189:0:13890:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574468.468194:0:13890:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574468.468199:0:13890:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574468.468204:0:13890:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574468.468943:0:13890:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574468.468956:0:13890:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574468.468962:0:13890:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574468.468967:0:13890:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574468.468973:0:13890:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574468.468978:0:13890:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574468.468983:0:13890:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574468.468989:0:13890:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574468.468994:0:13890:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574468.469001:0:13890:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:2.0:1788574468.472009:0:13890:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff90a79fbb5000 for lustre-MDT0000-lwp-OST0001 00000020:00000080:2.0:1788574468.472021:0:13890:0:(genops.c:885:class_export_put()) final put ffff90a7bb2d1800/lustre-MDT0000-lwp-OST0001_UUID 00000020:00000080:2.0:1788574468.472024:0:13890:0:(genops.c:844:class_export_destroy()) destroying export ffff90a7bb2d1800/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000-lwp-OST0001 00000020:01000000:2.0:1788574468.472046:0:13890:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0001 (lustre-MDT0000-lwp-OST0001_UUID) 00000020:00000080:2.0:1788574468.472086:0:13890:0:(genops.c:844:class_export_destroy()) destroying export ffff90a68134f800/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:00000080:0.0:1788574468.502019:0:17794:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788574468.502044:0:17794:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00000020:00000080:0.0:1788574468.502051:0:17794:0:(genops.c:885:class_export_put()) final put ffff90a79fbb3800/lustre-OST0001-osd_UUID 00000020:00000080:0.0:1788574468.502056:0:17794:0:(genops.c:844:class_export_destroy()) destroying export ffff90a79fbb3800/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:01000000:0.0:1788574468.502064:0:17794:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osd (lustre-OST0001-osd_UUID) 00000020:01000004:0.0:1788574468.502296:0:17794:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff90a79fbb3000 00000020:01000000:0.0:1788574468.502323:0:17794:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of OSS (flags='F') 00000020:00000080:0.0:1788574468.502329:0:17794:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788574468.502333:0:17794:0:(obd_config.c:956:class_cleanup()) OSS: forcing exports to disconnect: 0/1 00000020:00080000:0.0:1788574468.502343:0:17794:0:(genops.c:1558:class_disconnect_exports()) OBD device 12 (ffff90a7a745cd40) has no exports 00000020:00000080:0.0:1788574468.502411:0:17794:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788574468.502420:0:17794:0:(obd_config.c:883:class_detach()) detach on obd OSS (uuid OSS_uuid) 00000020:00000080:0.0:1788574468.502423:0:17794:0:(genops.c:885:class_export_put()) final put ffff90a785e1d800/OSS_uuid 00000020:00000080:0.0:1788574468.502425:0:17794:0:(genops.c:844:class_export_destroy()) destroying export ffff90a785e1d800/OSS_uuid for OSS 00000020:01000000:0.0:1788574468.502431:0:17794:0:(genops.c:441:class_free_dev()) finishing cleanup of obd OSS (OSS_uuid) 00000100:00100000:0.0:1788574468.502512:0:15028:0:(service.c:3183:ptlrpc_main()) ll_ost00_000: service thread [ffff90a7838eac00:15028] 0 exiting: rc = 1 00000100:00100000:1.0:1788574468.502886:0:15030:0:(service.c:3183:ptlrpc_main()) ll_ost00_002: service thread [ffff90a7838eb800:15030] 2 exiting: rc = 0 00000100:00100000:1.0:1788574468.502944:0:16578:0:(service.c:3183:ptlrpc_main()) ll_ost00_003: service thread [ffff90a79339fe00:16578] 3 exiting: rc = 0 00000100:00080000:3.0:1788574468.505230:0:14340:0:(pinger.c:548:ping_evictor_main()) Exiting Ping Evictor 00000100:00100000:3.0:1788574468.505423:0:15029:0:(service.c:3183:ptlrpc_main()) ll_ost00_001: service thread [ffff90a7979f8200:15029] 1 exiting: rc = 0 00000100:00100000:0.0:1788574468.505678:0:17794:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574468.505714:0:17794:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574468.505720:0:17794:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574468.505725:0:17794:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574468.505730:0:17794:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574468.505736:0:17794:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574468.505741:0:17794:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574468.505747:0:17794:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574468.505756:0:17794:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574468.505762:0:17794:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574468.505767:0:17794:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574468.505775:0:17794:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574468.505781:0:17794:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574468.505788:0:17794:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574468.505795:0:17794:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574468.505801:0:17794:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574468.505807:0:17794:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574468.505812:0:17794:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574468.505818:0:17794:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574468.505823:0:17794:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574468.505827:0:17794:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574468.505832:0:17794:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574468.505837:0:17794:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574468.505855:0:17794:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574468.505862:0:17794:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574468.505867:0:17794:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574468.505872:0:17794:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574468.505878:0:17794:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574468.505883:0:17794:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574468.505888:0:17794:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574468.505893:0:17794:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574468.505898:0:17794:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574468.505903:0:17794:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574468.505908:0:17794:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574468.505913:0:17794:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574468.505918:0:17794:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574468.505932:0:17794:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574468.505937:0:17794:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574468.505943:0:17794:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574468.505948:0:17794:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574468.505953:0:17794:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574468.505959:0:17794:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574468.505964:0:17794:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574468.505970:0:17794:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574468.505975:0:17794:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574468.505982:0:17794:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574468.505988:0:17794:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574468.505993:0:17794:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574468.505998:0:17794:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574468.506004:0:17794:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574468.506009:0:17794:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574468.506014:0:17794:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574468.506020:0:17794:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574468.506025:0:17794:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574468.506041:0:17794:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574468.506048:0:17794:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574468.506053:0:17794:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574468.506059:0:17794:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574468.506065:0:17794:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574468.506071:0:17794:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574468.506076:0:17794:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574468.506080:0:17794:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574468.506085:0:17794:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574468.506091:0:17794:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574468.506809:0:15031:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_000: service thread [ffff90a7bfae8e00:15031] 0 exiting: rc = 1 00000100:00100000:2.0:1788574468.507266:0:15032:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_001: service thread [ffff90a7a74d3200:15032] 1 exiting: rc = 0 00000100:00100000:0.0:1788574468.507438:0:17794:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574468.507444:0:17794:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574468.507449:0:17794:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574468.507455:0:17794:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574468.507461:0:17794:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574468.507466:0:17794:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574468.507486:0:17794:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574468.507492:0:17794:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574468.507497:0:17794:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574468.507503:0:17794:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574468.507509:0:17794:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574468.507514:0:17794:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574468.507519:0:17794:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574468.507524:0:17794:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574468.507530:0:17794:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574468.507535:0:17794:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574468.507541:0:17794:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574468.507547:0:17794:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574468.507553:0:17794:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574468.507560:0:17794:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574468.507567:0:17794:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574468.507573:0:17794:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574468.507579:0:17794:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574468.507586:0:17794:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574468.507591:0:17794:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574468.507596:0:17794:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574468.507601:0:17794:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574468.507610:0:17794:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574468.507616:0:17794:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574468.507622:0:17794:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574468.507627:0:17794:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574468.507633:0:17794:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574468.507640:0:17794:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574468.507645:0:17794:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574468.507650:0:17794:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574468.507655:0:17794:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574468.507661:0:17794:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574468.507666:0:17794:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574468.507671:0:17794:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574468.507676:0:17794:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574468.507681:0:17794:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574468.507762:0:17794:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574468.507769:0:17794:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574468.507774:0:17794:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574468.507779:0:17794:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574468.507784:0:17794:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574468.507790:0:17794:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574468.507795:0:17794:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574468.507799:0:17794:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574468.507804:0:17794:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574468.507809:0:17794:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574468.507814:0:17794:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574468.507819:0:17794:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574468.507823:0:17794:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574468.507828:0:17794:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574468.507833:0:17794:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574468.507838:0:17794:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574468.507918:0:17794:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574468.507924:0:17794:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574468.507928:0:17794:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574468.507933:0:17794:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574468.507937:0:17794:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574468.507943:0:17794:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574468.507948:0:17794:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574468.509865:0:15035:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_002: service thread [ffff90a79243d600:15035] 2 exiting: rc = 0 00000100:00100000:2.0:1788574468.510157:0:16581:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_003: service thread [ffff90a792271400:16581] 3 exiting: rc = 0 00000100:00100000:2.0:1788574468.510386:0:16583:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_005: service thread [ffff90a7bfb6e400:16583] 5 exiting: rc = 0 00000100:00100000:2.0:1788574468.510530:0:15033:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_000: service thread [ffff90a68313e400:15033] 0 exiting: rc = 1 00000100:00100000:3.0:1788574468.511308:0:16582:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_004: service thread [ffff90a783e42000:16582] 4 exiting: rc = 0 00000100:00100000:3.0:1788574468.511502:0:15034:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_001: service thread [ffff90a7a74eb600:15034] 1 exiting: rc = 0 00000100:00100000:0.0:1788574468.512234:0:17794:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574468.512242:0:17794:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574468.512249:0:17794:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574468.512254:0:17794:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574468.512261:0:17794:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574468.512268:0:17794:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574468.512275:0:17794:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574468.512280:0:17794:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574468.512285:0:17794:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574468.512291:0:17794:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574468.512296:0:17794:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574468.512302:0:17794:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574468.512320:0:17794:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574468.512325:0:17794:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574468.512332:0:17794:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574468.512337:0:17794:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574468.512342:0:17794:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574468.512348:0:17794:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574468.512354:0:17794:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574468.512362:0:17794:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574468.512385:0:17794:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574468.512392:0:17794:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574468.512411:0:17794:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574468.512417:0:17794:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574468.512423:0:17794:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574468.512428:0:17794:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574468.512434:0:17794:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574468.512439:0:17794:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574468.512445:0:17794:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574468.512450:0:17794:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574468.512456:0:17794:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574468.512461:0:17794:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574468.512467:0:17794:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574468.512472:0:17794:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574468.512477:0:17794:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574468.512483:0:17794:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574468.512488:0:17794:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574468.512495:0:17794:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574468.512501:0:17794:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574468.512517:0:17794:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574468.512523:0:17794:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574468.512530:0:17794:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574468.512537:0:17794:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574468.512542:0:17794:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574468.512548:0:17794:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574468.512554:0:17794:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574468.512575:0:17794:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574468.512586:0:17794:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574468.512592:0:17794:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574468.512597:0:17794:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574468.512604:0:17794:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574468.512610:0:17794:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574468.512615:0:17794:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574468.512622:0:17794:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574468.512638:0:17794:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574468.512659:0:17794:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574468.512668:0:17794:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574468.512675:0:17794:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574468.512682:0:17794:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574468.512688:0:17794:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574468.512959:0:17794:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574468.512968:0:17794:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574468.512974:0:17794:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574468.512980:0:17794:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574468.521228:0:15036:0:(service.c:3183:ptlrpc_main()) ll_ost_seq00_000: service thread [ffff90a79243c800:15036] 0 exiting: rc = 1 00000100:00100000:0.0:1788574468.521337:0:15037:0:(service.c:3183:ptlrpc_main()) ll_ost_seq00_001: service thread [ffff90a7979f8000:15037] 1 exiting: rc = 0 00000100:00100000:0.0:1788574468.521416:0:17794:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574468.521431:0:17794:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574468.521438:0:17794:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574468.521444:0:17794:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574468.521449:0:17794:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574468.521455:0:17794:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574468.521460:0:17794:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574468.521466:0:17794:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574468.521472:0:17794:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574468.521477:0:17794:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574468.521483:0:17794:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574468.521488:0:17794:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574468.521493:0:17794:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574468.521499:0:17794:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574468.521505:0:17794:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574468.521510:0:17794:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574468.521529:0:17794:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574468.521535:0:17794:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574468.521540:0:17794:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574468.521545:0:17794:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574468.521550:0:17794:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574468.521555:0:17794:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574468.521561:0:17794:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574468.521567:0:17794:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574468.521572:0:17794:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574468.521577:0:17794:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574468.521583:0:17794:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574468.521588:0:17794:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574468.521593:0:17794:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574468.521598:0:17794:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574468.521604:0:17794:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574468.521609:0:17794:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574468.521615:0:17794:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574468.521622:0:17794:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574468.521627:0:17794:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574468.521633:0:17794:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574468.521638:0:17794:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574468.521644:0:17794:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574468.521650:0:17794:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574468.521656:0:17794:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574468.521661:0:17794:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574468.521666:0:17794:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574468.521678:0:17794:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574468.521685:0:17794:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574468.521691:0:17794:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574468.522278:0:17794:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574468.522287:0:17794:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574468.522292:0:17794:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574468.522297:0:17794:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574468.522303:0:17794:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574468.522309:0:17794:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574468.522322:0:17794:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574468.522327:0:17794:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574468.522331:0:17794:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574468.522337:0:17794:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574468.522343:0:17794:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574468.522348:0:17794:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574468.522353:0:17794:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574468.522358:0:17794:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574468.522363:0:17794:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574468.522408:0:17794:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574468.522415:0:17794:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574468.522420:0:17794:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574468.522432:0:17794:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788574468.523655:0:15039:0:(service.c:3183:ptlrpc_main()) ll_ost_out00_001: service thread [ffff90a79326e200:15039] 1 exiting: rc = 0 00000100:00100000:1.0:1788574468.524573:0:15038:0:(service.c:3183:ptlrpc_main()) ll_ost_out00_000: service thread [ffff90a7854a1200:15038] 0 exiting: rc = 1 00000100:00100000:0.0:1788574468.527913:0:17794:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574468.527925:0:17794:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574468.527931:0:17794:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574468.527938:0:17794:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574468.527952:0:17794:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574468.527959:0:17794:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574468.527966:0:17794:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574468.527973:0:17794:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574468.527980:0:17794:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574468.527986:0:17794:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574468.527992:0:17794:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574468.527998:0:17794:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574468.528005:0:17794:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574468.528011:0:17794:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574468.528017:0:17794:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574468.528024:0:17794:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574468.528059:0:17794:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574468.528066:0:17794:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574468.528073:0:17794:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574468.528081:0:17794:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574468.528087:0:17794:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574468.528341:0:17794:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574468.528364:0:17794:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574468.528440:0:17794:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574468.528449:0:17794:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574468.528456:0:17794:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574468.528462:0:17794:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574468.528468:0:17794:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574468.528492:0:17794:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574468.528500:0:17794:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574468.528506:0:17794:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574468.528512:0:17794:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574468.528518:0:17794:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574468.528525:0:17794:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574468.528531:0:17794:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574468.528537:0:17794:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574468.528543:0:17794:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574468.528548:0:17794:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574468.528555:0:17794:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574468.528561:0:17794:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574468.528583:0:17794:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574468.528589:0:17794:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574468.528594:0:17794:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574468.528600:0:17794:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574468.528606:0:17794:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574468.528612:0:17794:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574468.528618:0:17794:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574468.528624:0:17794:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574468.528629:0:17794:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574468.528634:0:17794:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574468.528639:0:17794:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574468.528644:0:17794:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574468.528662:0:17794:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574468.528669:0:17794:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574468.528675:0:17794:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574468.528682:0:17794:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574468.528688:0:17794:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574468.528715:0:17794:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574468.528722:0:17794:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574468.528727:0:17794:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574468.528733:0:17794:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574468.528739:0:17794:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574468.528744:0:17794:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574468.528751:0:17794:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:02000400:0.0:1788574468.541596:0:17794:0:(tgt_mount.c:2184:server_put_super()) server umount lustre-OST0001 complete 00000001:02000400:1.0:1788574487.082346:0:18408:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg157-server.virtnet: executing load_modules_local 00000020:01000004:1.0:1788574497.422650:0:18868:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:1.0:1788574497.422656:0:18868:0:(obd_mount.c:926:lmd_print()) device: lustre-mdt1/mdt1 00000080:01200004:1.0:1788574497.424487:0:18868:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff90a79fbec800 00000020:01000004:1.0:1788574497.424510:0:18868:0:(tgt_mount.c:2506:osd_start()) Attempting to start lustre-MDT0000, type=osd-zfs, lsifl=200005, mountfl=0 00000020:01000004:1.0:1788574497.424520:0:18868:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-zfs) 00000020:00000080:1.0:1788574497.424537:0:18868:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (ffff90a7a745b380) 00000020:00000080:1.0:1788574497.424553:0:18868:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-zfs with refcount 2 00100000:10000000:3.0:1788574497.471068:0:18868:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:3.0:1788574497.477127:0:18868:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000003:0x36:0x0] (8/32) 00100000:10000000:2.0:1788574497.478998:0:18868:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled params under 217: rc = 0 00100000:10000000:2.0:1788574497.479103:0:18868:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-client under 217: rc = 0 00100000:10000000:2.0:1788574497.479456:0:18868:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-OST0000 under 217: rc = 0 00100000:10000000:2.0:1788574497.479817:0:18868:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000003:0x3:0x0] (8/32) 00100000:10000000:2.0:1788574497.479900:0:18868:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled nodemap under 217: rc = 0 00100000:10000000:2.0:1788574497.480001:0:18868:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-MDT0000 under 217: rc = 0 00100000:10000000:2.0:1788574497.481588:0:18868:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-OST0001 under 217: rc = 0 00100000:10000000:2.0:1788574497.483036:0:18868:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre under 219: rc = 0 00100000:10000000:2.0:1788574497.484895:0:18868:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled md-0x0 under 562: rc = 0 00100000:10000000:2.0:1788574497.484996:0:18868:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled dt-0x0 under 562: rc = 0 00100000:10000000:2.0:1788574497.485962:0:18868:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000 under 43: rc = 0 00100000:10000000:2.0:1788574497.486850:0:18868:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000-MDT0000 under 43: rc = 0 00100000:10000000:2.0:1788574497.487100:0:18868:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000 under 43: rc = 0 00100000:10000000:2.0:1788574497.488912:0:18868:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000-MDT0000 under 43: rc = 0 00100000:10000000:2.0:1788574497.489906:0:18868:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000-MDT0000 under 43: rc = 0 00100000:10000000:2.0:1788574497.492292:0:18868:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000 under 43: rc = 0 00100000:10000000:2.0:1788574497.494076:0:18868:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000 under 43: rc = 0 00100000:10000000:2.0:1788574497.495891:0:18868:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000 under 43: rc = 0 00100000:10000000:2.0:1788574497.496877:0:18868:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000-MDT0000 under 43: rc = 0 00100000:10000000:2.0:1788574497.499468:0:18868:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000-MDT0000 under 43: rc = 0 00100000:10000000:2.0:1788574497.500018:0:18868:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000 under 43: rc = 0 00100000:10000000:2.0:1788574497.500988:0:18868:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000-MDT0000 under 43: rc = 0 00100000:10000000:2.0:1788574497.501960:0:18868:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_07 under 64: rc = 0 00100000:10000000:2.0:1788574497.502466:0:18868:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_11 under 64: rc = 0 00100000:10000000:2.0:1788574497.503001:0:18868:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_14 under 64: rc = 0 00100000:10000000:2.0:1788574497.504609:0:18868:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_02 under 64: rc = 0 00100000:10000000:2.0:1788574497.504927:0:18868:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_08 under 64: rc = 0 00100000:10000000:2.0:1788574497.506478:0:18868:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_05 under 64: rc = 0 00100000:10000000:2.0:1788574497.508281:0:18868:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_13 under 64: rc = 0 00100000:10000000:2.0:1788574497.508615:0:18868:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_00 under 64: rc = 0 00100000:10000000:2.0:1788574497.508919:0:18868:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_04 under 64: rc = 0 00100000:10000000:2.0:1788574497.509165:0:18868:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_12 under 64: rc = 0 00100000:10000000:2.0:1788574497.509461:0:18868:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_01 under 64: rc = 0 00100000:10000000:2.0:1788574497.509732:0:18868:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_06 under 64: rc = 0 00100000:10000000:2.0:1788574497.510004:0:18868:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_10 under 64: rc = 0 00100000:10000000:2.0:1788574497.510270:0:18868:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_15 under 64: rc = 0 00100000:10000000:2.0:1788574497.510556:0:18868:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_09 under 64: rc = 0 00100000:10000000:2.0:1788574497.510815:0:18868:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_03 under 64: rc = 0 00100000:10000000:0.0:1788574497.511335:0:18868:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_01 under 64: rc = 0 00100000:10000000:0.0:1788574497.511638:0:18868:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_04 under 64: rc = 0 00100000:10000000:0.0:1788574497.511883:0:18868:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_12 under 64: rc = 0 00100000:10000000:0.0:1788574497.512093:0:18868:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_15 under 64: rc = 0 00100000:10000000:0.0:1788574497.512886:0:18868:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_09 under 64: rc = 0 00100000:10000000:0.0:1788574497.513106:0:18868:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_03 under 64: rc = 0 00100000:10000000:0.0:1788574497.513746:0:18868:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_06 under 64: rc = 0 00100000:10000000:0.0:1788574497.514000:0:18868:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_10 under 64: rc = 0 00100000:10000000:0.0:1788574497.515912:0:18868:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_14 under 64: rc = 0 00100000:10000000:0.0:1788574497.518689:0:18868:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_02 under 64: rc = 0 00100000:10000000:0.0:1788574497.519111:0:18868:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_08 under 64: rc = 0 00100000:10000000:0.0:1788574497.520922:0:18868:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_07 under 64: rc = 0 00100000:10000000:0.0:1788574497.525475:0:18868:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_11 under 64: rc = 0 00100000:10000000:0.0:1788574497.531942:0:18868:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_00 under 64: rc = 0 00100000:10000000:0.0:1788574497.534036:0:18868:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_05 under 64: rc = 0 00100000:10000000:0.0:1788574497.535893:0:18868:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_13 under 64: rc = 0 00100000:10000000:0.0:1788574497.539923:0:18868:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled [0x200000400:0x1:0x0] under 57: rc = 0 00100000:10000000:0.0:1788574497.543266:0:18868:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x2010000:0x0] (8/32) 00100000:10000000:0.0:1788574497.543478:0:18868:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000 under 563: rc = 0 00100000:10000000:0.0:1788574497.543663:0:18868:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x1010000:0x0] (8/32) 00100000:10000000:0.0:1788574497.543748:0:18868:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000 under 563: rc = 0 00100000:10000000:0.0:1788574497.543945:0:18868:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x10000:0x0] (8/32) 00100000:10000000:0.0:1788574497.544011:0:18868:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000 under 563: rc = 0 00100000:10000000:0.0:1788574497.544363:0:18868:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x2020000:0x0] (8/32) 00100000:10000000:0.0:1788574497.544452:0:18868:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000 under 566: rc = 0 00100000:10000000:0.0:1788574497.544622:0:18868:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x20000:0x0] (8/32) 00100000:10000000:0.0:1788574497.545610:0:18868:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000 under 566: rc = 0 00100000:10000000:0.0:1788574497.545909:0:18868:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x1020000:0x0] (8/32) 00100000:10000000:0.0:1788574497.545970:0:18868:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000 under 566: rc = 0 00000020:00000080:0.0:1788574497.547724:0:18868:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:0.0:1788574497.547737:0:18868:0:(osd_handler.c:1574:osd_obd_connect()) connect #0 00000020:00000080:0.0:1788574497.547749:0:18868:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x10531a153b536fca 00000020:01000004:0.0:1788574497.547757:0:18868:0:(tgt_mount.c:2591:server_fill_super()) Found service lustre-MDT0000 on device lustre-mdt1/mdt1 00000020:01000000:0.0:1788574497.547762:0:18868:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:0.0:1788574497.547768:0:18868:0:(tgt_mount.c:101:server_register_mount()) register mount ffff90a79fbec800 from MGS 00000020:01000004:0.0:1788574497.547772:0:18868:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:0.0:1788574497.547783:0:18868:0:(genops.c:413:class_newdev()) Allocate new device MGS (ffff90a7924199c0) 00000020:00000080:0.0:1788574497.547795:0:18868:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:0.0:1788574497.547855:0:18868:0:(tgt_mount.c:153:server_get_mount()) get mount ffff90a79fbec800 from MGS, refs=2 00080000:01000000:0.0:1788574497.547860:0:18868:0:(osd_handler.c:1574:osd_obd_connect()) connect #1 00000020:00000080:0.0:1788574497.547865:0:18868:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x10531a153b536fd8 00000100:00100000:0.0:1788574497.548000:0:18868:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:0.0:1788574497.548135:0:18868:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:0.0:1788574497.548142:0:18868:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:0.0:1788574497.552327:0:18868:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:0.0:1788574497.552345:0:18868:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:2.0:1788574497.556962:0:18868:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788574497.558332:0:18868:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:2.0:1788574497.558341:0:18868:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:0.0:1788574497.561815:0:18868:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:0.0:1788574497.561835:0:18868:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:1.0:1788574497.564208:0:18868:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:1.0:1788574497.564221:0:18868:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:3.0:1788574497.566909:0:18874:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788574497.566917:0:18874:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788574497.566925:0:18874:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788574497.567200:0:18875:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788574497.567203:0:18875:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788574497.567205:0:18875:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788574497.567844:0:18868:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:3.0:1788574497.570772:0:18874:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:01000000:3.0:1788574497.591718:0:18868:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 20000000:01000000:3.0:1788574497.591744:0:18868:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:3.0:1788574497.591748:0:18868:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 10000000:01000000:0.0:1788574497.593973:0:18877:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:3.0:1788574497.594413:0:18868:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:3.0:1788574497.594520:0:18868:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:3.0:1788574497.599463:0:18868:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:3.0:1788574497.599902:0:18868:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788574497.600101:0:18868:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:3.0:1788574497.601898:0:18868:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:3.0:1788574497.602977:0:18868:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:3.0:1788574497.602989:0:18868:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:2.0:1788574497.606943:0:18868:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:2.0:1788574497.606961:0:18868:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:2.0:1788574497.608649:0:18868:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:2.0:1788574497.608695:0:18868:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.201.157@tcp' 00000020:01000004:2.0:1788574497.608697:0:18868:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:2.0:1788574497.608736:0:18868:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.201.157@tcp (typ=mgc) 00000020:00000080:2.0:1788574497.608752:0:18868:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.201.157@tcp (ffff90a79f8fcd40) 00000020:00000080:2.0:1788574497.608772:0:18868:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:2.0:1788574497.608883:0:18868:0:(ldlm_lib.c:102:import_set_conn()) imp ffff90a7bbb5a800@MGC192.168.201.157@tcp: add connection 192.168.201.157@tcp at head 00010000:00010000:2.0:1788574497.609083:0:18868:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.201.157@tcp-0 is initialized 00000040:01000000:2.0:1788574497.609092:0:18868:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.201.157@tcp ctxt 1 is initialized 10000000:01000000:2.0:1788574497.612459:0:18883:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:3.0:1788574497.612579:0:18868:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.201.157@tcp (uuid 64047b6f-0fa6-4004-9f51-bd636ae04daf) 00000020:00000080:3.0:1788574497.612610:0:18868:0:(genops.c:1385:class_connect()) connect: client 64047b6f-0fa6-4004-9f51-bd636ae04daf, cookie 0x10531a153b536fe6 00000100:00080000:3.0:1788574497.612626:0:18868:0:(import.c:545:import_select_connection()) MGC192.168.201.157@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1788574497.612635:0:18868:0:(import.c:665:import_select_connection()) MGC192.168.201.157@tcp: import ffff90a7bbb5a800 using connection 192.168.201.157@tcp/0@lo 00000100:00100000:3.0:1788574497.612693:0:18868:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff90a7bbebd500 x1875455747676288/t0(0) o250->MGC192.168.201.157@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788574497.612726:0:18868:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import 64047b6f-0fa6-4004-9f51-bd636ae04daf->MGS 00000020:01000004:3.0:1788574497.612750:0:18868:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:3.0:1788574497.612758:0:18868:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:3.0:1788574497.612776:0:18868:0:(genops.c:413:class_newdev()) Allocate new device MDS (ffff90a791dc8000) 00000020:00000080:3.0:1788574497.612790:0:18868:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:2.0:1788574497.614631:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a7bbebd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:64047b6f-0fa6-4004-9f51-bd636ae04daf:3311:1875455747676288:0@lo:250:mount.lustre.0 00000100:00100000:2.0:1788574497.614762:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788574497.631781:0:18879:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747676288 00000100:00100000:2.0:1788574497.631796:0:18879:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747676288 00000100:00100000:2.0:1788574497.631837:0:18879:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788574497.631845:0:18879:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a786371850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3311:x1875455747676288:12345-0@lo:250:mount.lustre.0 00010000:00080000:2.0:1788574497.631871:0:18879:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from 64047b6f-0fa6-4004-9f51-bd636ae04daf@0@lo t0 exp 0000000000000000 cur 623 last 0 00000020:00000080:2.0:1788574497.631900:0:18879:0:(genops.c:1385:class_connect()) connect: client 64047b6f-0fa6-4004-9f51-bd636ae04daf, cookie 0x10531a153b536ff4 00000100:00080000:2.0:1788574497.632013:0:18879:0:(import.c:65:import_set_state_nolock()) ffff90a7bbb5b800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788574497.632091:0:18879:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a786371850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:64047b6f-0fa6-4004-9f51-bd636ae04daf+5:3311:x1875455747676288:12345-0@lo:250:mount.lustre.0 Request processed in 247us (17329us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574497.632099:0:18879:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788574497.632202:0:3311:0:(client.c:3126:ptlrpc_free_committed()) MGC192.168.201.157@tcp: committing for last_committed 0 gen 1 00000100:00080000:2.0:1788574497.632212:0:3311:0:(import.c:1176:ptlrpc_connect_interpret()) MGC192.168.201.157@tcp: connect to target with instance 0 00000100:00080000:2.0:1788574497.632220:0:3311:0:(import.c:1000:ptlrpc_connect_set_flags()) MGC192.168.201.157@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:2.0:1788574497.632225:0:3311:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:2.0:1788574497.632228:0:3311:0:(import.c:65:import_set_state_nolock()) ffff90a7bbb5a800 MGS: changing import state from CONNECTING to FULL 10000000:01000000:2.0:1788574497.632231:0:3311:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:2.0:1788574497.632239:0:3311:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:2.0:1788574497.632245:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a7bbebd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:64047b6f-0fa6-4004-9f51-bd636ae04daf:3311:1875455747676288:0@lo:250:mount.lustre.0 00000100:00100000:3.0:1788574497.632414:0:18868:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788574497.632706:0:18868:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:3.0:1788574497.632713:0:18868:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00080000:3.0:1788574497.633252:0:18882:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 00000100:00100000:2.0:1788574497.633916:0:18868:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:2.0:1788574497.633924:0:18868:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:3.0:1788574497.634311:0:18868:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:3.0:1788574497.634323:0:18868:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:2.0:1788574497.642809:0:18868:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788574497.643031:0:18868:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:2.0:1788574497.643038:0:18868:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:2.0:1788574497.648080:0:18868:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:2.0:1788574497.648094:0:18868:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:1.0:1788574497.724859:0:18868:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788574497.725093:0:18868:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:1.0:1788574497.725102:0:18868:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:1.0:1788574497.727859:0:18868:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:1.0:1788574497.727881:0:18868:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:1.0:1788574497.728953:0:18868:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788574497.729275:0:18868:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:1.0:1788574497.729289:0:18868:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:1.0:1788574497.730613:0:18868:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:1.0:1788574497.730623:0:18868:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:1.0:1788574497.731311:0:18868:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788574497.731745:0:18868:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:1.0:1788574497.731751:0:18868:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:1.0:1788574497.732709:0:18868:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:1.0:1788574497.732719:0:18868:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:1.0:1788574497.733810:0:18868:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788574497.734002:0:18868:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:1.0:1788574497.734008:0:18868:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:1.0:1788574497.734923:0:18868:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:1.0:1788574497.734932:0:18868:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:0.0:1788574497.763070:0:18868:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788574497.764029:0:18868:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:0.0:1788574497.764037:0:18868:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:1.0:1788574497.770688:0:18868:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:1.0:1788574497.770708:0:18868:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:1.0:1788574497.771904:0:18868:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:1.0:1788574497.771916:0:18868:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:1.0:1788574497.775364:0:18868:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:1.0:1788574497.775435:0:18868:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-mdt1/mdt1 10000000:01000000:1.0:1788574497.775442:0:18868:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.201.157@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:1.0:1788574497.775810:0:18868:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.201.157@tcp ctxt 0 is initialized 00000020:01000004:1.0:1788574497.775881:0:18868:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.201.157@tcp, index=0000, flags=0x20005 00000020:01000004:1.0:1788574497.775889:0:18868:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:1.0:1788574497.775891:0:18868:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1788574497.775892:0:18868:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788574497.775894:0:18868:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788574497.775895:0:18868:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788574497.775896:0:18868:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788574497.775902:0:18868:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1788574497.775904:0:18868:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1788574497.775906:0:18868:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788574497.775907:0:18868:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1788574497.775910:0:18868:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020005 00000020:01000004:1.0:1788574497.775916:0:18868:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1788574497.775918:0:18868:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1788574497.775919:0:18868:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788574497.775928:0:18868:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788574497.775929:0:18868:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788574497.775930:0:18868:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788574497.775931:0:18868:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1788574497.775932:0:18868:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1788574497.775933:0:18868:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788574497.775934:0:18868:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1788574497.775976:0:18868:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:1.0:1788574497.776003:0:18868:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a7a72b9180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:64047b6f-0fa6-4004-9f51-bd636ae04daf:18868:1875455747676416:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1788574497.776312:0:18868:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788574497.776569:0:18868:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a7bb7e0c00 going to sleep for 11 seconds 00000100:00100000:0.0:1788574497.781279:0:18881:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747676416 00000100:00100000:0.0:1788574497.781300:0:18881:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747676416 00000100:00100000:0.0:1788574497.781784:0:18881:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788574497.781798:0:18881:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a786370850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:64047b6f-0fa6-4004-9f51-bd636ae04daf+5:18868:x1875455747676416:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1788574497.781867:0:18881:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:0.0:1788574497.781871:0:18881:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:0.0:1788574497.781874:0:18881:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0000 is running on 0@lo 10000000:01000000:0.0:1788574497.782305:0:18902:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:1.0:1788574497.782835:0:18881:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 8 20000000:01000000:1.0:1788574497.784182:0:18903:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 0 20000000:01000000:1.0:1788574497.784192:0:18903:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0000_UUID is 0 (0) 20000000:01000000:1.0:1788574497.784194:0:18903:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0001_UUID is 1 (1) 00000040:00080000:1.0:1788574497.784234:0:18903:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 20000000:01000000:0.0:1788574497.784948:0:18881:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:0.0:1788574497.784961:0:18881:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:1.0:1788574497.797482:0:18881:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a786370850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:64047b6f-0fa6-4004-9f51-bd636ae04daf+5:18868:x1875455747676416:12345-0@lo:253:mount.lustre.0 Request processed in 15678us (21160us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574497.797509:0:18881:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788574497.797714:0:18868:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a7a72b9180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:64047b6f-0fa6-4004-9f51-bd636ae04daf:18868:1875455747676416:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1788574497.797728:0:18868:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:0.0:1788574497.797732:0:18868:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1788574497.797734:0:18868:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1788574497.797735:0:18868:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788574497.797736:0:18868:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788574497.797738:0:18868:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788574497.797739:0:18868:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788574497.797741:0:18868:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1788574497.797742:0:18868:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1788574497.797744:0:18868:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788574497.797745:0:18868:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1788574497.797843:0:18868:0:(tgt_mount.c:101:server_register_mount()) register mount ffff90a79fbec800 from lustre-MDT0000 10000000:01000000:2.0:1788574497.797866:0:18868:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:2.0:1788574497.797882:0:18868:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:2.0:1788574497.797886:0:18868:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff90a79f8fcd40 10000000:01000000:2.0:1788574497.797893:0:18868:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1788574497.797902:0:18868:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff90a79f8fcd40 from 1 10000000:01000000:2.0:1788574497.797905:0:18868:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1788574497.797943:0:18868:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.157@tcp lock: ffff90a79e984200/0x10531a153b536ffb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 18868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574497.797954:0:18868:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.157@tcp lock: ffff90a79e984200/0x10531a153b536ffb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 18868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574497.797964:0:18868:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.157@tcp lock: ffff90a79e984200/0x10531a153b536ffb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 18868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788574497.797983:0:18868:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a7bb28b480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:64047b6f-0fa6-4004-9f51-bd636ae04daf:18868:1875455747676544:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1788574497.798022:0:18868:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788574497.798096:0:18868:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a7a76746c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788574497.798252:0:18880:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747676544 00000100:00100000:0.0:1788574497.798259:0:18880:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747676544 00000100:00100000:0.0:1788574497.798333:0:18880:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788574497.798343:0:18880:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a79e8e2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:64047b6f-0fa6-4004-9f51-bd636ae04daf+5:18868:x1875455747676544:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788574497.798356:0:18880:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788574497.798399:0:18880:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90a68116b600/0x10531a153b537002 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x10531a153b536ffb expref: -99 pid: 18880 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574497.798437:0:18880:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90a68116b600/0x10531a153b537002 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x10531a153b536ffb expref: 6 pid: 18880 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574497.798448:0:18880:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90a68116b600/0x10531a153b537002 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x10531a153b536ffb expref: 6 pid: 18880 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574497.798459:0:18880:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a68116b600, rc 0) 00000100:00100000:0.0:1788574497.798509:0:18880:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a79e8e2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:64047b6f-0fa6-4004-9f51-bd636ae04daf+6:18868:x1875455747676544:12345-0@lo:101:mount.lustre.0 Request processed in 167us (486us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574497.798515:0:18880:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788574497.798609:0:18868:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a7bb28b480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:64047b6f-0fa6-4004-9f51-bd636ae04daf:18868:1875455747676544:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788574497.798624:0:18868:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.157@tcp lock: ffff90a79e984200/0x10531a153b536ffb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x10531a153b537002 expref: -99 pid: 18868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574497.798634:0:18868:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.157@tcp lock: ffff90a79e984200/0x10531a153b536ffb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x10531a153b537002 expref: -99 pid: 18868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788574497.798696:0:18868:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a7a72b9500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:64047b6f-0fa6-4004-9f51-bd636ae04daf:18868:1875455747676672:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788574497.798723:0:18868:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788574497.798986:0:18868:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a7bb7e0a80 going to sleep for 11 seconds 00000100:00100000:2.0:1788574497.799060:0:18879:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747676672 00000100:00100000:2.0:1788574497.799066:0:18879:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747676672 00000100:00100000:2.0:1788574497.799089:0:18879:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788574497.799095:0:18879:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a79e8e3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:64047b6f-0fa6-4004-9f51-bd636ae04daf+6:18868:x1875455747676672:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788574497.799354:0:18879:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a79e8e3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:64047b6f-0fa6-4004-9f51-bd636ae04daf+6:18868:x1875455747676672:12345-0@lo:501:mount.lustre.0 Request processed in 257us (628us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788574497.799361:0:18879:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788574497.799475:0:18868:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a7a72b9500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:64047b6f-0fa6-4004-9f51-bd636ae04daf:18868:1875455747676672:0@lo:501:mount.lustre.0 10000000:01000000:1.0:1788574497.799511:0:18868:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.157@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:1.0:1788574497.799528:0:18868:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.157@tcp lock: ffff90a79e984200/0x10531a153b536ffb lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x10531a153b537002 expref: -99 pid: 18868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574497.799536:0:18868:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.157@tcp lock: ffff90a79e984200/0x10531a153b536ffb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x10531a153b537002 expref: -99 pid: 18868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788574497.799544:0:18868:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff90a79fbec800 10000000:01000000:1.0:1788574497.799560:0:18868:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1788574497.799564:0:18868:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff90a79fbec800 10000000:01000000:1.0:1788574497.799566:0:18868:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:1.0:1788574497.799569:0:18868:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff90a79fbec800 from 1 10000000:01000000:1.0:1788574497.799572:0:18868:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:1.0:1788574497.799595:0:18868:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.157@tcp lock: ffff90a790a20a00/0x10531a153b537009 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 18868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574497.799603:0:18868:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.157@tcp lock: ffff90a790a20a00/0x10531a153b537009 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 18868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574497.799613:0:18868:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.157@tcp lock: ffff90a790a20a00/0x10531a153b537009 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 18868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788574497.799628:0:18868:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a7a72b9500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:64047b6f-0fa6-4004-9f51-bd636ae04daf:18868:1875455747676800:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1788574497.799657:0:18868:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788574497.799686:0:18868:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a7bb7e0a80 going to sleep for 11 seconds 00000100:00100000:2.0:1788574497.799946:0:18879:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747676800 00000100:00100000:2.0:1788574497.799951:0:18879:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747676800 00000100:00100000:2.0:1788574497.799975:0:18879:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788574497.799981:0:18879:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a79e8e2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:64047b6f-0fa6-4004-9f51-bd636ae04daf+6:18868:x1875455747676800:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788574497.799989:0:18879:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788574497.800009:0:18879:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90a79e985a00/0x10531a153b537010 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x10531a153b537009 expref: -99 pid: 18879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574497.800025:0:18879:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90a79e985a00/0x10531a153b537010 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x10531a153b537009 expref: 7 pid: 18879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574497.800034:0:18879:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90a79e985a00/0x10531a153b537010 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x10531a153b537009 expref: 7 pid: 18879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574497.800040:0:18879:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a79e985a00, rc 0) 00000100:00100000:2.0:1788574497.800079:0:18879:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a79e8e2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:64047b6f-0fa6-4004-9f51-bd636ae04daf+7:18868:x1875455747676800:12345-0@lo:101:mount.lustre.0 Request processed in 98us (421us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574497.800085:0:18879:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788574497.800201:0:18868:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a7a72b9500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:64047b6f-0fa6-4004-9f51-bd636ae04daf:18868:1875455747676800:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788574497.800213:0:18868:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.157@tcp lock: ffff90a790a20a00/0x10531a153b537009 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x10531a153b537010 expref: -99 pid: 18868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574497.800222:0:18868:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.157@tcp lock: ffff90a790a20a00/0x10531a153b537009 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x10531a153b537010 expref: -99 pid: 18868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788574497.800242:0:18868:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.157@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:1.0:1788574497.800260:0:18868:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.157@tcp lock: ffff90a790a20a00/0x10531a153b537009 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x10531a153b537010 expref: -99 pid: 18868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574497.800266:0:18868:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.157@tcp lock: ffff90a790a20a00/0x10531a153b537009 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x10531a153b537010 expref: -99 pid: 18868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788574497.800273:0:18868:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:1.0:1788574497.800277:0:18868:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1788574497.800282:0:18868:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff90a79fbec800 10000000:01000000:1.0:1788574497.800284:0:18868:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:1.0:1788574497.800286:0:18868:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:1.0:1788574497.800288:0:18868:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:1.0:1788574497.800303:0:18868:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.157@tcp lock: ffff90a790a21e00/0x10531a153b537017 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 18868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574497.800311:0:18868:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.157@tcp lock: ffff90a790a21e00/0x10531a153b537017 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 18868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574497.800318:0:18868:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.157@tcp lock: ffff90a790a21e00/0x10531a153b537017 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 18868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788574497.800331:0:18868:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a7a72b9500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:64047b6f-0fa6-4004-9f51-bd636ae04daf:18868:1875455747676928:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1788574497.800358:0:18868:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788574497.800400:0:18868:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a7bb7e0a80 going to sleep for 11 seconds 00000100:00100000:2.0:1788574497.800503:0:18879:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747676928 00000100:00100000:2.0:1788574497.800507:0:18879:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747676928 00000100:00100000:2.0:1788574497.800525:0:18879:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788574497.800531:0:18879:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a79f2d0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:64047b6f-0fa6-4004-9f51-bd636ae04daf+7:18868:x1875455747676928:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788574497.800537:0:18879:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788574497.800545:0:18879:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90a79e985000/0x10531a153b53701e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x10531a153b537017 expref: -99 pid: 18879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574497.800683:0:18879:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90a79e985000/0x10531a153b53701e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x10531a153b537017 expref: 8 pid: 18879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574497.800692:0:18879:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90a79e985000/0x10531a153b53701e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x10531a153b537017 expref: 8 pid: 18879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574497.800698:0:18879:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a79e985000, rc 0) 00000100:00100000:2.0:1788574497.800734:0:18879:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a79f2d0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:64047b6f-0fa6-4004-9f51-bd636ae04daf+8:18868:x1875455747676928:12345-0@lo:101:mount.lustre.0 Request processed in 203us (375us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574497.800750:0:18879:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788574497.800822:0:18868:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a7a72b9500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:64047b6f-0fa6-4004-9f51-bd636ae04daf:18868:1875455747676928:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788574497.800833:0:18868:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.157@tcp lock: ffff90a790a21e00/0x10531a153b537017 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x10531a153b53701e expref: -99 pid: 18868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574497.800849:0:18868:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.157@tcp lock: ffff90a790a21e00/0x10531a153b537017 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x10531a153b53701e expref: -99 pid: 18868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788574497.800897:0:18868:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a7a72b9500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:64047b6f-0fa6-4004-9f51-bd636ae04daf:18868:1875455747677056:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788574497.800922:0:18868:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788574497.801065:0:18868:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a7bb7e0a80 going to sleep for 11 seconds 00000100:00100000:0.0:1788574497.801110:0:18880:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747677056 00000100:00100000:0.0:1788574497.801115:0:18880:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747677056 00000100:00100000:3.0:1788574497.801358:0:18880:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788574497.801381:0:18880:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a79f2d0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:64047b6f-0fa6-4004-9f51-bd636ae04daf+8:18868:x1875455747677056:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788574497.801988:0:18880:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a79f2d0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:64047b6f-0fa6-4004-9f51-bd636ae04daf+9:18868:x1875455747677056:12345-0@lo:501:mount.lustre.0 Request processed in 620us (1061us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574497.801997:0:18880:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788574497.802101:0:18868:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a7a72b9500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:64047b6f-0fa6-4004-9f51-bd636ae04daf:18868:1875455747677056:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788574497.802223:0:18868:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a6839d2a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:64047b6f-0fa6-4004-9f51-bd636ae04daf:18868:1875455747677184:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788574497.802273:0:18868:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788574497.802782:0:18868:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a7852ac000 going to sleep for 11 seconds 00000100:00100000:2.0:1788574497.802861:0:18879:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747677184 00000100:00100000:2.0:1788574497.802871:0:18879:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747677184 00000100:00100000:2.0:1788574497.802912:0:18879:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788574497.802922:0:18879:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a79f2d0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:64047b6f-0fa6-4004-9f51-bd636ae04daf+9:18868:x1875455747677184:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788574497.803726:0:18879:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a79f2d0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:64047b6f-0fa6-4004-9f51-bd636ae04daf+9:18868:x1875455747677184:12345-0@lo:503:mount.lustre.0 Request processed in 798us (1445us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574497.803739:0:18879:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788574497.803858:0:18868:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a6839d2a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:64047b6f-0fa6-4004-9f51-bd636ae04daf:18868:1875455747677184:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788574497.804476:0:18904:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a7bb28b480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:64047b6f-0fa6-4004-9f51-bd636ae04daf:18904:1875455747677312:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788574497.804742:0:18904:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788574497.804774:0:18879:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747677312 00000100:00100000:2.0:1788574497.804780:0:18879:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747677312 00000100:00100000:2.0:1788574497.804810:0:18879:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788574497.804817:0:18879:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a79f2d2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:64047b6f-0fa6-4004-9f51-bd636ae04daf+9:18904:x1875455747677312:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788574497.805188:0:18879:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a79f2d2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:64047b6f-0fa6-4004-9f51-bd636ae04daf+9:18904:x1875455747677312:12345-0@lo:502:llog_process_th.0 Request processed in 302us (378us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574497.805398:0:18879:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788574497.805446:0:18904:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a7921be300 going to sleep for 11 seconds 00000100:00100000:2.0:1788574497.805465:0:18904:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a7bb28b480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:64047b6f-0fa6-4004-9f51-bd636ae04daf:18904:1875455747677312:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788574497.805502:0:18904:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788574497.805513:0:18904:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788574497.805516:0:18904:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:2.0:1788574497.805521:0:18904:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:2.0:1788574497.805523:0:18904:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1788574497.805536:0:18904:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (ffff90a79f8fb380) 00000020:00000080:2.0:1788574497.805678:0:18904:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:2.0:1788574497.805693:0:18904:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:2.0:1788574497.805753:0:18904:0:(osd_handler.c:1574:osd_obd_connect()) connect #2 00000020:00000080:2.0:1788574497.805761:0:18904:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x10531a153b53702c 00000020:00000080:2.0:1788574497.805964:0:18904:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:2.0:1788574497.805969:0:18904:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788574497.805972:0:18904:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788574497.805973:0:18904:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:2.0:1788574497.805976:0:18904:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788574497.805980:0:18904:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788574497.805981:0:18904:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:2.0:1788574497.805984:0:18904:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1788574497.805990:0:18904:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (ffff90a79f8f8000) 00000020:00000080:2.0:1788574497.805998:0:18904:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:2.0:1788574497.806001:0:18904:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:2.0:1788574497.806003:0:18904:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:2.0:1788574497.806006:0:18904:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:2.0:1788574497.806012:0:18904:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:2.0:1788574497.806044:0:18904:0:(tgt_mount.c:153:server_get_mount()) get mount ffff90a79fbec800 from lustre-MDT0000, refs=3 00000020:00000080:2.0:1788574497.806053:0:18904:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (ffff90a79f8f99c0) 00000020:00000080:2.0:1788574497.806060:0:18904:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:2.0:1788574497.806096:0:18904:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:2.0:1788574497.806103:0:18904:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x10531a153b537041 00000020:00000080:2.0:1788574497.806330:0:18904:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:2.0:1788574497.806336:0:18904:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:2.0:1788574497.806340:0:18904:0:(genops.c:1385:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0x10531a153b537048 00080000:01000000:2.0:1788574497.806345:0:18904:0:(osd_handler.c:1574:osd_obd_connect()) connect #3 00000020:00000080:2.0:1788574497.806349:0:18904:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x10531a153b53704f 00010000:00010000:3.0:1788574497.919351:0:18904:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:00000004:3.0:1788574497.920071:0:18904:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 3, last_transno is 8589934627 00000001:00080000:3.0:1788574497.920294:0:18904:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:3.0:1788574497.925512:0:18904:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (ffff90a791dccd40) 00000020:00000080:3.0:1788574497.925540:0:18904:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:3.0:1788574497.926235:0:18904:0:(osd_handler.c:1574:osd_obd_connect()) connect #4 00000020:00000080:3.0:1788574497.926246:0:18904:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x10531a153b53705d 00000020:00000080:3.0:1788574497.928344:0:18904:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:3.0:1788574497.952673:0:18904:0:(genops.c:1385:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0x10531a153b537064 00000020:00000080:1.0:1788574497.956619:0:18904:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:1.0:1788574497.956640:0:18904:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788574497.956651:0:18904:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788574497.956654:0:18904:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:1.0:1788574497.956669:0:18904:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788574497.956678:0:18904:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788574497.956679:0:18904:0:(obd_config.c:1563:class_process_config()) marker 8 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:1.0:1788574497.956683:0:18904:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:1.0:1788574497.956745:0:18904:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:1.0:1788574497.956769:0:18904:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788574497.956773:0:18904:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788574497.956775:0:18904:0:(obd_config.c:1563:class_process_config()) marker 8 (0x2) lustre-MDT0000 mdt.identity_upcall 00000020:01000000:1.0:1788574497.956778:0:18904:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1788574497.956780:0:18904:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #9 00000020:01000000:1.0:1788574497.956783:0:18904:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1788574497.956785:0:18904:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1788574497.956786:0:18904:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1788574497.956789:0:18904:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788574497.956791:0:18904:0:(obd_config.c:1563:class_process_config()) marker 9 (0x6) lustre sys.timeout 00000020:01000000:1.0:1788574497.956793:0:18904:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1788574497.956797:0:18904:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-mdt1/mdt1 00000020:00000080:1.0:1788574497.956801:0:18904:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788574497.956803:0:18904:0:(obd_config.c:1563:class_process_config()) marker 12 (0x1) lustre-OST0000 add osc 00000020:00000080:1.0:1788574497.956806:0:18904:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1788574497.956829:0:18904:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.201.157@tcp to nid 0x20000c0a8c99d (192.168.201.157@tcp) 00000020:01000000:1.0:1788574497.956863:0:18904:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:1.0:1788574497.956866:0:18904:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1788574497.956885:0:18904:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff90a7a74599c0) 00000020:00000080:1.0:1788574497.957854:0:18904:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type osp with refcount 2 00000020:00000080:1.0:1788574497.957873:0:18904:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1788574497.958038:0:18904:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:1.0:1788574497.958044:0:18904:0:(osd_handler.c:1574:osd_obd_connect()) connect #5 00000020:00000080:1.0:1788574497.958054:0:18904:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x10531a153b537072 00010000:00080000:1.0:1788574497.958097:0:18904:0:(ldlm_lib.c:102:import_set_conn()) imp ffff90a7b1b65000@lustre-OST0000-osc-MDT0000: add connection 192.168.201.157@tcp at head 00010000:00010000:1.0:1788574497.958716:0:18904:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-1 is initialized 00000040:01000000:1.0:1788574497.962653:0:18904:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:1.0:1788574497.962723:0:18904:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:1.0:1788574497.967301:0:18904:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788574497.967399:0:18904:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].3, 64 off8384 00000040:00080000:1.0:1788574497.967472:0:18904:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x10:0x0].1, 64 off8256 00000040:00080000:2.0:1788574497.971670:0:18908:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:2.0:1788574497.971678:0:18908:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x10:0x0] at index 3 of catalog [0x1:0x2:0x0] 00000020:00000080:0.0:1788574497.983781:0:18904:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1788574497.983805:0:18904:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:0.0:1788574497.983860:0:18904:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:0.0:1788574497.983885:0:18904:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x10531a153b537079 00000100:00080000:0.0:1788574497.983898:0:18904:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1788574497.983972:0:18904:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff90a7b1b65000 using connection 192.168.201.157@tcp/0@lo 00000100:00100000:0.0:1788574497.984007:0:18904:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff90a6839d2a00 x1875455747677440/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788574497.984073:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a6839d2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3311:1875455747677440:0@lo:8:llog_process_th.0 00000400:00000100:2.0:1788574497.984146:0:3311:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875455747677440 offset 0 length 520: 4 00000100:00080000:0.0:1788574497.985015:0:18904:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:0.0:1788574497.985099:0:18904:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788574497.985253:0:18904:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788574497.985256:0:18904:0:(obd_config.c:1563:class_process_config()) marker 12 (0x2) lustre-OST0000 add osc 00000020:01000000:0.0:1788574497.985261:0:18904:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:0.0:1788574497.985265:0:18904:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #14 00000020:01000000:0.0:1788574497.985266:0:18904:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1788574497.985268:0:18904:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1788574497.985270:0:18904:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:0.0:1788574497.985272:0:18904:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788574497.985274:0:18904:0:(obd_config.c:1563:class_process_config()) marker 14 (0x6) lustre sys.timeout 00000020:01000000:0.0:1788574497.985276:0:18904:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1788574497.985281:0:18904:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-mdt1/mdt1 00000020:00000080:0.0:1788574497.985284:0:18904:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788574497.985285:0:18904:0:(obd_config.c:1563:class_process_config()) marker 18 (0x1) lustre-OST0001 add osc 00000020:00000080:0.0:1788574497.985288:0:18904:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:0.0:1788574497.985292:0:18904:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.201.157@tcp to nid 0x20000c0a8c99d (192.168.201.157@tcp) 00000020:01000000:0.0:1788574497.985315:0:18904:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:0.0:1788574497.985318:0:18904:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1788574497.985330:0:18904:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff90a79241b380) 00000020:00000080:0.0:1788574497.985348:0:18904:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osp with refcount 2 00000020:00000080:0.0:1788574497.985353:0:18904:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:0.0:1788574497.985436:0:18904:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:0.0:1788574497.985442:0:18904:0:(osd_handler.c:1574:osd_obd_connect()) connect #6 00000020:00000080:0.0:1788574497.985447:0:18904:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x10531a153b537087 00010000:00080000:0.0:1788574497.985474:0:18904:0:(ldlm_lib.c:102:import_set_conn()) imp ffff90a786924800@lustre-OST0001-osc-MDT0000: add connection 192.168.201.157@tcp at head 00010000:00010000:0.0:1788574497.985736:0:18904:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-2 is initialized 00000100:00100000:1.0:1788574497.986434:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a7bbebc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:64047b6f-0fa6-4004-9f51-bd636ae04daf:3313:1875455747677568:0@lo:400:kworker.0 00000100:00100000:1.0:1788574497.986499:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788574497.986622:0:18881:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747677568 00000100:00100000:3.0:1788574497.986631:0:18881:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747677568 00000100:00100000:3.0:1788574497.986687:0:18881:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788574497.986698:0:18881:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a79f2d1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:64047b6f-0fa6-4004-9f51-bd636ae04daf+9:3313:x1875455747677568:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788574497.986762:0:18881:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a79f2d1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:64047b6f-0fa6-4004-9f51-bd636ae04daf+9:3313:x1875455747677568:12345-0@lo:400:kworker.0 Request processed in 66us (263us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574497.986769:0:18881:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788574497.986849:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a7bbebc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:64047b6f-0fa6-4004-9f51-bd636ae04daf:3313:1875455747677568:0@lo:400:kworker.0 00000040:01000000:0.0:1788574497.986977:0:18904:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:0.0:1788574497.987004:0:18904:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:0.0:1788574497.988272:0:18904:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788574497.988342:0:18904:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].3, 64 off8384 00000040:00080000:0.0:1788574497.988448:0:18904:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x12:0x0].1, 64 off8256 00000040:00080000:2.0:1788574497.988974:0:18910:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:2.0:1788574497.988987:0:18910:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x12:0x0] at index 3 of catalog [0x1:0x5:0x0] 00000020:00000080:0.0:1788574498.000794:0:18904:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1788574498.000812:0:18904:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:0.0:1788574498.000865:0:18904:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:0.0:1788574498.000884:0:18904:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x10531a153b53708e 00000100:00080000:0.0:1788574498.000896:0:18904:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1788574498.000902:0:18904:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff90a786924800 using connection 192.168.201.157@tcp/0@lo 00000100:00100000:0.0:1788574498.000938:0:18904:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff90a6839d2d80 x1875455747677696/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788574498.001009:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a6839d2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3311:1875455747677696:0@lo:8:llog_process_th.0 00000400:00000100:2.0:1788574498.001081:0:3311:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875455747677696 offset 0 length 520: 4 00000100:00080000:0.0:1788574498.001146:0:18904:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:0.0:1788574498.001316:0:18904:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788574498.001321:0:18904:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788574498.001323:0:18904:0:(obd_config.c:1563:class_process_config()) marker 18 (0x2) lustre-OST0001 add osc 00000020:01000000:0.0:1788574498.001327:0:18904:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788574498.001331:0:18904:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788574498.001332:0:18904:0:(obd_config.c:1563:class_process_config()) marker 21 (0x1) lustre sys.timeout 00000020:00000080:0.0:1788574498.001335:0:18904:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1788574498.001336:0:18904:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:0.0:1788574498.001339:0:18904:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788574498.001341:0:18904:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788574498.001342:0:18904:0:(obd_config.c:1563:class_process_config()) marker 21 (0x2) lustre sys.timeout 00000020:01000000:0.0:1788574498.001345:0:18904:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788574498.001347:0:18904:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788574498.001349:0:18904:0:(obd_config.c:1563:class_process_config()) marker 25 (0x1) lustre sys.jobid_var 00000020:00000080:0.0:1788574498.001352:0:18904:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:0.0:1788574498.001419:0:18904:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a6839d1180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:64047b6f-0fa6-4004-9f51-bd636ae04daf:18904:1875455747677824:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788574498.001470:0:18904:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788574498.001498:0:18904:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a7852acc00 going to sleep for 11 seconds 00000100:00100000:3.0:1788574498.001702:0:18880:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747677824 00000100:00100000:3.0:1788574498.001711:0:18880:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747677824 00000100:00100000:3.0:1788574498.001749:0:18880:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1788574498.001760:0:18880:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a79f2d0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:64047b6f-0fa6-4004-9f51-bd636ae04daf+9:18904:x1875455747677824:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788574498.002065:0:18880:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a79f2d0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:64047b6f-0fa6-4004-9f51-bd636ae04daf+9:18904:x1875455747677824:12345-0@lo:502:llog_process_th.0 Request processed in 306us (593us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574498.002081:0:18880:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788574498.002438:0:18904:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a6839d1180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:64047b6f-0fa6-4004-9f51-bd636ae04daf:18904:1875455747677824:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1788574498.002471:0:18904:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788574498.002477:0:18904:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788574498.002479:0:18904:0:(obd_config.c:1563:class_process_config()) marker 25 (0x2) lustre sys.jobid_var 00000040:00080000:0.0:1788574498.002483:0:18904:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 37 count 37 00000020:01000000:1.0:1788574498.004482:0:18868:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-36 (rc=0) 10000000:01000000:1.0:1788574498.004518:0:18868:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.157@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:1.0:1788574498.004548:0:18868:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.157@tcp lock: ffff90a790a21e00/0x10531a153b537017 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x10531a153b53701e expref: -99 pid: 18868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574498.004560:0:18868:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.157@tcp lock: ffff90a790a21e00/0x10531a153b537017 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x10531a153b53701e expref: -99 pid: 18868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788574498.004569:0:18868:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff90a79fbec800 from 1 10000000:01000000:1.0:1788574498.004572:0:18868:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1788574498.004630:0:18868:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.157@tcp lock: ffff90a790a21c00/0x10531a153b537095 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 18868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574498.004639:0:18868:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.157@tcp lock: ffff90a790a21c00/0x10531a153b537095 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 18868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574498.004650:0:18868:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.157@tcp lock: ffff90a790a21c00/0x10531a153b537095 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 18868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788574498.004687:0:18868:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a7a72bb800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:64047b6f-0fa6-4004-9f51-bd636ae04daf:18868:1875455747677952:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1788574498.004752:0:18868:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788574498.010823:0:18879:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747677952 00000100:00100000:2.0:1788574498.010841:0:18879:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747677952 00000100:00100000:3.0:1788574498.010869:0:18868:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a7bb7e00c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788574498.010996:0:18879:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788574498.011009:0:18879:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a79f2d2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:64047b6f-0fa6-4004-9f51-bd636ae04daf+9:18868:x1875455747677952:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788574498.011026:0:18879:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788574498.011049:0:18879:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90a78165a800/0x10531a153b53709c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x10531a153b537095 expref: -99 pid: 18879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574498.011077:0:18879:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90a78165a800/0x10531a153b53709c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x10531a153b537095 expref: 10 pid: 18879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574498.011088:0:18879:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90a78165a800/0x10531a153b53709c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x10531a153b537095 expref: 10 pid: 18879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574498.011097:0:18879:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a78165a800, rc 0) 00000100:00100000:0.0:1788574498.011333:0:18868:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a7a72bb800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:64047b6f-0fa6-4004-9f51-bd636ae04daf:18868:1875455747677952:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788574498.011398:0:18868:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.157@tcp lock: ffff90a790a21c00/0x10531a153b537095 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x10531a153b53709c expref: -99 pid: 18868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574498.011409:0:18868:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.157@tcp lock: ffff90a790a21c00/0x10531a153b537095 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x10531a153b53709c expref: -99 pid: 18868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788574498.011986:0:18868:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a6839d1180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:64047b6f-0fa6-4004-9f51-bd636ae04daf:18868:1875455747678080:0@lo:256:mount.lustre.0 00000100:00100000:0.0:1788574498.012050:0:18868:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788574498.012098:0:18879:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a79f2d2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:64047b6f-0fa6-4004-9f51-bd636ae04daf+10:18868:x1875455747677952:12345-0@lo:101:mount.lustre.0 Request processed in 182us (6434us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574498.012108:0:18879:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788574498.014524:0:18868:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a7852acc00 going to sleep for 11 seconds 00000100:00100000:3.0:1788574498.015498:0:18879:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747678080 00000100:00100000:3.0:1788574498.015515:0:18879:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747678080 00000100:00100000:3.0:1788574498.015575:0:18879:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788574498.015586:0:18879:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a79f2d3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:64047b6f-0fa6-4004-9f51-bd636ae04daf+10:18868:x1875455747678080:12345-0@lo:256:mount.lustre.0 20000000:01000000:3.0:1788574498.015618:0:18879:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:3.0:1788574498.015626:0:18879:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:3.0:1788574498.015755:0:18879:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a79f2d3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:64047b6f-0fa6-4004-9f51-bd636ae04daf+10:18868:x1875455747678080:12345-0@lo:256:mount.lustre.0 Request processed in 170us (3705us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574498.015762:0:18879:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788574498.016171:0:18868:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a6839d1180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:64047b6f-0fa6-4004-9f51-bd636ae04daf:18868:1875455747678080:0@lo:256:mount.lustre.0 10000000:01000000:0.0:1788574498.016790:0:18868:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.157@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1788574498.016813:0:18868:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.157@tcp lock: ffff90a790a21c00/0x10531a153b537095 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x10531a153b53709c expref: -99 pid: 18868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574498.016826:0:18868:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.157@tcp lock: ffff90a790a21c00/0x10531a153b537095 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x10531a153b53709c expref: -99 pid: 18868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788574498.016849:0:18868:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff90a79fbec800 from 1 10000000:01000000:0.0:1788574498.016852:0:18868:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788574498.016892:0:18868:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.157@tcp lock: ffff90a68116a000/0x10531a153b5370a3 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 18868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574498.016900:0:18868:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.157@tcp lock: ffff90a68116a000/0x10531a153b5370a3 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 18868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574498.016909:0:18868:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.157@tcp lock: ffff90a68116a000/0x10531a153b5370a3 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 18868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788574498.016932:0:18868:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a6839d1180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:64047b6f-0fa6-4004-9f51-bd636ae04daf:18868:1875455747678208:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1788574498.016987:0:18868:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788574498.017016:0:18868:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a7852acc00 going to sleep for 11 seconds 00000100:00100000:3.0:1788574498.017666:0:18879:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747678208 00000100:00100000:3.0:1788574498.017674:0:18879:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747678208 00000100:00100000:3.0:1788574498.017712:0:18879:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1788574498.017721:0:18879:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a79f2d3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:64047b6f-0fa6-4004-9f51-bd636ae04daf+10:18868:x1875455747678208:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788574498.017732:0:18879:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788574498.017748:0:18879:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90a78165a000/0x10531a153b5370aa lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x10531a153b5370a3 expref: -99 pid: 18879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574498.017770:0:18879:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90a78165a000/0x10531a153b5370aa lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x10531a153b5370a3 expref: 11 pid: 18879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574498.017781:0:18879:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90a78165a000/0x10531a153b5370aa lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x10531a153b5370a3 expref: 11 pid: 18879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574498.017789:0:18879:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a78165a000, rc 0) 00000100:00100000:3.0:1788574498.017839:0:18879:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a79f2d3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:64047b6f-0fa6-4004-9f51-bd636ae04daf+11:18868:x1875455747678208:12345-0@lo:101:mount.lustre.0 Request processed in 118us (851us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574498.017844:0:18879:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788574498.017958:0:18868:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a6839d1180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:64047b6f-0fa6-4004-9f51-bd636ae04daf:18868:1875455747678208:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788574498.017973:0:18868:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.157@tcp lock: ffff90a68116a000/0x10531a153b5370a3 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x10531a153b5370aa expref: -99 pid: 18868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574498.017983:0:18868:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.157@tcp lock: ffff90a68116a000/0x10531a153b5370a3 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x10531a153b5370aa expref: -99 pid: 18868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788574498.018040:0:18868:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a6839d1180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:64047b6f-0fa6-4004-9f51-bd636ae04daf:18868:1875455747678336:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788574498.018068:0:18868:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788574498.018101:0:18868:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a7852acc00 going to sleep for 11 seconds 00000100:00100000:3.0:1788574498.018333:0:18881:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747678336 00000100:00100000:3.0:1788574498.018339:0:18881:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747678336 00000100:00100000:3.0:1788574498.018359:0:18881:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1788574498.018364:0:18881:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a79f2d3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:64047b6f-0fa6-4004-9f51-bd636ae04daf+11:18868:x1875455747678336:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788574498.018764:0:18881:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a79f2d3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:64047b6f-0fa6-4004-9f51-bd636ae04daf+11:18868:x1875455747678336:12345-0@lo:501:mount.lustre.0 Request processed in 398us (694us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574498.018771:0:18881:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1788574498.018872:0:18868:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a6839d1180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:64047b6f-0fa6-4004-9f51-bd636ae04daf:18868:1875455747678336:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788574498.018906:0:18868:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a6839d1180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:64047b6f-0fa6-4004-9f51-bd636ae04daf:18868:1875455747678464:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788574498.018947:0:18868:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788574498.018967:0:18868:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a7852acc00 going to sleep for 11 seconds 00000100:00100000:3.0:1788574498.019016:0:18881:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747678464 00000100:00100000:3.0:1788574498.019021:0:18881:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747678464 00000100:00100000:3.0:1788574498.019039:0:18881:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1788574498.019045:0:18881:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a79f2d1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:64047b6f-0fa6-4004-9f51-bd636ae04daf+11:18868:x1875455747678464:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788574498.019629:0:18881:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a79f2d1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:64047b6f-0fa6-4004-9f51-bd636ae04daf+11:18868:x1875455747678464:12345-0@lo:503:mount.lustre.0 Request processed in 581us (679us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574498.019636:0:18881:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1788574498.025504:0:18868:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a6839d1180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:64047b6f-0fa6-4004-9f51-bd636ae04daf:18868:1875455747678464:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788574498.026850:0:18912:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a7a72baa00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:64047b6f-0fa6-4004-9f51-bd636ae04daf:18912:1875455747678592:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788574498.026934:0:18912:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788574498.026979:0:18912:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a7bb7e00c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788574498.027041:0:18879:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747678592 00000100:00100000:2.0:1788574498.027047:0:18879:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747678592 00000100:00100000:2.0:1788574498.027093:0:18879:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1788574498.027110:0:18879:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a79f2d2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:64047b6f-0fa6-4004-9f51-bd636ae04daf+11:18912:x1875455747678592:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788574498.027548:0:18879:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a79f2d2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:64047b6f-0fa6-4004-9f51-bd636ae04daf+11:18912:x1875455747678592:12345-0@lo:502:llog_process_th.0 Request processed in 447us (614us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574498.027557:0:18879:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1788574498.029680:0:18912:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a7a72baa00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:64047b6f-0fa6-4004-9f51-bd636ae04daf:18912:1875455747678592:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788574498.029746:0:18912:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788574498.029764:0:18912:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788574498.029768:0:18912:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:1.0:1788574498.029778:0:18912:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff90a79fbec800 00000020:00000080:1.0:1788574498.029782:0:18912:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1788574498.029791:0:18912:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788574498.029793:0:18912:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788574498.029795:0:18912:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:1.0:1788574498.029798:0:18912:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788574498.029800:0:18912:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788574498.029802:0:18912:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:1.0:1788574498.029805:0:18912:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff90a79fbec800 00000020:00000080:1.0:1788574498.029807:0:18912:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1788574498.029880:0:18912:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788574498.029884:0:18912:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788574498.029897:0:18912:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:1.0:1788574498.029900:0:18912:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788574498.029903:0:18912:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788574498.029905:0:18912:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1788574498.029908:0:18912:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff90a79fbec800 00000020:00000080:1.0:1788574498.029911:0:18912:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1788574498.029981:0:18912:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a7a72baa00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:64047b6f-0fa6-4004-9f51-bd636ae04daf:18912:1875455747678720:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788574498.030058:0:18912:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788574498.030122:0:18912:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a7bb7e00c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788574498.030526:0:18880:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747678720 00000100:00100000:3.0:1788574498.030536:0:18880:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747678720 00000100:00100000:3.0:1788574498.030581:0:18880:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1788574498.030590:0:18880:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7bbc70450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:64047b6f-0fa6-4004-9f51-bd636ae04daf+11:18912:x1875455747678720:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788574498.030872:0:18880:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7bbc70450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:64047b6f-0fa6-4004-9f51-bd636ae04daf+11:18912:x1875455747678720:12345-0@lo:502:llog_process_th.0 Request processed in 282us (813us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574498.030881:0:18880:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1788574498.033822:0:18912:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a7a72baa00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:64047b6f-0fa6-4004-9f51-bd636ae04daf:18912:1875455747678720:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788574498.033876:0:18912:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788574498.033888:0:18912:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788574498.033891:0:18912:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:1.0:1788574498.033896:0:18912:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:0.0:1788574498.034333:0:18868:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-9 (rc=0) 10000000:01000000:0.0:1788574498.034358:0:18868:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.157@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788574498.034413:0:18868:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.157@tcp lock: ffff90a68116a000/0x10531a153b5370a3 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x10531a153b5370aa expref: -99 pid: 18868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574498.034425:0:18868:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.157@tcp lock: ffff90a68116a000/0x10531a153b5370a3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x10531a153b5370aa expref: -99 pid: 18868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788574498.034479:0:18868:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:0.0:1788574498.034491:0:18868:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff90a79fbec800 10000000:01000000:0.0:1788574498.034494:0:18868:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff90a79fbec800 10000000:01000000:0.0:1788574498.034499:0:18868:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1788574498.034505:0:18868:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff90a79fbec800 from 1 10000000:01000000:0.0:1788574498.034507:0:18868:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1788574498.034549:0:18868:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.157@tcp lock: ffff90a68116b400/0x10531a153b5370b1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 18868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574498.034558:0:18868:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.157@tcp lock: ffff90a68116b400/0x10531a153b5370b1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 18868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574498.034568:0:18868:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.157@tcp lock: ffff90a68116b400/0x10531a153b5370b1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 18868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788574498.034589:0:18868:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a6839d1180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:64047b6f-0fa6-4004-9f51-bd636ae04daf:18868:1875455747678848:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1788574498.034652:0:18868:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788574498.034703:0:18868:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a7852acd80 going to sleep for 11 seconds 00000100:00100000:3.0:1788574498.034775:0:18879:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747678848 00000100:00100000:3.0:1788574498.034784:0:18879:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747678848 00000100:00100000:3.0:1788574498.034842:0:18879:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1788574498.034853:0:18879:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7bbc72450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:64047b6f-0fa6-4004-9f51-bd636ae04daf+11:18868:x1875455747678848:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788574498.034868:0:18879:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788574498.034885:0:18879:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90a78165ba00/0x10531a153b5370b8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x10531a153b5370b1 expref: -99 pid: 18879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574498.034914:0:18879:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90a78165ba00/0x10531a153b5370b8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x10531a153b5370b1 expref: 12 pid: 18879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574498.034926:0:18879:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90a78165ba00/0x10531a153b5370b8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x10531a153b5370b1 expref: 12 pid: 18879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574498.034937:0:18879:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a78165ba00, rc 0) 00000100:00100000:3.0:1788574498.034996:0:18879:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7bbc72450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:64047b6f-0fa6-4004-9f51-bd636ae04daf+12:18868:x1875455747678848:12345-0@lo:101:mount.lustre.0 Request processed in 144us (343us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574498.035013:0:18879:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1788574498.035164:0:18868:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a6839d1180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:64047b6f-0fa6-4004-9f51-bd636ae04daf:18868:1875455747678848:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788574498.035191:0:18868:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.157@tcp lock: ffff90a68116b400/0x10531a153b5370b1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x10531a153b5370b8 expref: -99 pid: 18868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574498.035201:0:18868:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.157@tcp lock: ffff90a68116b400/0x10531a153b5370b1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x10531a153b5370b8 expref: -99 pid: 18868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788574498.035260:0:18868:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a7bb28b480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:64047b6f-0fa6-4004-9f51-bd636ae04daf:18868:1875455747678976:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788574498.035288:0:18868:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788574498.035311:0:18868:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a78e0b73c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788574498.035435:0:18881:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747678976 00000100:00100000:1.0:1788574498.035440:0:18881:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747678976 00000100:00100000:1.0:1788574498.035472:0:18881:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1788574498.035479:0:18881:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7a74f5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:64047b6f-0fa6-4004-9f51-bd636ae04daf+12:18868:x1875455747678976:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788574498.035756:0:18881:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7a74f5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:64047b6f-0fa6-4004-9f51-bd636ae04daf+12:18868:x1875455747678976:12345-0@lo:501:mount.lustre.0 Request processed in 277us (466us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574498.035763:0:18881:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1788574498.035934:0:18868:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a7bb28b480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:64047b6f-0fa6-4004-9f51-bd636ae04daf:18868:1875455747678976:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788574498.035966:0:18868:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a7bb28b480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:64047b6f-0fa6-4004-9f51-bd636ae04daf:18868:1875455747679104:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788574498.036004:0:18868:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788574498.036027:0:18868:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a78e0b73c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788574498.036072:0:18881:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747679104 00000100:00100000:1.0:1788574498.036076:0:18881:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747679104 00000100:00100000:1.0:1788574498.036106:0:18881:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1788574498.036113:0:18881:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7a74f7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:64047b6f-0fa6-4004-9f51-bd636ae04daf+12:18868:x1875455747679104:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788574498.036292:0:18881:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7a74f7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:64047b6f-0fa6-4004-9f51-bd636ae04daf+12:18868:x1875455747679104:12345-0@lo:503:mount.lustre.0 Request processed in 179us (287us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574498.036298:0:18881:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1788574498.037403:0:18868:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a7bb28b480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:64047b6f-0fa6-4004-9f51-bd636ae04daf:18868:1875455747679104:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788574498.040631:0:18914:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a7a72baa00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:64047b6f-0fa6-4004-9f51-bd636ae04daf:18914:1875455747679232:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788574498.040733:0:18914:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788574498.040778:0:18914:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a7bb7e0c00 going to sleep for 11 seconds 00000100:00100000:3.0:1788574498.040812:0:18881:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747679232 00000100:00100000:3.0:1788574498.040822:0:18881:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747679232 00000100:00100000:3.0:1788574498.040885:0:18881:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1788574498.040897:0:18881:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7a74f6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:64047b6f-0fa6-4004-9f51-bd636ae04daf+12:18914:x1875455747679232:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788574498.041328:0:18881:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7a74f6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:64047b6f-0fa6-4004-9f51-bd636ae04daf+12:18914:x1875455747679232:12345-0@lo:502:llog_process_th.0 Request processed in 432us (595us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574498.041336:0:18881:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1788574498.041824:0:18914:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a7a72baa00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:64047b6f-0fa6-4004-9f51-bd636ae04daf:18914:1875455747679232:0@lo:502:llog_process_th.0 00000020:01000004:1.0:1788574498.041911:0:18914:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:1.0:1788574498.041933:0:18914:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (ffff90a7a745cd40) 00000020:00000080:1.0:1788574498.041957:0:18914:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type lwp with refcount 2 00000020:01000004:1.0:1788574498.042059:0:18914:0:(tgt_mount.c:153:server_get_mount()) get mount ffff90a79fbec800 from lustre-MDT0000, refs=4 00000020:01000004:1.0:1788574498.042063:0:18914:0:(tgt_mount.c:187:server_put_mount()) put mount ffff90a79fbec800 from lustre-MDT0000, refs=4 00000020:01000004:1.0:1788574498.042066:0:18914:0:(obd_mount.c:710:lustre_put_lsi()) put ffff90a79fbec800 4 00010000:00080000:1.0:1788574498.042094:0:18914:0:(ldlm_lib.c:102:import_set_conn()) imp ffff90a79e97f000@lustre-MDT0000-lwp-MDT0000: add connection 192.168.201.157@tcp at head 00010000:00010000:2.0:1788574498.059537:0:18914:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-3 is initialized 00000020:00000080:2.0:1788574498.059827:0:18914:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:2.0:1788574498.059877:0:18914:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1788574498.059899:0:18914:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0x10531a153b5370c6 00000100:00080000:2.0:1788574498.059912:0:18914:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1788574498.059920:0:18914:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff90a79e97f000 using connection 192.168.201.157@tcp/0@lo 00000100:00100000:2.0:1788574498.059975:0:18914:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff90a7bb28b480 x1875455747679360/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788574498.060024:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a7bb28b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3311:1875455747679360:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1788574498.060125:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788574498.060306:0:18886:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747679360 00000100:00100000:3.0:1788574498.060315:0:18886:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747679360 00000100:00100000:3.0:1788574498.060349:0:18886:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788574498.060357:0:18886:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7bb28ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3311:x1875455747679360:12345-0@lo:38:llog_process_th.0 00000100:00100000:3.0:1788574498.060480:0:18886:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7bb28ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3311:x1875455747679360:12345-0@lo:38:llog_process_th.0 Request processed in 121us (354us total) trans 0 rc -11/-11 00000100:00100000:3.0:1788574498.060487:0:18886:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788574498.060501:0:3311:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1788574498.060511:0:3311:0:(import.c:65:import_set_state_nolock()) ffff90a79e97f000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788574498.060525:0:3311:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:2.0:1788574498.060529:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a7bb28b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3311:1875455747679360:0@lo:38:llog_process_th.0 00000100:00080000:2.0:1788574498.060564:0:18914:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:2.0:1788574498.061140:0:18914:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a7bb28b480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:64047b6f-0fa6-4004-9f51-bd636ae04daf:18914:1875455747679488:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788574498.061312:0:18914:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788574498.061340:0:18914:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a793221480 going to sleep for 11 seconds 00000100:00100000:2.0:1788574498.061356:0:18879:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747679488 00000100:00100000:2.0:1788574498.061361:0:18879:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747679488 00000100:00100000:2.0:1788574498.061430:0:18879:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1788574498.061438:0:18879:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7a74f7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:64047b6f-0fa6-4004-9f51-bd636ae04daf+12:18914:x1875455747679488:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788574498.061998:0:18879:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7a74f7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:64047b6f-0fa6-4004-9f51-bd636ae04daf+12:18914:x1875455747679488:12345-0@lo:502:llog_process_th.0 Request processed in 558us (683us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574498.062016:0:18879:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1788574498.062076:0:18914:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a7bb28b480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:64047b6f-0fa6-4004-9f51-bd636ae04daf:18914:1875455747679488:0@lo:502:llog_process_th.0 00000040:00080000:2.0:1788574498.062267:0:18914:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:1.0:1788574498.062566:0:18868:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:1.0:1788574498.062588:0:18868:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.157@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1788574498.062604:0:18868:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.157@tcp lock: ffff90a68116b400/0x10531a153b5370b1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x10531a153b5370b8 expref: -99 pid: 18868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574498.062616:0:18868:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.157@tcp lock: ffff90a68116b400/0x10531a153b5370b1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x10531a153b5370b8 expref: -99 pid: 18868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1788574498.062678:0:18868:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:1.0:1788574498.062680:0:18868:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1788574498.062681:0:18868:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788574498.062683:0:18868:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788574498.062684:0:18868:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788574498.062685:0:18868:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788574498.062687:0:18868:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1788574498.062688:0:18868:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1788574498.062690:0:18868:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788574498.062692:0:18868:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1788574498.062697:0:18868:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020005 00000020:01000004:1.0:1788574498.062699:0:18868:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1788574498.062700:0:18868:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1788574498.062706:0:18868:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788574498.062707:0:18868:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788574498.062707:0:18868:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788574498.062708:0:18868:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788574498.062709:0:18868:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1788574498.062710:0:18868:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1788574498.062711:0:18868:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788574498.062712:0:18868:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1788574498.062735:0:18868:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:1.0:1788574498.062750:0:18868:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a7a72baa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:64047b6f-0fa6-4004-9f51-bd636ae04daf:18868:1875455747679616:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1788574498.062793:0:18868:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788574498.062820:0:18868:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a783575600 going to sleep for 11 seconds 00000100:00100000:0.0:1788574498.065586:0:18880:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747679616 00000100:00100000:0.0:1788574498.065605:0:18880:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747679616 00000100:00100000:0.0:1788574498.066071:0:18880:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1788574498.066082:0:18880:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7a74f7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:64047b6f-0fa6-4004-9f51-bd636ae04daf+12:18868:x1875455747679616:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1788574498.066147:0:18880:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:0.0:1788574498.066163:0:18880:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:0.0:1788574498.150887:0:18880:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1788574498.150912:0:18880:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:1.0:1788574498.151763:0:18902:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1788574498.151770:0:18902:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1788574498.151796:0:18902:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff90a790a21200/0x10531a153b5370cd lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574498.151817:0:18902:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90a78165a800/0x10531a153b53709c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x10531a153b537095 expref: 12 pid: 18879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574498.151827:0:18902:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff90a790a21200/0x10531a153b5370cd lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 18902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574498.151874:0:18902:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90a78165a800/0x10531a153b53709c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x10531a153b537095 expref: 12 pid: 18879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574498.151900:0:18902:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff90a78165a800/0x10531a153b53709c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x10531a153b537095 expref: 12 pid: 18879 timeout: 724 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788574498.151917:0:18902:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a7a72b9880 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:18902:1875455747679744:0@lo:104: 00000100:00100000:1.0:1788574498.151999:0:18902:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788574498.152060:0:18902:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a783575840 going to sleep for 11 seconds 00000100:00100000:3.0:1788574498.152100:0:18869:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747679744 00000100:00100000:3.0:1788574498.152110:0:18869:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747679744 00000100:00100000:3.0:1788574498.152184:0:18869:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788574498.152196:0:18869:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7a72bb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:64047b6f-0fa6-4004-9f51-bd636ae04daf+3:18902:x1875455747679744:12345-0@lo:104: 00010000:00010000:3.0:1788574498.152211:0:18869:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.157@tcp lock: ffff90a790a21c00/0x10531a153b537095 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x10531a153b53709c expref: -99 pid: 18868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574498.152268:0:18869:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788574498.152274:0:18869:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7a72bb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:64047b6f-0fa6-4004-9f51-bd636ae04daf+3:18902:x1875455747679744:12345-0@lo:104: Request processed in 81us (276us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574498.152281:0:18869:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:3.0:1788574498.152304:0:18875:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788574498.152323:0:18875:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.157@tcp lock: ffff90a790a21c00/0x10531a153b537095 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x10531a153b53709c expref: -99 pid: 18868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574498.152330:0:18875:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a790a21c00 already unused, calling callback (ffffffffc1bbcc20) 10000000:00010000:3.0:1788574498.152334:0:18875:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.157@tcp lock: ffff90a790a21c00/0x10531a153b537095 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x10531a153b53709c expref: -99 pid: 18868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574498.152343:0:18875:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.157@tcp lock: ffff90a790a21c00/0x10531a153b537095 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x10531a153b53709c expref: -99 pid: 18868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788574498.152351:0:18875:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.157@tcp lock: ffff90a790a21c00/0x10531a153b537095 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x10531a153b53709c expref: -99 pid: 18868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788574498.152356:0:18875:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1788574498.152405:0:18875:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.157@tcp lock: ffff90a790a21c00/0x10531a153b537095 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x10531a153b53709c expref: -99 pid: 18868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574498.152412:0:18875:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788574498.152430:0:18875:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.157@tcp lock: ffff90a790a21c00/0x10531a153b537095 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x10531a153b53709c expref: -99 pid: 18868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574498.152438:0:18875:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.157@tcp lock: ffff90a790a21c00/0x10531a153b537095 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x10531a153b53709c expref: -99 pid: 18868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788574498.152447:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a7bbebea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:64047b6f-0fa6-4004-9f51-bd636ae04daf:3314:1875455747679872:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788574498.152455:0:18875:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788574498.152457:0:18875:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788574498.152459:0:18875:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788574498.152479:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788574498.152881:0:18871:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747679872 00000100:00100000:2.0:1788574498.152888:0:18871:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747679872 00010000:00010000:2.0:1788574498.152911:0:18871:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90a78165a800/0x10531a153b53709c lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x10531a153b537095 expref: 13 pid: 18879 timeout: 724 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788574498.152942:0:18871:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788574498.152950:0:18871:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7a72b9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:64047b6f-0fa6-4004-9f51-bd636ae04daf+13:3314:x1875455747679872:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788574498.152961:0:18871:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788574498.152967:0:18871:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90a78165a800/0x10531a153b53709c lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x10531a153b537095 expref: 13 pid: 18879 timeout: 724 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574498.152977:0:18871:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90a78165a800/0x10531a153b53709c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x10531a153b537095 expref: 13 pid: 18879 timeout: 724 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574498.152996:0:18871:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff90a790a21200/0x10531a153b5370cd lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 18902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574498.153004:0:18871:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90a790a21200/0x10531a153b5370cd lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 18902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1788574498.153018:0:18871:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.001249205s 00010000:00010000:2.0:1788574498.153023:0:18871:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff90a790a21200/0x10531a153b5370cd lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 18902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574498.153030:0:18871:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff90a790a21200/0x10531a153b5370cd lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 18902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574498.153048:0:18871:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff90a790a21200/0x10531a153b5370cd lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 18902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574498.153055:0:18871:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff90a790a21200/0x10531a153b5370cd lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 18902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574498.153061:0:18871:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a790a21200 already unused, calling callback (ffffffffc159f4f0) 00010000:00010000:2.0:1788574498.153066:0:18871:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff90a790a21200/0x10531a153b5370cd lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 18902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574498.153135:0:18871:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff90a790a21200/0x10531a153b5370cd lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 18902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574498.153145:0:18871:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff90a790a21200/0x10531a153b5370cd lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 18902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574498.153154:0:18871:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788574498.153299:0:18871:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7a72b9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:64047b6f-0fa6-4004-9f51-bd636ae04daf+13:3314:x1875455747679872:12345-0@lo:103:ldlm_bl.0 Request processed in 348us (818us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574498.153307:0:18871:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:0.0:1788574498.153466:0:18902:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90a78165a800/0x10531a153b53709c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x10531a153b537095 expref: 12 pid: 18879 timeout: 724 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788574498.153468:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a7bbebea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:64047b6f-0fa6-4004-9f51-bd636ae04daf:3314:1875455747679872:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788574498.153552:0:18902:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a7a72b9880 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:18902:1875455747679744:0@lo:104: 00010000:00010000:0.0:1788574498.153568:0:18902:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff90a790a21200/0x10531a153b5370cd lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 18902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574498.153585:0:18902:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff90a790a21200/0x10531a153b5370cd lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 18902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574498.153590:0:18902:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff90a790a21200/0x10531a153b5370cd lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 18902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574498.153597:0:18902:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90a790a21200/0x10531a153b5370cd lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 18902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788574498.186410:0:18880:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7a74f7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:64047b6f-0fa6-4004-9f51-bd636ae04daf+11:18868:x1875455747679616:12345-0@lo:253:mount.lustre.0 Request processed in 120318us (123604us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574498.186430:0:18880:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1788574498.186621:0:18868:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a7a72baa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:64047b6f-0fa6-4004-9f51-bd636ae04daf:18868:1875455747679616:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1788574498.186641:0:18868:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:1.0:1788574498.186645:0:18868:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1788574498.186647:0:18868:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1788574498.186649:0:18868:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788574498.186649:0:18868:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788574498.186651:0:18868:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788574498.186663:0:18868:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788574498.186664:0:18868:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1788574498.186666:0:18868:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1788574498.186668:0:18868:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788574498.186669:0:18868:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:1.0:1788574498.186685:0:18868:0:(tgt_mount.c:2698:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:0.0:1788574498.195029:0:18868:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/8/4) registered 00080000:10000000:0.0:1788574498.195353:0:18868:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:0.0:1788574498.196519:0:18868:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/8/4) registered 00080000:10000000:0.0:1788574498.197256:0:18868:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:0.0:1788574498.197607:0:18868:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/8/4) registered 00080000:10000000:0.0:1788574498.197799:0:18868:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00080000:10000000:1.0:1788574498.200611:0:18868:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/8/4) registered 00080000:10000000:1.0:1788574498.200830:0:18868:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8/1) registered 00080000:10000000:1.0:1788574498.201124:0:18868:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/8/4) registered 00080000:10000000:2.0:1788574498.205301:0:18868:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8/1) registered 00080000:10000000:2.0:1788574498.205675:0:18868:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xf:0x0] (8/8/4) registered 00080000:10000000:2.0:1788574498.205848:0:18868:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8/1) registered 00000020:00080000:0.0:1788574498.291776:0:18868:0:(update_trans.c:1496:distribute_txn_commit_batchid_init()) lustre-MDT0000: committed batchid 4294967527 00000040:01000000:0.0:1788574498.293130:0:18868:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000040:01000000:0.0:1788574498.293801:0:18926:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:00080000:0.0:1788574498.293884:0:18926:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788574498.299975:0:18926:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:0.0:1788574498.300077:0:18926:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000004:00080000:0.0:1788574498.300082:0:18926:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00000040:01000000:2.0:1788574498.300998:0:18868:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000020:00080000:3.0:1788574498.301824:0:18925:0:(update_trans.c:1538:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 4294967527 00000020:00080000:3.0:1788574498.301831:0:18925:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4294967527 00000040:00080000:2.0:1788574498.302813:0:18868:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:2.0:1788574498.303798:0:18868:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:2.0:1788574498.303815:0:18868:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:2.0:1788574498.304665:0:18868:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788574498.306859:0:18868:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:2.0:1788574498.308631:0:18868:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:3.0:1788574498.308877:0:18868:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00000040:00080000:3.0:1788574498.310797:0:18868:0:(llog_cat.c:403:llog_cat_set_first_idx()) catlog [0xa:0x7:0x0] first idx 1, last_idx 2 00080000:10000000:3.0:1788574498.312090:0:18868:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x37:0x0] (8/8/4) registered 00000001:00000004:0.0:1788574498.329829:0:18868:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 3, last_transno is 12884901888 00000001:00080000:0.0:1788574498.397458:0:18868:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:0.0:1788574498.397560:0:18868:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffb3a241c33988 00100000:10000000:0.0:1788574498.397584:0:18868:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:2.0:1788574498.398670:0:18868:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1788574498.398689:0:18868:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.201.157@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1788574498.398707:0:18868:0:(tgt_mount.c:2464:server_fill_super_common()) Server sb, dev=46 00000080:00000004:2.0:1788574498.398729:0:18868:0:(super25.c:182:lustre_fill_super()) lustre-mdt1/mdt1: Mount complete 00010000:00010000:2.0:1788574498.624745:0:18874:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788574499.138069:0:18921:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:2.0:1788574499.138080:0:18921:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788574499.138567:0:18921:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:2.0:1788574499.138576:0:18921:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 10000000:01000000:3.0:1788574499.398721:0:18883:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1788574499.398733:0:18883:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff90a79fbec800 from 9 10000000:01000000:3.0:1788574499.398739:0:18883:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1788574499.398808:0:18883:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.157@tcp lock: ffff90a78165a400/0x10531a153b5370d4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 18883 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574499.398822:0:18883:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.157@tcp lock: ffff90a78165a400/0x10531a153b5370d4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 18883 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574499.398833:0:18883:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.157@tcp lock: ffff90a78165a400/0x10531a153b5370d4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 18883 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788574499.398865:0:18883:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a7bbebe300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:64047b6f-0fa6-4004-9f51-bd636ae04daf:18883:1875455747680000:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788574499.398943:0:18883:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788574499.399005:0:18883:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a79b142d80 going to sleep for 11 seconds 00000100:00100000:0.0:1788574499.399757:0:18881:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747680000 00000100:00100000:0.0:1788574499.399767:0:18881:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747680000 00000100:00100000:0.0:1788574499.399827:0:18881:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1788574499.399837:0:18881:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7a74f4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:64047b6f-0fa6-4004-9f51-bd636ae04daf+11:18883:x1875455747680000:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788574499.399854:0:18881:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788574499.399874:0:18881:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90a68116a400/0x10531a153b5370db lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x10531a153b5370d4 expref: -99 pid: 18881 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574499.399902:0:18881:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90a68116a400/0x10531a153b5370db lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x10531a153b5370d4 expref: 12 pid: 18881 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574499.399914:0:18881:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90a68116a400/0x10531a153b5370db lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x10531a153b5370d4 expref: 12 pid: 18881 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574499.399925:0:18881:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a68116a400, rc 0) 00000100:00100000:0.0:1788574499.399987:0:18881:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7a74f4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:64047b6f-0fa6-4004-9f51-bd636ae04daf+12:18883:x1875455747680000:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 151us (1045us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574499.399994:0:18881:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1788574499.401558:0:18883:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a7bbebe300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:64047b6f-0fa6-4004-9f51-bd636ae04daf:18883:1875455747680000:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788574499.401585:0:18883:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.157@tcp lock: ffff90a78165a400/0x10531a153b5370d4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x10531a153b5370db expref: -99 pid: 18883 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574499.401597:0:18883:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.157@tcp lock: ffff90a78165a400/0x10531a153b5370d4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x10531a153b5370db expref: -99 pid: 18883 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788574499.401679:0:18883:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a7bbebe300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:64047b6f-0fa6-4004-9f51-bd636ae04daf:18883:1875455747680128:0@lo:256:ll_cfg_requeue.0 00000100:00100000:3.0:1788574499.401736:0:18883:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788574499.401768:0:18883:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a79b142d80 going to sleep for 11 seconds 00000100:00100000:0.0:1788574499.401829:0:18880:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747680128 00000100:00100000:0.0:1788574499.401836:0:18880:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747680128 00000100:00100000:0.0:1788574499.401920:0:18880:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1788574499.401931:0:18880:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7a74f4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:64047b6f-0fa6-4004-9f51-bd636ae04daf+12:18883:x1875455747680128:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:0.0:1788574499.401950:0:18880:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1788574499.401965:0:18880:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1788574499.401968:0:18880:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 9 00000100:00100000:0.0:1788574499.402067:0:18880:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7a74f4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:64047b6f-0fa6-4004-9f51-bd636ae04daf+12:18883:x1875455747680128:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 137us (329us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574499.402076:0:18880:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1788574499.406741:0:18883:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a7bbebe300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:64047b6f-0fa6-4004-9f51-bd636ae04daf:18883:1875455747680128:0@lo:256:ll_cfg_requeue.0 10000000:01000000:3.0:1788574499.406825:0:18883:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.157@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1788574499.406843:0:18883:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.157@tcp lock: ffff90a78165a400/0x10531a153b5370d4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x10531a153b5370db expref: -99 pid: 18883 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574499.406856:0:18883:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.157@tcp lock: ffff90a78165a400/0x10531a153b5370d4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x10531a153b5370db expref: -99 pid: 18883 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574499.656864:0:18875:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788574500.162283:0:18921:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:1.0:1788574500.162294:0:18921:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788574500.163141:0:18921:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 1 count 1 00000040:00080000:1.0:1788574500.163218:0:18921:0:(llog_cat_server.c:902:llog_cat_cleanup()) cancel plain log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788574500.163263:0:18921:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 1 00010000:00010000:2.0:1788574500.672528:0:18874:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788574501.696978:0:18875:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788574502.721572:0:18874:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1788574503.559679:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788574503.559686:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1788574503.559689:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788574503.559692:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1788574503.559695:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:0.0:1788574503.559698:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1788574503.559703:0:8:0:(import.c:65:import_set_state_nolock()) ffff90a79e97f000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788574503.559718:0:8:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff90a79e97f000 using connection 192.168.201.157@tcp/0@lo 00000100:00100000:0.0:1788574503.559743:0:8:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff90a6839d2680 x1875455747680384/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788574503.561250:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788574503.561282:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a6839d0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:64047b6f-0fa6-4004-9f51-bd636ae04daf:3314:1875455747680256:0@lo:400:kworker.0 00000100:00100000:1.0:1788574503.561352:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788574503.563231:0:18879:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747680256 00000100:00100000:1.0:1788574503.563248:0:18879:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747680256 00000100:00100000:1.0:1788574503.563301:0:18879:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1788574503.563318:0:18879:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7a74f4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:64047b6f-0fa6-4004-9f51-bd636ae04daf+12:3314:x1875455747680256:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788574503.564984:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a6839d2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3311:1875455747680384:0@lo:38:kworker.0 00000100:00100000:0.0:1788574503.565051:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788574503.565127:0:18888:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747680384 00000100:00100000:0.0:1788574503.565133:0:18888:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747680384 00000100:00100000:0.0:1788574503.565161:0:18888:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788574503.565168:0:18888:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6839d3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3311:x1875455747680384:12345-0@lo:38:kworker.0 00010000:00080000:0.0:1788574503.565202:0:18888:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 629 last 0 00000020:00000080:0.0:1788574503.565242:0:18888:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0x10531a153b5370e2 00000004:00100000:0.0:1788574503.565258:0:18888:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00100000:1.0:1788574503.566824:0:18879:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7a74f4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:64047b6f-0fa6-4004-9f51-bd636ae04daf+12:3314:x1875455747680256:12345-0@lo:400:kworker.0 Request processed in 3498us (5461us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574503.566843:0:18879:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1788574503.566959:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a6839d0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:64047b6f-0fa6-4004-9f51-bd636ae04daf:3314:1875455747680256:0@lo:400:kworker.0 00000100:00080000:0.0:1788574503.568779:0:18888:0:(import.c:65:import_set_state_nolock()) ffff90a7a76a2800 : changing import state from RECOVER to FULL 00010000:00080000:1.0:1788574503.569846:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff90a6839d2680 x1875455747680384/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788574513 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1788574503.569869:0:3311:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 3 00000100:00080000:1.0:1788574503.569880:0:3311:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:1.0:1788574503.569887:0:3311:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1788574503.569890:0:3311:0:(import.c:65:import_set_state_nolock()) ffff90a79e97f000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1788574503.569898:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a6839d2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3311:1875455747680384:0@lo:38:kworker.0 00000100:00100000:0.0:1788574503.570404:0:18888:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6839d3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1875455747680384:12345-0@lo:38:kworker.0 Request processed in 5226us (5343us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574503.571570:0:18888:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00010000:3.0:1788574503.746208:0:18875:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1788574504.080139:0:19170:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg157-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:1.0:1788574504.768574:0:18874:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788574505.792694:0:18875:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788574506.819586:0:18874:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1788574506.946832:0:19321:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffc53276530 20000000:00000080:1.0:1788574506.946858:0:19321:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff90a787b3c000 uarg=0000000000000000 20000000:01000000:1.0:1788574506.946909:0:19321:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:1.0:1788574506.946917:0:19321:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:1.0:1788574506.946924:0:19321:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:3.0:1788574506.947865:0:19322:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 2 count 10 20000000:00000400:1.0:1788574506.948065:0:19321:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/debug_raw_pointers=Y (mode = 0) failed: rc = -17 10000000:01000000:1.0:1788574506.952847:0:19321:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:1.0:1788574506.952884:0:19321:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff90a790a20400/0x10531a153b5370e9 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574506.952903:0:19321:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90a78165a000/0x10531a153b5370aa lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x10531a153b5370a3 expref: 11 pid: 18879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574506.952935:0:19321:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff90a790a20400/0x10531a153b5370e9 lrc: 4/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 19321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574506.952985:0:19321:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90a78165a000/0x10531a153b5370aa lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x10531a153b5370a3 expref: 11 pid: 18879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574506.953001:0:19321:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff90a78165a000/0x10531a153b5370aa lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x10531a153b5370a3 expref: 11 pid: 18879 timeout: 733 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788574506.953016:0:19321:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a7a72baa00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:19321:1875455747680512:0@lo:104: 00000100:00100000:1.0:1788574506.953101:0:19321:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788574506.953159:0:19321:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a7852acc00 going to sleep for 11 seconds 00000100:00100000:2.0:1788574506.953284:0:18870:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747680512 00000100:00100000:2.0:1788574506.953292:0:18870:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747680512 00000100:00100000:2.0:1788574506.953349:0:18870:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788574506.953358:0:18870:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7a72b8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:64047b6f-0fa6-4004-9f51-bd636ae04daf+3:19321:x1875455747680512:12345-0@lo:104: 00010000:00010000:2.0:1788574506.953394:0:18870:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.157@tcp lock: ffff90a68116a000/0x10531a153b5370a3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x10531a153b5370aa expref: -99 pid: 18868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574506.953457:0:18870:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788574506.953463:0:18870:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7a72b8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:64047b6f-0fa6-4004-9f51-bd636ae04daf+3:19321:x1875455747680512:12345-0@lo:104: Request processed in 107us (363us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574506.953470:0:18870:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00010000:2.0:1788574506.953491:0:18875:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788574506.953497:0:18875:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.157@tcp lock: ffff90a68116a000/0x10531a153b5370a3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x10531a153b5370aa expref: -99 pid: 18868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574506.953514:0:18875:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a68116a000 already unused, calling callback (ffffffffc1bbcc20) 10000000:00010000:2.0:1788574506.953519:0:18875:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.157@tcp lock: ffff90a68116a000/0x10531a153b5370a3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x10531a153b5370aa expref: -99 pid: 18868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574506.953527:0:18875:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.157@tcp lock: ffff90a68116a000/0x10531a153b5370a3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x10531a153b5370aa expref: -99 pid: 18868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788574506.953542:0:18875:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.157@tcp lock: ffff90a68116a000/0x10531a153b5370a3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x10531a153b5370aa expref: -99 pid: 18868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788574506.953547:0:18875:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1788574506.953577:0:18875:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.157@tcp lock: ffff90a68116a000/0x10531a153b5370a3 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x10531a153b5370aa expref: -99 pid: 18868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574506.953584:0:18875:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788574506.953605:0:18875:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.157@tcp lock: ffff90a68116a000/0x10531a153b5370a3 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x10531a153b5370aa expref: -99 pid: 18868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574506.953613:0:18875:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.157@tcp lock: ffff90a68116a000/0x10531a153b5370a3 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x10531a153b5370aa expref: -99 pid: 18868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574506.953630:0:18875:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788574506.953632:0:18875:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788574506.953633:0:18875:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788574506.953653:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a7bb28b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:64047b6f-0fa6-4004-9f51-bd636ae04daf:3312:1875455747680640:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788574506.953683:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788574506.953716:0:18871:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747680640 00000100:00100000:2.0:1788574506.953720:0:18871:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747680640 00010000:00010000:2.0:1788574506.953737:0:18871:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90a78165a000/0x10531a153b5370aa lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x10531a153b5370a3 expref: 12 pid: 18879 timeout: 733 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788574506.953757:0:18871:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788574506.953764:0:18871:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7bb28b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:64047b6f-0fa6-4004-9f51-bd636ae04daf+12:3312:x1875455747680640:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788574506.953774:0:18871:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788574506.953778:0:18871:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90a78165a000/0x10531a153b5370aa lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x10531a153b5370a3 expref: 12 pid: 18879 timeout: 733 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574506.953795:0:18871:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90a78165a000/0x10531a153b5370aa lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x10531a153b5370a3 expref: 12 pid: 18879 timeout: 733 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574506.953812:0:18871:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff90a790a20400/0x10531a153b5370e9 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 19321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574506.953821:0:18871:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90a790a20400/0x10531a153b5370e9 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 19321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574506.953836:0:18871:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff90a790a20400/0x10531a153b5370e9 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 19321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574506.953844:0:18871:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff90a790a20400/0x10531a153b5370e9 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 19321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574506.953852:0:18871:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff90a790a20400/0x10531a153b5370e9 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 19321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574506.953860:0:18871:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff90a790a20400/0x10531a153b5370e9 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 19321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574506.953865:0:18871:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a790a20400 already unused, calling callback (ffffffffc159f4f0) 00010000:00010000:2.0:1788574506.953870:0:18871:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff90a790a20400/0x10531a153b5370e9 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 19321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574506.953877:0:18871:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff90a790a20400/0x10531a153b5370e9 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 19321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574506.953887:0:18871:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff90a790a20400/0x10531a153b5370e9 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 19321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574506.953905:0:18871:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788574506.953932:0:18871:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7bb28b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:64047b6f-0fa6-4004-9f51-bd636ae04daf+12:3312:x1875455747680640:12345-0@lo:103:ldlm_bl.0 Request processed in 169us (249us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574506.953940:0:18871:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788574506.953975:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a7bb28b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:64047b6f-0fa6-4004-9f51-bd636ae04daf:3312:1875455747680640:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788574506.954470:0:19321:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90a78165a000/0x10531a153b5370aa lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x10531a153b5370a3 expref: 11 pid: 18879 timeout: 733 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788574506.954494:0:19321:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a7a72baa00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:19321:1875455747680512:0@lo:104: 00010000:00010000:0.0:1788574506.954583:0:19321:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff90a790a20400/0x10531a153b5370e9 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 19321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574506.954594:0:19321:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff90a790a20400/0x10531a153b5370e9 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 19321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574506.954600:0:19321:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff90a790a20400/0x10531a153b5370e9 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 19321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574506.954606:0:19321:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90a790a20400/0x10531a153b5370e9 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 19321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788574507.648449:0:3311:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788574497/real 1788574497] req@ffff90a6839d2a00 x1875455747677440/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788574507 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788574507.648482:0:3311:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff90a6839d2a00 x1875455747677440/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788574507 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788574507.648513:0:3311:0:(import.c:65:import_set_state_nolock()) ffff90a7b1b65000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788574507.648529:0:3311:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1788574507.648533:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a6839d2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3311:1875455747677440:0@lo:8:llog_process_th.0 00000100:00080000:1.0:1788574507.648609:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788574507.648613:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:1.0:1788574507.648616:0:8:0:(import.c:65:import_set_state_nolock()) ffff90a7b1b65000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788574507.648621:0:8:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 624 00000100:00080000:1.0:1788574507.648626:0:8:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1788574507.648634:0:8:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff90a7b1b65000 using connection 192.168.201.157@tcp/0@lo 00000100:00100000:1.0:1788574507.648672:0:8:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff90a7a72baa00 x1875455747680768/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788574507.648692:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788574507.648695:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1788574507.648738:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a7a72b9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3313:1875455747680896:0@lo:400:kworker.0 00000100:00100000:1.0:1788574507.648814:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788574507.648892:0:18887:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747680896 00000100:00100000:1.0:1788574507.648905:0:18887:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747680896 00000100:00100000:1.0:1788574507.648948:0:18887:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788574507.648956:0:18887:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7a72bb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1875455747680896:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788574507.649001:0:18887:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7a72bb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1875455747680896:12345-0@lo:400:kworker.0 Request processed in 45us (187us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574507.649009:0:18887:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:1.0:1788574507.649110:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff90a7a72b9880 x1875455747680896/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788574523 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788574507.649122:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a7a72b9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3313:1875455747680896:0@lo:400:kworker.0 00000100:00100000:2.0:1788574507.649182:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a7a72baa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3311:1875455747680768:0@lo:8:kworker.0 00000400:00000100:2.0:1788574507.649203:0:3311:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875455747680768 offset 0 length 520: 4 00010000:00010000:1.0:1788574507.840517:0:18874:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1788574508.224569:0:18883:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1788574508.224579:0:18883:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff90a79fbec800 from 10 10000000:01000000:2.0:1788574508.224585:0:18883:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788574508.224657:0:18883:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.157@tcp lock: ffff90a79e985400/0x10531a153b5370f0 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 18883 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574508.224670:0:18883:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.157@tcp lock: ffff90a79e985400/0x10531a153b5370f0 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 18883 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574508.224683:0:18883:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.157@tcp lock: ffff90a79e985400/0x10531a153b5370f0 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 18883 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788574508.224717:0:18883:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a7bb28b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:64047b6f-0fa6-4004-9f51-bd636ae04daf:18883:1875455747681024:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788574508.225012:0:18883:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788574508.225087:0:18883:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a7bbfb6180 going to sleep for 11 seconds 00000100:00100000:0.0:1788574508.225393:0:18880:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747681024 00000100:00100000:0.0:1788574508.225401:0:18880:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747681024 00000100:00100000:0.0:1788574508.225450:0:18880:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1788574508.225459:0:18880:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7a74f7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:64047b6f-0fa6-4004-9f51-bd636ae04daf+11:18883:x1875455747681024:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788574508.225473:0:18880:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788574508.225515:0:18880:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90a68116ac00/0x10531a153b5370f7 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x10531a153b5370f0 expref: -99 pid: 18880 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574508.225544:0:18880:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90a68116ac00/0x10531a153b5370f7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x10531a153b5370f0 expref: 12 pid: 18880 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574508.225555:0:18880:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90a68116ac00/0x10531a153b5370f7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x10531a153b5370f0 expref: 12 pid: 18880 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574508.225564:0:18880:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a68116ac00, rc 0) 00000100:00100000:0.0:1788574508.225614:0:18880:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7a74f7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:64047b6f-0fa6-4004-9f51-bd636ae04daf+12:18883:x1875455747681024:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 156us (611us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574508.225621:0:18880:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1788574508.225818:0:18883:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a7bb28b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:64047b6f-0fa6-4004-9f51-bd636ae04daf:18883:1875455747681024:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788574508.225833:0:18883:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.157@tcp lock: ffff90a79e985400/0x10531a153b5370f0 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x10531a153b5370f7 expref: -99 pid: 18883 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574508.225853:0:18883:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.157@tcp lock: ffff90a79e985400/0x10531a153b5370f0 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x10531a153b5370f7 expref: -99 pid: 18883 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788574508.225982:0:18883:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a7bb28b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:64047b6f-0fa6-4004-9f51-bd636ae04daf:18883:1875455747681152:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788574508.226083:0:18883:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788574508.226115:0:18883:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a7bbfb6180 going to sleep for 11 seconds 00000100:00100000:1.0:1788574508.226182:0:18881:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747681152 00000100:00100000:1.0:1788574508.226187:0:18881:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747681152 00000100:00100000:1.0:1788574508.226222:0:18881:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1788574508.226230:0:18881:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7a74f4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:64047b6f-0fa6-4004-9f51-bd636ae04daf+12:18883:x1875455747681152:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788574508.226556:0:18881:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7a74f4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:64047b6f-0fa6-4004-9f51-bd636ae04daf+12:18883:x1875455747681152:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 326us (472us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574508.226563:0:18881:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1788574508.226812:0:18883:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a7bb28b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:64047b6f-0fa6-4004-9f51-bd636ae04daf:18883:1875455747681152:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788574508.226848:0:18883:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a7bb28b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:64047b6f-0fa6-4004-9f51-bd636ae04daf:18883:1875455747681280:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788574508.226889:0:18883:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788574508.226994:0:18883:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a7bbfb6180 going to sleep for 11 seconds 00000100:00100000:1.0:1788574508.227117:0:18879:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747681280 00000100:00100000:1.0:1788574508.227123:0:18879:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747681280 00000100:00100000:1.0:1788574508.227267:0:18879:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1788574508.227277:0:18879:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7a74f6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:64047b6f-0fa6-4004-9f51-bd636ae04daf+12:18883:x1875455747681280:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788574508.227476:0:18879:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7a74f6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:64047b6f-0fa6-4004-9f51-bd636ae04daf+12:18883:x1875455747681280:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 200us (586us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574508.227495:0:18879:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1788574508.227565:0:18883:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a7bb28b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:64047b6f-0fa6-4004-9f51-bd636ae04daf:18883:1875455747681280:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1788574508.233143:0:19382:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:0.0:1788574508.233617:0:18883:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:0.0:1788574508.233653:0:18883:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.157@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788574508.233667:0:18883:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.157@tcp lock: ffff90a79e985400/0x10531a153b5370f0 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x10531a153b5370f7 expref: -99 pid: 18883 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574508.233679:0:18883:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.157@tcp lock: ffff90a79e985400/0x10531a153b5370f0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x10531a153b5370f7 expref: -99 pid: 18883 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788574508.672783:0:3311:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788574498/real 1788574498] req@ffff90a6839d2d80 x1875455747677696/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788574508 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788574508.672825:0:3311:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff90a6839d2d80 x1875455747677696/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788574508 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1788574508.672857:0:3311:0:(import.c:65:import_set_state_nolock()) ffff90a786924800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788574508.672876:0:3311:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:3.0:1788574508.672881:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a6839d2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3311:1875455747677696:0@lo:8:llog_process_th.0 00000100:00080000:1.0:1788574508.678534:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788574508.678546:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788574508.678569:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788574508.678573:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1788574508.678577:0:8:0:(import.c:65:import_set_state_nolock()) ffff90a786924800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788574508.678586:0:8:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 624 00000100:00080000:1.0:1788574508.678594:0:8:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1788574508.678602:0:8:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff90a786924800 using connection 192.168.201.157@tcp/0@lo 00000100:00100000:1.0:1788574508.678653:0:8:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff90a7a72b9880 x1875455747681408/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788574508.678769:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788574508.678786:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a7a72b9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3315:1875455747681536:0@lo:400:kworker.0 00000100:00100000:1.0:1788574508.678861:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788574508.679096:0:18888:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747681536 00000100:00100000:2.0:1788574508.679106:0:18888:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747681536 00000100:00100000:2.0:1788574508.679192:0:18888:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788574508.679203:0:18888:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7a72b9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1875455747681536:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788574508.679260:0:18888:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7a72b9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1875455747681536:12345-0@lo:400:kworker.0 Request processed in 59us (399us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574508.679266:0:18888:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1788574508.680930:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff90a7a72b9500 x1875455747681536/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788574524 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788574508.680953:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a7a72b9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3315:1875455747681536:0@lo:400:kworker.0 00000100:00100000:3.0:1788574508.681188:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a7a72b9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3311:1875455747681408:0@lo:8:kworker.0 00000400:00000100:3.0:1788574508.681264:0:3311:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875455747681408 offset 0 length 520: 4 00010000:00010000:3.0:1788574508.870477:0:18875:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788574509.888791:0:18874:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788574510.401095:0:18921:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1788574510.923819:0:18875:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788574511.939230:0:18874:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788574512.960870:0:18875:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:1.0:1788574513.641665:0:19574:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:1.0:1788574513.641670:0:19574:0:(obd_mount.c:926:lmd_print()) device: lustre-ost1/ost1 00000080:01200004:1.0:1788574513.641783:0:19574:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff90a7a773a000 00000020:01000004:1.0:1788574513.641802:0:19574:0:(tgt_mount.c:2506:osd_start()) Attempting to start lustre-OST0000, type=osd-zfs, lsifl=200002, mountfl=0 00000020:01000004:1.0:1788574513.641816:0:19574:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-zfs) 00000020:00000080:1.0:1788574513.641831:0:19574:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff90a7a7458000) 00000020:00000080:1.0:1788574513.641847:0:19574:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type osd-zfs with refcount 2 00100000:10000000:2.0:1788574513.690685:0:19574:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:2.0:1788574513.694116:0:19574:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0000: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:1.0:1788574513.707535:0:19574:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:1.0:1788574513.707797:0:19574:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00100000:10000000:1.0:1788574513.708085:0:19574:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0000: registered index [0x200000003:0xb:0x0] (8/32) 00100000:10000000:1.0:1788574513.708517:0:19574:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled lustre-OST0000 under 107: rc = 0 00100000:10000000:1.0:1788574513.708613:0:19574:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled lustre-client under 107: rc = 0 00100000:10000000:1.0:1788574513.708744:0:19574:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled params under 107: rc = 0 00100000:10000000:1.0:1788574513.709288:0:19574:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x20000 under 769: rc = 0 00100000:10000000:1.0:1788574513.710439:0:19574:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x2020000-OST0000 under 769: rc = 0 00100000:10000000:1.0:1788574513.710694:0:19574:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x2020000 under 769: rc = 0 00100000:10000000:1.0:1788574513.713083:0:19574:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x20000-OST0000 under 769: rc = 0 00100000:10000000:1.0:1788574513.713623:0:19574:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x1020000-OST0000 under 769: rc = 0 00100000:10000000:1.0:1788574513.716904:0:19574:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x1020000 under 769: rc = 0 00000020:00000080:1.0:1788574513.718654:0:19574:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:1.0:1788574513.718668:0:19574:0:(osd_handler.c:1574:osd_obd_connect()) connect #0 00000020:00000080:1.0:1788574513.718680:0:19574:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x10531a153b537105 00000020:01000004:1.0:1788574513.718689:0:19574:0:(tgt_mount.c:2591:server_fill_super()) Found service lustre-OST0000 on device lustre-ost1/ost1 00000020:01000004:1.0:1788574513.718848:0:19574:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.201.157@tcp:Set MGC reconnect 1 10000000:01000000:1.0:1788574513.718853:0:19574:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.201.157@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:1.0:1788574513.718859:0:19574:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-OST0000 00000020:01000004:1.0:1788574513.718864:0:19574:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:1.0:1788574513.718892:0:19574:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffff90a7867819c0) 00000020:00000080:1.0:1788574513.718901:0:19574:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type ost with refcount 2 00000100:00100000:1.0:1788574513.722820:0:19574:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788574513.723000:0:19574:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:1.0:1788574513.723005:0:19574:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:1.0:1788574513.723804:0:19574:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:1.0:1788574513.723812:0:19574:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:2.0:1788574513.724130:0:19574:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:2.0:1788574513.724136:0:19574:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:2.0:1788574513.731178:0:19574:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788574513.731685:0:19574:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:2.0:1788574513.731692:0:19574:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:3.0:1788574513.733276:0:19574:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:3.0:1788574513.733289:0:19574:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:2.0:1788574513.790647:0:19574:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788574513.790898:0:19574:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:2.0:1788574513.790906:0:19574:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00080000:0.0:1788574513.793030:0:489:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788574513.793037:0:489:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1788574513.793040:0:489:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788574513.793043:0:489:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1788574513.793071:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788574513.793091:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a6839d2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:64047b6f-0fa6-4004-9f51-bd636ae04daf:3314:1875455747681664:0@lo:400:kworker.0 00000100:00100000:0.0:1788574513.793180:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788574513.793245:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a6839d1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3312:1875455747681792:0@lo:400:kworker.0 00000100:00100000:0.0:1788574513.793274:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788574513.793309:0:18880:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747681664 00000100:00100000:0.0:1788574513.793316:0:18880:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747681664 00000100:00100000:0.0:1788574513.793357:0:18880:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1788574513.793403:0:18880:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7a74f5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:64047b6f-0fa6-4004-9f51-bd636ae04daf+12:3314:x1875455747681664:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788574513.793456:0:18880:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7a74f5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:64047b6f-0fa6-4004-9f51-bd636ae04daf+12:3314:x1875455747681664:12345-0@lo:400:kworker.0 Request processed in 90us (276us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574513.793464:0:18880:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1788574513.793496:0:18886:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747681792 00000100:00100000:0.0:1788574513.793499:0:18886:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747681792 00000100:00100000:0.0:1788574513.793640:0:18886:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788574513.793648:0:18886:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6839d0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1875455747681792:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788574513.793687:0:18886:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6839d0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1875455747681792:12345-0@lo:400:kworker.0 Request processed in 41us (412us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574513.793694:0:18886:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:0.0:1788574513.793732:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff90a6839d1c00 x1875455747681792/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788574529 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788574513.793746:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a6839d1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3312:1875455747681792:0@lo:400:kworker.0 00000100:00100000:0.0:1788574513.793773:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a6839d2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:64047b6f-0fa6-4004-9f51-bd636ae04daf:3314:1875455747681664:0@lo:400:kworker.0 00000100:00100000:0.0:1788574513.812261:0:19574:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:0.0:1788574513.812283:0:19574:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:0.0:1788574513.817679:0:19574:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:0.0:1788574513.817707:0:19574:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:1.0:1788574513.838648:0:19574:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788574513.838919:0:19574:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:1.0:1788574513.838931:0:19574:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:1.0:1788574513.845869:0:19574:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:1.0:1788574513.845891:0:19574:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:0.0:1788574513.937815:0:19574:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788574513.938235:0:19574:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:0.0:1788574513.938242:0:19574:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:1.0:1788574513.943936:0:19574:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:1.0:1788574513.943962:0:19574:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:1.0:1788574513.952712:0:19574:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:1.0:1788574513.952748:0:19574:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost1/ost1 10000000:01000000:1.0:1788574513.952756:0:19574:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.201.157@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00010000:00010000:2.0:1788574513.984839:0:18874:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:01000000:1.0:1788574513.988545:0:19574:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.201.157@tcp ctxt 0 is initialized 00000020:01000004:1.0:1788574513.988608:0:19574:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.201.157@tcp, index=0000, flags=0x20002 00000020:01000004:1.0:1788574513.988613:0:19574:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:1.0:1788574513.988615:0:19574:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1788574513.988617:0:19574:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788574513.988618:0:19574:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788574513.988620:0:19574:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788574513.988621:0:19574:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788574513.988623:0:19574:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788574513.988625:0:19574:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788574513.988627:0:19574:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1788574513.988632:0:19574:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020002 00000020:01000004:1.0:1788574513.988635:0:19574:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1788574513.988636:0:19574:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1788574513.988637:0:19574:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788574513.988638:0:19574:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788574513.988640:0:19574:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788574513.988641:0:19574:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788574513.988642:0:19574:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788574513.988643:0:19574:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788574513.988644:0:19574:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1788574513.988682:0:19574:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:1.0:1788574513.988715:0:19574:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a7a72ba680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:64047b6f-0fa6-4004-9f51-bd636ae04daf:19574:1875455747681920:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1788574513.988816:0:19574:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788574514.004695:0:19574:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a78524a000 going to sleep for 10 seconds 00000100:00100000:3.0:1788574514.005309:0:18879:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747681920 00000100:00100000:3.0:1788574514.005320:0:18879:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747681920 00000100:00100000:3.0:1788574514.005418:0:18879:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1788574514.005430:0:18879:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7a74f6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:64047b6f-0fa6-4004-9f51-bd636ae04daf+12:19574:x1875455747681920:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1788574514.005493:0:18879:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:3.0:1788574514.005496:0:18879:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0000 is running on 0@lo 20000000:01000000:3.0:1788574514.005502:0:18879:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:1.0:1788574514.035942:0:18879:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7a74f6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:64047b6f-0fa6-4004-9f51-bd636ae04daf+12:19574:x1875455747681920:12345-0@lo:253:mount.lustre.0 Request processed in 30500us (47111us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574514.035962:0:18879:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1788574514.036060:0:19574:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a7a72ba680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:64047b6f-0fa6-4004-9f51-bd636ae04daf:19574:1875455747681920:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1788574514.036085:0:19574:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:0.0:1788574514.036089:0:19574:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1788574514.036091:0:19574:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1788574514.036093:0:19574:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788574514.036094:0:19574:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788574514.036095:0:19574:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788574514.036096:0:19574:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788574514.036098:0:19574:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788574514.036100:0:19574:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788574514.036102:0:19574:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:0.0:1788574514.036133:0:19574:0:(tgt_mount.c:101:server_register_mount()) register mount ffff90a7a773a000 from lustre-OST0000 10000000:01000000:0.0:1788574514.036168:0:19574:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:0.0:1788574514.036172:0:19574:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:0.0:1788574514.036179:0:19574:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff90a79f8fcd40 local copy 00010000:00010000:0.0:1788574514.036193:0:19574:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.157@tcp lock: ffff90a79e984200/0x10531a153b536ffb lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x10531a153b537002 expref: -99 pid: 18868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788574514.036462:0:19574:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a6839d2a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:64047b6f-0fa6-4004-9f51-bd636ae04daf:19574:1875455747682048:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788574514.036500:0:19574:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788574514.036541:0:19574:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a784f7a9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788574514.036679:0:18881:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747682048 00000100:00100000:3.0:1788574514.036686:0:18881:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747682048 00000100:00100000:3.0:1788574514.036730:0:18881:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1788574514.036740:0:18881:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7a74f5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:64047b6f-0fa6-4004-9f51-bd636ae04daf+12:19574:x1875455747682048:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788574514.037084:0:18881:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7a74f5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:64047b6f-0fa6-4004-9f51-bd636ae04daf+12:19574:x1875455747682048:12345-0@lo:501:mount.lustre.0 Request processed in 345us (583us total) trans 0 rc -2/-2 00000100:00100000:3.0:1788574514.037092:0:18881:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1788574514.047227:0:19574:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a6839d2a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:64047b6f-0fa6-4004-9f51-bd636ae04daf:19574:1875455747682048:0@lo:501:mount.lustre.0 10000000:01000000:3.0:1788574514.047458:0:19574:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.201.157@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:3.0:1788574514.047765:0:19574:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.201.157@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:3.0:1788574514.047780:0:19574:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.157@tcp lock: ffff90a79e984200/0x10531a153b536ffb lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x10531a153b537002 expref: -99 pid: 18868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574514.047793:0:19574:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.157@tcp lock: ffff90a79e984200/0x10531a153b536ffb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x10531a153b537002 expref: -99 pid: 18868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788574514.047844:0:19574:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff90a7a773a000 10000000:01000000:3.0:1788574514.047850:0:19574:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1788574514.047857:0:19574:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff90a79f8fcd40 10000000:01000000:3.0:1788574514.047859:0:19574:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:3.0:1788574514.047863:0:19574:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff90a79f8fcd40 from 1 10000000:01000000:3.0:1788574514.047867:0:19574:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:3.0:1788574514.048059:0:19574:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.157@tcp lock: ffff90a78165ae00/0x10531a153b537113 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 19574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574514.048069:0:19574:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.157@tcp lock: ffff90a78165ae00/0x10531a153b537113 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 19574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574514.048092:0:19574:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.157@tcp lock: ffff90a78165ae00/0x10531a153b537113 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 19574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788574514.048115:0:19574:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a7bbebe300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:64047b6f-0fa6-4004-9f51-bd636ae04daf:19574:1875455747682176:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788574514.048178:0:19574:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788574514.048230:0:19574:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a7bb92a9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788574514.049107:0:18879:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747682176 00000100:00100000:1.0:1788574514.049118:0:18879:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747682176 00000100:00100000:1.0:1788574514.049177:0:18879:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1788574514.049187:0:18879:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7a74f6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:64047b6f-0fa6-4004-9f51-bd636ae04daf+12:19574:x1875455747682176:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788574514.049204:0:18879:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788574514.049220:0:18879:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90a790a20000/0x10531a153b53711a lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x10531a153b537113 expref: -99 pid: 18879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574514.049251:0:18879:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90a790a20000/0x10531a153b53711a lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x10531a153b537113 expref: 13 pid: 18879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574514.049262:0:18879:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90a790a20000/0x10531a153b53711a lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x10531a153b537113 expref: 13 pid: 18879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574514.049270:0:18879:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a790a20000, rc 0) 00000100:00100000:1.0:1788574514.049319:0:18879:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7a74f6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:64047b6f-0fa6-4004-9f51-bd636ae04daf+13:19574:x1875455747682176:12345-0@lo:101:mount.lustre.0 Request processed in 133us (1141us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574514.049325:0:18879:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1788574514.049470:0:19574:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a7bbebe300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:64047b6f-0fa6-4004-9f51-bd636ae04daf:19574:1875455747682176:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788574514.049485:0:19574:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.157@tcp lock: ffff90a78165ae00/0x10531a153b537113 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x10531a153b53711a expref: -99 pid: 19574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574514.049495:0:19574:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.157@tcp lock: ffff90a78165ae00/0x10531a153b537113 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x10531a153b53711a expref: -99 pid: 19574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788574514.049516:0:19574:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.157@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:3.0:1788574514.049531:0:19574:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.157@tcp lock: ffff90a78165ae00/0x10531a153b537113 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x10531a153b53711a expref: -99 pid: 19574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574514.049538:0:19574:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.157@tcp lock: ffff90a78165ae00/0x10531a153b537113 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x10531a153b53711a expref: -99 pid: 19574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788574514.049545:0:19574:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:3.0:1788574514.049550:0:19574:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1788574514.049564:0:19574:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:3.0:1788574514.049566:0:19574:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:3.0:1788574514.049588:0:19574:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.157@tcp lock: ffff90a78165ac00/0x10531a153b537121 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 19574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574514.049595:0:19574:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.157@tcp lock: ffff90a78165ac00/0x10531a153b537121 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 19574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574514.049609:0:19574:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.157@tcp lock: ffff90a78165ac00/0x10531a153b537121 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 19574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788574514.049625:0:19574:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a7bbebe300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:64047b6f-0fa6-4004-9f51-bd636ae04daf:19574:1875455747682304:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788574514.049653:0:19574:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788574514.049678:0:19574:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a7bb92a9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788574514.050628:0:18881:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747682304 00000100:00100000:1.0:1788574514.050642:0:18881:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747682304 00000100:00100000:1.0:1788574514.050696:0:18881:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1788574514.050705:0:18881:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a796615850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:64047b6f-0fa6-4004-9f51-bd636ae04daf+13:19574:x1875455747682304:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788574514.050720:0:18881:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788574514.050733:0:18881:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90a790a20200/0x10531a153b537128 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x10531a153b537121 expref: -99 pid: 18881 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574514.050755:0:18881:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90a790a20200/0x10531a153b537128 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x10531a153b537121 expref: 14 pid: 18881 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574514.050765:0:18881:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90a790a20200/0x10531a153b537128 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x10531a153b537121 expref: 14 pid: 18881 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574514.050783:0:18881:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a790a20200, rc 0) 00000100:00100000:1.0:1788574514.050840:0:18881:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a796615850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:64047b6f-0fa6-4004-9f51-bd636ae04daf+14:19574:x1875455747682304:12345-0@lo:101:mount.lustre.0 Request processed in 135us (1186us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574514.050857:0:18881:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1788574514.050923:0:19574:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a7bbebe300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:64047b6f-0fa6-4004-9f51-bd636ae04daf:19574:1875455747682304:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788574514.050938:0:19574:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.157@tcp lock: ffff90a78165ac00/0x10531a153b537121 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x10531a153b537128 expref: -99 pid: 19574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574514.050947:0:19574:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.157@tcp lock: ffff90a78165ac00/0x10531a153b537121 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x10531a153b537128 expref: -99 pid: 19574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788574514.053088:0:19574:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 14 count 14 00000040:00080000:0.0:1788574514.061604:0:19574:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788574514.063228:0:19574:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].1, 224 off8416 00000040:00080000:0.0:1788574514.063295:0:19574:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].2, 128 off8544 00000040:00080000:0.0:1788574514.063328:0:19574:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].3, 112 off8656 00000040:00080000:2.0:1788574514.065327:0:19574:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].4, 224 off8880 00000040:00080000:2.0:1788574514.065487:0:19574:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].5, 224 off9104 00000040:00080000:2.0:1788574514.065529:0:19574:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].6, 80 off9184 00000040:00080000:2.0:1788574514.065583:0:19574:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].7, 224 off9408 00000040:00080000:2.0:1788574514.065619:0:19574:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].8, 224 off9632 00000040:00080000:2.0:1788574514.065653:0:19574:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].9, 80 off9712 00000040:00080000:2.0:1788574514.065704:0:19574:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].10, 224 off9936 00000040:00080000:2.0:1788574514.065739:0:19574:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].11, 224 off10160 00000040:00080000:2.0:1788574514.065798:0:19574:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].12, 120 off10280 00000040:00080000:2.0:1788574514.065881:0:19574:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].13, 224 off10504 00000040:00080000:2.0:1788574514.065900:0:19574:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 13 count 14 00000100:00100000:2.0:1788574514.066218:0:19574:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a7bb28b480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:64047b6f-0fa6-4004-9f51-bd636ae04daf:19574:1875455747682432:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788574514.066290:0:19574:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788574514.066325:0:19574:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a7834a30c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788574514.067792:0:18880:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747682432 00000100:00100000:0.0:1788574514.067805:0:18880:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747682432 00000100:00100000:0.0:1788574514.067862:0:18880:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1788574514.067873:0:18880:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a796616c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:64047b6f-0fa6-4004-9f51-bd636ae04daf+14:19574:x1875455747682432:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788574514.068292:0:18880:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a796616c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:64047b6f-0fa6-4004-9f51-bd636ae04daf+14:19574:x1875455747682432:12345-0@lo:501:mount.lustre.0 Request processed in 420us (2001us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574514.068300:0:18880:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1788574514.068544:0:19574:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a7bb28b480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:64047b6f-0fa6-4004-9f51-bd636ae04daf:19574:1875455747682432:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788574514.068612:0:19574:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a7bb28b480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:64047b6f-0fa6-4004-9f51-bd636ae04daf:19574:1875455747682560:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788574514.068667:0:19574:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788574514.068704:0:19574:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a7834a30c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788574514.068804:0:18881:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747682560 00000100:00100000:1.0:1788574514.068810:0:18881:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747682560 00000100:00100000:1.0:1788574514.068838:0:18881:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1788574514.068847:0:18881:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a785535050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:64047b6f-0fa6-4004-9f51-bd636ae04daf+14:19574:x1875455747682560:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788574514.069208:0:18881:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a785535050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:64047b6f-0fa6-4004-9f51-bd636ae04daf+14:19574:x1875455747682560:12345-0@lo:503:mount.lustre.0 Request processed in 362us (540us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574514.069215:0:18881:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1788574514.069549:0:19574:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a7bb28b480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:64047b6f-0fa6-4004-9f51-bd636ae04daf:19574:1875455747682560:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1788574514.070883:0:19574:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1788574514.071187:0:19574:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a7bb28b480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:64047b6f-0fa6-4004-9f51-bd636ae04daf:19574:1875455747682688:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788574514.071264:0:19574:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788574514.071344:0:19574:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a7834a30c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788574514.082443:0:18879:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747682688 00000100:00100000:1.0:1788574514.082462:0:18879:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747682688 00000100:00100000:2.0:1788574514.083559:0:18879:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1788574514.083574:0:18879:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a785537c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:64047b6f-0fa6-4004-9f51-bd636ae04daf+14:19574:x1875455747682688:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788574514.084589:0:18879:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a785537c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:64047b6f-0fa6-4004-9f51-bd636ae04daf+14:19574:x1875455747682688:12345-0@lo:502:mount.lustre.0 Request processed in 1014us (13319us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574514.084602:0:18879:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1788574514.084736:0:19574:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a7bb28b480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:64047b6f-0fa6-4004-9f51-bd636ae04daf:19574:1875455747682688:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1788574514.085078:0:19574:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].1, 224 off8416 00000040:00080000:0.0:1788574514.085144:0:19574:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].2, 128 off8544 00000040:00080000:0.0:1788574514.085180:0:19574:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].3, 112 off8656 00000040:00080000:0.0:1788574514.085247:0:19574:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].4, 224 off8880 00000040:00080000:0.0:1788574514.085287:0:19574:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].5, 224 off9104 00000040:00080000:0.0:1788574514.085324:0:19574:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].6, 80 off9184 00000040:00080000:0.0:1788574514.085427:0:19574:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].7, 224 off9408 00000040:00080000:0.0:1788574514.085467:0:19574:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].8, 224 off9632 00000040:00080000:0.0:1788574514.085504:0:19574:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].9, 80 off9712 00000040:00080000:0.0:1788574514.085570:0:19574:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].10, 224 off9936 00000040:00080000:0.0:1788574514.085609:0:19574:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].11, 224 off10160 00000040:00080000:0.0:1788574514.085657:0:19574:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].12, 120 off10280 00000100:00100000:0.0:1788574514.085723:0:19574:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a6839d1c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:64047b6f-0fa6-4004-9f51-bd636ae04daf:19574:1875455747682816:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788574514.085797:0:19574:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788574514.085848:0:19574:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a784f7ab40 going to sleep for 11 seconds 00000100:00100000:2.0:1788574514.086149:0:18880:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747682816 00000100:00100000:2.0:1788574514.086158:0:18880:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747682816 00000100:00100000:2.0:1788574514.086210:0:18880:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1788574514.086223:0:18880:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a785535450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:64047b6f-0fa6-4004-9f51-bd636ae04daf+14:19574:x1875455747682816:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788574514.086445:0:18880:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a785535450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:64047b6f-0fa6-4004-9f51-bd636ae04daf+14:19574:x1875455747682816:12345-0@lo:502:mount.lustre.0 Request processed in 224us (647us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574514.086453:0:18880:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1788574514.088121:0:19574:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a6839d1c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:64047b6f-0fa6-4004-9f51-bd636ae04daf:19574:1875455747682816:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1788574514.088687:0:19574:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].13, 224 off10504 00000040:00080000:0.0:1788574514.088706:0:19574:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 13 count 14 00000020:01000000:1.0:1788574514.093020:0:19589:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1788574514.093034:0:19589:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-ost1/ost1 00000020:00000080:1.0:1788574514.093041:0:19589:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788574514.093043:0:19589:0:(obd_config.c:1563:class_process_config()) marker 11 (0x1) lustre-OST0000 add ost 00000020:00000080:1.0:1788574514.093049:0:19589:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1788574514.093065:0:19589:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff90a786783380) 00000020:00000080:1.0:1788574514.093087:0:19589:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type obdfilter with refcount 2 00000020:00000080:1.0:1788574514.093092:0:19589:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1788574514.093169:0:19589:0:(tgt_mount.c:153:server_get_mount()) get mount ffff90a7a773a000 from lustre-OST0000, refs=2 00080000:01000000:1.0:1788574514.093176:0:19589:0:(osd_handler.c:1574:osd_obd_connect()) connect #1 00000020:00000080:1.0:1788574514.093182:0:19589:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x10531a153b537136 00010000:00010000:2.0:1788574514.106317:0:19589:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-2 is initialized 00000001:00000004:1.0:1788574514.110253:0:19589:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 3, last_transno is 8589934593 00080000:10000000:2.0:1788574514.117042:0:19589:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0xc:0x0] (8/8/4) registered 00000020:00000080:2.0:1788574514.137810:0:19589:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:2.0:1788574514.137825:0:19589:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788574514.137832:0:19589:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788574514.137834:0:19589:0:(obd_config.c:1563:class_process_config()) marker 11 (0x2) lustre-OST0000 add ost 00000020:01000000:2.0:1788574514.137840:0:19589:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:2.0:1788574514.137843:0:19589:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #15 00000020:01000000:2.0:1788574514.137844:0:19589:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1788574514.137846:0:19589:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1788574514.137848:0:19589:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:2.0:1788574514.137850:0:19589:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788574514.137857:0:19589:0:(obd_config.c:1563:class_process_config()) marker 15 (0x6) lustre sys.timeout 00000020:01000000:2.0:1788574514.137860:0:19589:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788574514.137864:0:19589:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788574514.137865:0:19589:0:(obd_config.c:1563:class_process_config()) marker 22 (0x1) lustre sys.timeout 00000020:00000080:2.0:1788574514.137868:0:19589:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1788574514.137870:0:19589:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1788574514.137872:0:19589:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788574514.137875:0:19589:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788574514.137876:0:19589:0:(obd_config.c:1563:class_process_config()) marker 22 (0x2) lustre sys.timeout 00000020:01000000:2.0:1788574514.137878:0:19589:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788574514.137879:0:19589:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788574514.137881:0:19589:0:(obd_config.c:1563:class_process_config()) marker 26 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1788574514.137884:0:19589:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:2.0:1788574514.137969:0:19589:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788574514.137973:0:19589:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788574514.137975:0:19589:0:(obd_config.c:1563:class_process_config()) marker 26 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1788574514.137978:0:19589:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xc:0x0] index 14 count 14 00000020:01000000:2.0:1788574514.138038:0:19574:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-13 (rc=0) 10000000:01000000:2.0:1788574514.138063:0:19574:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.157@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:2.0:1788574514.138085:0:19574:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.157@tcp lock: ffff90a78165ac00/0x10531a153b537121 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x10531a153b537128 expref: -99 pid: 19574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574514.138097:0:19574:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.157@tcp lock: ffff90a78165ac00/0x10531a153b537121 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x10531a153b537128 expref: -99 pid: 19574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788574514.138105:0:19574:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff90a7a773a000 from 1 10000000:01000000:2.0:1788574514.138108:0:19574:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788574514.138145:0:19574:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.157@tcp lock: ffff90a79e985c00/0x10531a153b53713d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 19574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574514.138153:0:19574:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.157@tcp lock: ffff90a79e985c00/0x10531a153b53713d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 19574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574514.138174:0:19574:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.157@tcp lock: ffff90a79e985c00/0x10531a153b53713d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 19574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788574514.138201:0:19574:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a7bb288380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:64047b6f-0fa6-4004-9f51-bd636ae04daf:19574:1875455747682944:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1788574514.138278:0:19574:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788574514.138314:0:19574:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a79662e0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788574514.138338:0:18880:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747682944 00000100:00100000:2.0:1788574514.138344:0:18880:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747682944 00000100:00100000:2.0:1788574514.138420:0:18880:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1788574514.138430:0:18880:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a785536c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:64047b6f-0fa6-4004-9f51-bd636ae04daf+14:19574:x1875455747682944:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788574514.138442:0:18880:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788574514.138455:0:18880:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90a79e985200/0x10531a153b537144 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x10531a153b53713d expref: -99 pid: 18880 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574514.138479:0:18880:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90a79e985200/0x10531a153b537144 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x10531a153b53713d expref: 15 pid: 18880 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574514.138490:0:18880:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90a79e985200/0x10531a153b537144 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x10531a153b53713d expref: 15 pid: 18880 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574514.138499:0:18880:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a79e985200, rc 0) 00000100:00100000:2.0:1788574514.138535:0:18880:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a785536c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:64047b6f-0fa6-4004-9f51-bd636ae04daf+15:19574:x1875455747682944:12345-0@lo:101:mount.lustre.0 Request processed in 108us (257us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574514.138542:0:18880:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1788574514.138600:0:19574:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a7bb288380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:64047b6f-0fa6-4004-9f51-bd636ae04daf:19574:1875455747682944:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788574514.138615:0:19574:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.157@tcp lock: ffff90a79e985c00/0x10531a153b53713d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x10531a153b537144 expref: -99 pid: 19574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574514.138630:0:19574:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.157@tcp lock: ffff90a79e985c00/0x10531a153b53713d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x10531a153b537144 expref: -99 pid: 19574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788574514.139187:0:19574:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 10 count 10 00000040:00080000:2.0:1788574514.139532:0:19574:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788574514.139797:0:19574:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].1, 224 off8416 00000040:00080000:2.0:1788574514.139843:0:19574:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].2, 112 off8528 00000040:00080000:2.0:1788574514.139892:0:19574:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].3, 224 off8752 00000040:00080000:2.0:1788574514.139928:0:19574:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].4, 224 off8976 00000040:00080000:2.0:1788574514.139964:0:19574:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].5, 112 off9088 00000040:00080000:2.0:1788574514.140023:0:19574:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].6, 224 off9312 00000040:00080000:2.0:1788574514.140063:0:19574:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].7, 224 off9536 00000040:00080000:2.0:1788574514.140098:0:19574:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].8, 128 off9664 00000040:00080000:2.0:1788574514.140191:0:19574:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].9, 224 off9888 00000040:00080000:2.0:1788574514.140200:0:19574:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 9 count 10 00000100:00100000:2.0:1788574514.140282:0:19574:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a7bb288380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:64047b6f-0fa6-4004-9f51-bd636ae04daf:19574:1875455747683072:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788574514.140336:0:19574:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788574514.145625:0:18879:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747683072 00000100:00100000:1.0:1788574514.145649:0:18879:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747683072 00000100:00100000:1.0:1788574514.145726:0:18879:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1788574514.145739:0:18879:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a785536450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:64047b6f-0fa6-4004-9f51-bd636ae04daf+15:19574:x1875455747683072:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788574514.147621:0:19574:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a79662e0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788574514.151224:0:18879:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a785536450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:64047b6f-0fa6-4004-9f51-bd636ae04daf+15:19574:x1875455747683072:12345-0@lo:501:mount.lustre.0 Request processed in 5476us (10875us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574514.151262:0:18879:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1788574514.160693:0:19574:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a7bb288380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:64047b6f-0fa6-4004-9f51-bd636ae04daf:19574:1875455747683072:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788574514.160782:0:19574:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a7bb288380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:64047b6f-0fa6-4004-9f51-bd636ae04daf:19574:1875455747683200:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788574514.160898:0:19574:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788574514.160977:0:19574:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a79662e0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788574514.177915:0:18881:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747683200 00000100:00100000:1.0:1788574514.177946:0:18881:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747683200 00000100:00100000:1.0:1788574514.178024:0:18881:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1788574514.178039:0:18881:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a785534050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:64047b6f-0fa6-4004-9f51-bd636ae04daf+15:19574:x1875455747683200:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788574514.178406:0:18881:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a785534050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:64047b6f-0fa6-4004-9f51-bd636ae04daf+15:19574:x1875455747683200:12345-0@lo:503:mount.lustre.0 Request processed in 332us (17468us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574514.178417:0:18881:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1788574514.179465:0:19574:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a7bb288380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:64047b6f-0fa6-4004-9f51-bd636ae04daf:19574:1875455747683200:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1788574514.190759:0:19574:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1788574514.190914:0:19574:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a7bbebdf80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:64047b6f-0fa6-4004-9f51-bd636ae04daf:19574:1875455747683328:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788574514.195140:0:19574:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788574514.195200:0:19574:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a79b1423c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788574514.198101:0:18879:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747683328 00000100:00100000:1.0:1788574514.198116:0:18879:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747683328 00000100:00100000:1.0:1788574514.198183:0:18879:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1788574514.198194:0:18879:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a785537850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:64047b6f-0fa6-4004-9f51-bd636ae04daf+15:19574:x1875455747683328:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788574514.201246:0:19574:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a7bbebdf80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:64047b6f-0fa6-4004-9f51-bd636ae04daf:19574:1875455747683328:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788574514.203672:0:18879:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a785537850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:64047b6f-0fa6-4004-9f51-bd636ae04daf+15:19574:x1875455747683328:12345-0@lo:502:mount.lustre.0 Request processed in 5458us (8520us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574514.203695:0:18879:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000040:00080000:2.0:1788574514.208489:0:19574:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].1, 224 off8416 00000040:00080000:2.0:1788574514.208602:0:19574:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].2, 112 off8528 00000040:00080000:2.0:1788574514.208661:0:19574:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].3, 224 off8752 00000040:00080000:2.0:1788574514.208703:0:19574:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].4, 224 off8976 00000040:00080000:2.0:1788574514.208749:0:19574:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].5, 112 off9088 00000040:00080000:2.0:1788574514.208796:0:19574:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].6, 224 off9312 00000040:00080000:2.0:1788574514.208832:0:19574:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].7, 224 off9536 00000040:00080000:2.0:1788574514.208868:0:19574:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].8, 128 off9664 00000100:00100000:2.0:1788574514.208947:0:19574:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a7bb289c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:64047b6f-0fa6-4004-9f51-bd636ae04daf:19574:1875455747683456:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788574514.209073:0:19574:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788574514.209134:0:19574:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a7a08f8840 going to sleep for 11 seconds 00000100:00100000:0.0:1788574514.210996:0:18880:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747683456 00000100:00100000:0.0:1788574514.211020:0:18880:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747683456 00000100:00100000:0.0:1788574514.211116:0:18880:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1788574514.211130:0:18880:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a785534850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:64047b6f-0fa6-4004-9f51-bd636ae04daf+15:19574:x1875455747683456:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788574514.220175:0:18880:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a785534850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:64047b6f-0fa6-4004-9f51-bd636ae04daf+15:19574:x1875455747683456:12345-0@lo:502:mount.lustre.0 Request processed in 9023us (11077us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574514.220203:0:18880:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1788574514.226283:0:19574:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a7bb289c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:64047b6f-0fa6-4004-9f51-bd636ae04daf:19574:1875455747683456:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788574514.240783:0:19574:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].9, 224 off9888 00000040:00080000:2.0:1788574514.240821:0:19574:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 9 count 10 00000020:01000000:3.0:1788574514.248613:0:19593:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788574514.248630:0:19593:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788574514.248632:0:19593:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1788574514.248639:0:19593:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff90a7a773a000 00000020:00000080:3.0:1788574514.248642:0:19593:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1788574514.248652:0:19593:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788574514.248654:0:19593:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788574514.248656:0:19593:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:3.0:1788574514.248658:0:19593:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788574514.248660:0:19593:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788574514.248662:0:19593:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1788574514.248664:0:19593:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff90a7a773a000 00000020:00000080:3.0:1788574514.248667:0:19593:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1788574514.248731:0:19593:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788574514.259699:0:19593:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788574514.259714:0:19593:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:3.0:1788574514.259728:0:19593:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788574514.259735:0:19593:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788574514.259736:0:19593:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1788574514.259742:0:19593:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff90a7a773a000 00000020:00000080:3.0:1788574514.259744:0:19593:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1788574514.259909:0:19593:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788574514.259913:0:19593:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788574514.259915:0:19593:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:3.0:1788574514.259919:0:19593:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xe:0x0] index 10 count 10 00000020:01000000:1.0:1788574514.277504:0:19574:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-9 (rc=0) 10000000:01000000:1.0:1788574514.277561:0:19574:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.157@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788574514.277603:0:19574:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.157@tcp lock: ffff90a79e985c00/0x10531a153b53713d lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x10531a153b537144 expref: -99 pid: 19574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574514.277623:0:19574:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.157@tcp lock: ffff90a79e985c00/0x10531a153b53713d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x10531a153b537144 expref: -99 pid: 19574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788574514.277698:0:19574:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:1.0:1788574514.277703:0:19574:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff90a7a773a000 10000000:01000000:1.0:1788574514.277707:0:19574:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff90a7a773a000 10000000:01000000:1.0:1788574514.277712:0:19574:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1788574514.277725:0:19574:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff90a7a773a000 from 1 10000000:01000000:1.0:1788574514.277728:0:19574:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1788574514.277778:0:19574:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.157@tcp lock: ffff90a790a20800/0x10531a153b53714b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 19574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574514.277788:0:19574:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.157@tcp lock: ffff90a790a20800/0x10531a153b53714b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 19574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574514.277802:0:19574:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.157@tcp lock: ffff90a790a20800/0x10531a153b53714b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 19574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788574514.277837:0:19574:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a7a72bbb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:64047b6f-0fa6-4004-9f51-bd636ae04daf:19574:1875455747683584:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1788574514.277938:0:19574:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788574514.277995:0:19574:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a793212480 going to sleep for 11 seconds 00000100:00100000:1.0:1788574514.278029:0:18881:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747683584 00000100:00100000:1.0:1788574514.278038:0:18881:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747683584 00000100:00100000:1.0:1788574514.278093:0:18881:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1788574514.278104:0:18881:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a785537450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:64047b6f-0fa6-4004-9f51-bd636ae04daf+15:19574:x1875455747683584:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788574514.278121:0:18881:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788574514.278140:0:18881:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90a790a20400/0x10531a153b537152 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x10531a153b53714b expref: -99 pid: 18881 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574514.278174:0:18881:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90a790a20400/0x10531a153b537152 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x10531a153b53714b expref: 16 pid: 18881 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574514.278189:0:18881:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90a790a20400/0x10531a153b537152 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x10531a153b53714b expref: 16 pid: 18881 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574514.278199:0:18881:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a790a20400, rc 0) 00000100:00100000:1.0:1788574514.278240:0:18881:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a785537450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:64047b6f-0fa6-4004-9f51-bd636ae04daf+16:19574:x1875455747683584:12345-0@lo:101:mount.lustre.0 Request processed in 137us (302us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574514.278253:0:18881:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1788574514.280477:0:19574:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a7a72bbb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:64047b6f-0fa6-4004-9f51-bd636ae04daf:19574:1875455747683584:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788574514.280521:0:19574:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.157@tcp lock: ffff90a790a20800/0x10531a153b53714b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x10531a153b537152 expref: -99 pid: 19574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574514.280537:0:19574:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.157@tcp lock: ffff90a790a20800/0x10531a153b53714b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x10531a153b537152 expref: -99 pid: 19574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788574514.301874:0:19574:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 42 count 42 00000040:00080000:1.0:1788574514.314153:0:19574:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788574514.314696:0:19574:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].1, 224 off8416 00000040:00080000:1.0:1788574514.314749:0:19574:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].2, 120 off8536 00000040:00080000:1.0:1788574514.314782:0:19574:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].3, 168 off8704 00000040:00080000:1.0:1788574514.314825:0:19574:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].4, 224 off8928 00000040:00080000:1.0:1788574514.314857:0:19574:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].5, 224 off9152 00000040:00080000:1.0:1788574514.314903:0:19574:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].6, 120 off9272 00000040:00080000:1.0:1788574514.315784:0:19574:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].7, 168 off9440 00000040:00080000:1.0:1788574514.315856:0:19574:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].8, 224 off9664 00000040:00080000:1.0:1788574514.318069:0:19574:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].9, 224 off9888 00000040:00080000:1.0:1788574514.319173:0:19574:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].10, 120 off10008 00000040:00080000:1.0:1788574514.319211:0:19574:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].11, 224 off10232 00000040:00080000:1.0:1788574514.319290:0:19574:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].12, 224 off10456 00000040:00080000:1.0:1788574514.319324:0:19574:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].13, 88 off10544 00000040:00080000:1.0:1788574514.319356:0:19574:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].14, 128 off10672 00000040:00080000:1.0:1788574514.319437:0:19574:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].15, 144 off10816 00000040:00080000:1.0:1788574514.319472:0:19574:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].16, 160 off10976 00000040:00080000:1.0:1788574514.319503:0:19574:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].17, 224 off11200 00000040:00080000:1.0:1788574514.319549:0:19574:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].18, 224 off11424 00000040:00080000:1.0:1788574514.319583:0:19574:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].19, 80 off11504 00000040:00080000:1.0:1788574514.319616:0:19574:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].20, 224 off11728 00000040:00080000:1.0:1788574514.319682:0:19574:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].21, 224 off11952 00000040:00080000:1.0:1788574514.319718:0:19574:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].22, 88 off12040 00000040:00080000:1.0:1788574514.319750:0:19574:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].23, 128 off12168 00000040:00080000:1.0:1788574514.319837:0:19574:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].24, 144 off12312 00000040:00080000:1.0:1788574514.319874:0:19574:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].25, 128 off12440 00000040:00080000:1.0:1788574514.319908:0:19574:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].26, 224 off12664 00000040:00080000:1.0:1788574514.319973:0:19574:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].27, 224 off12888 00000040:00080000:1.0:1788574514.320009:0:19574:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].28, 80 off12968 00000040:00080000:1.0:1788574514.320041:0:19574:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].29, 224 off13192 00000040:00080000:1.0:1788574514.320086:0:19574:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].30, 224 off13416 00000040:00080000:1.0:1788574514.320122:0:19574:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].31, 88 off13504 00000040:00080000:1.0:1788574514.320153:0:19574:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].32, 128 off13632 00000040:00080000:1.0:1788574514.320188:0:19574:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].33, 144 off13776 00000040:00080000:1.0:1788574514.320235:0:19574:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].34, 128 off13904 00000040:00080000:1.0:1788574514.320270:0:19574:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].35, 224 off14128 00000040:00080000:1.0:1788574514.320319:0:19574:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].36, 224 off14352 00000040:00080000:1.0:1788574514.320353:0:19574:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].37, 80 off14432 00000040:00080000:1.0:1788574514.320432:0:19574:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].38, 224 off14656 00000040:00080000:1.0:1788574514.320494:0:19574:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].39, 224 off14880 00000040:00080000:1.0:1788574514.320546:0:19574:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].40, 120 off15000 00000040:00080000:1.0:1788574514.320681:0:19574:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].41, 224 off15224 00000040:00080000:1.0:1788574514.320689:0:19574:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 41 count 42 00000100:00100000:1.0:1788574514.320811:0:19574:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a7a72bbb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:64047b6f-0fa6-4004-9f51-bd636ae04daf:19574:1875455747683712:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788574514.320887:0:19574:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788574514.320931:0:19574:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a793212480 going to sleep for 11 seconds 00000100:00100000:0.0:1788574514.328918:0:18880:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747683712 00000100:00100000:0.0:1788574514.328950:0:18880:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747683712 00000100:00100000:0.0:1788574514.329040:0:18880:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1788574514.329054:0:18880:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a785534c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:64047b6f-0fa6-4004-9f51-bd636ae04daf+16:19574:x1875455747683712:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788574514.329556:0:18880:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a785534c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:64047b6f-0fa6-4004-9f51-bd636ae04daf+16:19574:x1875455747683712:12345-0@lo:501:mount.lustre.0 Request processed in 503us (8666us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574514.329567:0:18880:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1788574514.349235:0:19574:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a7a72bbb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:64047b6f-0fa6-4004-9f51-bd636ae04daf:19574:1875455747683712:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788574514.350140:0:19574:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a7a72bbb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:64047b6f-0fa6-4004-9f51-bd636ae04daf:19574:1875455747683840:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788574514.350272:0:19574:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788574514.355205:0:19574:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a793212480 going to sleep for 11 seconds 00000100:00100000:1.0:1788574514.356035:0:18879:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747683840 00000100:00100000:1.0:1788574514.356071:0:18879:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747683840 00000100:00100000:1.0:1788574514.356153:0:18879:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1788574514.356166:0:18879:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a785535850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:64047b6f-0fa6-4004-9f51-bd636ae04daf+16:19574:x1875455747683840:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788574514.357677:0:18879:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a785535850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:64047b6f-0fa6-4004-9f51-bd636ae04daf+16:19574:x1875455747683840:12345-0@lo:503:mount.lustre.0 Request processed in 1504us (7396us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574514.357688:0:18879:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1788574514.358034:0:19574:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a7a72bbb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:64047b6f-0fa6-4004-9f51-bd636ae04daf:19574:1875455747683840:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1788574514.359213:0:19574:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1788574514.359330:0:19574:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a6839d1c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:64047b6f-0fa6-4004-9f51-bd636ae04daf:19574:1875455747683968:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788574514.359473:0:19574:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788574514.359523:0:19574:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a785d5acc0 going to sleep for 11 seconds 00000100:00100000:1.0:1788574514.362867:0:18881:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747683968 00000100:00100000:1.0:1788574514.362893:0:18881:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747683968 00000100:00100000:1.0:1788574514.366103:0:18881:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1788574514.366119:0:18881:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a785536850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:64047b6f-0fa6-4004-9f51-bd636ae04daf+16:19574:x1875455747683968:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788574514.367727:0:18881:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a785536850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:64047b6f-0fa6-4004-9f51-bd636ae04daf+16:19574:x1875455747683968:12345-0@lo:502:mount.lustre.0 Request processed in 1603us (8246us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574514.367741:0:18881:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1788574514.368054:0:19574:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a6839d1c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:64047b6f-0fa6-4004-9f51-bd636ae04daf:19574:1875455747683968:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1788574514.370899:0:19574:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].1, 224 off8416 00000040:00080000:0.0:1788574514.370986:0:19574:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].2, 120 off8536 00000040:00080000:0.0:1788574514.371020:0:19574:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].3, 168 off8704 00000040:00080000:0.0:1788574514.371098:0:19574:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].4, 224 off8928 00000040:00080000:0.0:1788574514.371138:0:19574:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].5, 224 off9152 00000040:00080000:0.0:1788574514.371184:0:19574:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].6, 120 off9272 00000040:00080000:0.0:1788574514.371220:0:19574:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].7, 168 off9440 00000040:00080000:0.0:1788574514.371256:0:19574:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].8, 224 off9664 00000040:00080000:0.0:1788574514.371310:0:19574:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].9, 224 off9888 00000040:00080000:0.0:1788574514.375760:0:19574:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].10, 120 off10008 00000040:00080000:0.0:1788574514.386783:0:19574:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].11, 224 off10232 00000040:00080000:0.0:1788574514.386933:0:19574:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].12, 224 off10456 00000040:00080000:0.0:1788574514.386974:0:19574:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].13, 88 off10544 00000040:00080000:0.0:1788574514.387008:0:19574:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].14, 128 off10672 00000040:00080000:0.0:1788574514.387063:0:19574:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].15, 144 off10816 00000040:00080000:0.0:1788574514.387151:0:19574:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].16, 160 off10976 00000040:00080000:0.0:1788574514.387184:0:19574:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].17, 224 off11200 00000040:00080000:0.0:1788574514.387231:0:19574:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].18, 224 off11424 00000040:00080000:0.0:1788574514.387264:0:19574:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].19, 80 off11504 00000040:00080000:0.0:1788574514.387297:0:19574:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].20, 224 off11728 00000040:00080000:0.0:1788574514.387361:0:19574:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].21, 224 off11952 00000040:00080000:0.0:1788574514.388670:0:19574:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].22, 88 off12040 00000040:00080000:0.0:1788574514.388719:0:19574:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].23, 128 off12168 00000040:00080000:0.0:1788574514.388794:0:19574:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].24, 144 off12312 00000040:00080000:0.0:1788574514.388833:0:19574:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].25, 128 off12440 00000040:00080000:0.0:1788574514.388866:0:19574:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].26, 224 off12664 00000040:00080000:0.0:1788574514.388944:0:19574:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].27, 224 off12888 00000040:00080000:0.0:1788574514.388985:0:19574:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].28, 80 off12968 00000040:00080000:0.0:1788574514.389020:0:19574:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].29, 224 off13192 00000040:00080000:0.0:1788574514.389065:0:19574:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].30, 224 off13416 00000040:00080000:0.0:1788574514.389116:0:19574:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].31, 88 off13504 00000040:00080000:0.0:1788574514.389164:0:19574:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].32, 128 off13632 00000040:00080000:0.0:1788574514.389193:0:19574:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].33, 144 off13776 00000040:00080000:0.0:1788574514.389242:0:19574:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].34, 128 off13904 00000040:00080000:0.0:1788574514.389278:0:19574:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].35, 224 off14128 00000040:00080000:0.0:1788574514.389344:0:19574:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].36, 224 off14352 00000040:00080000:0.0:1788574514.398251:0:19574:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].37, 80 off14432 00000040:00080000:0.0:1788574514.402036:0:19574:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].38, 224 off14656 00000040:00080000:0.0:1788574514.402163:0:19574:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].39, 224 off14880 00000040:00080000:0.0:1788574514.402203:0:19574:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].40, 120 off15000 00000100:00100000:0.0:1788574514.402273:0:19574:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a6839d1c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:64047b6f-0fa6-4004-9f51-bd636ae04daf:19574:1875455747684096:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788574514.407186:0:19574:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788574514.407256:0:19574:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a78e242840 going to sleep for 11 seconds 00000100:00100000:0.0:1788574514.409052:0:18880:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747684096 00000100:00100000:0.0:1788574514.409070:0:18880:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747684096 00000100:00100000:0.0:1788574514.409129:0:18880:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1788574514.409140:0:18880:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a785536050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:64047b6f-0fa6-4004-9f51-bd636ae04daf+16:19574:x1875455747684096:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788574514.413185:0:18880:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a785536050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:64047b6f-0fa6-4004-9f51-bd636ae04daf+16:19574:x1875455747684096:12345-0@lo:502:mount.lustre.0 Request processed in 4032us (5997us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574514.413203:0:18880:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1788574514.414052:0:19574:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a6839d1c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:64047b6f-0fa6-4004-9f51-bd636ae04daf:19574:1875455747684096:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1788574514.414243:0:19574:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].41, 224 off15224 00000040:00080000:0.0:1788574514.414267:0:19574:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 41 count 42 00000020:01000004:3.0:1788574514.428869:0:19598:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:3.0:1788574514.428891:0:19598:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff90a791dcb380) 00000020:00000080:3.0:1788574514.428934:0:19598:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type lwp with refcount 2 00000020:01000004:3.0:1788574514.429046:0:19598:0:(tgt_mount.c:153:server_get_mount()) get mount ffff90a7a773a000 from lustre-OST0000, refs=3 00000020:01000004:3.0:1788574514.429051:0:19598:0:(tgt_mount.c:187:server_put_mount()) put mount ffff90a7a773a000 from lustre-OST0000, refs=3 00000020:01000004:3.0:1788574514.429054:0:19598:0:(obd_mount.c:710:lustre_put_lsi()) put ffff90a7a773a000 3 00010000:00080000:3.0:1788574514.429106:0:19598:0:(ldlm_lib.c:102:import_set_conn()) imp ffff90a7a6d51800@lustre-MDT0000-lwp-OST0000: add connection 192.168.201.157@tcp at head 00010000:00010000:3.0:1788574514.442305:0:19598:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-4 is initialized 00000020:00000080:3.0:1788574514.443051:0:19598:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:3.0:1788574514.443101:0:19598:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1788574514.443116:0:19598:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0x10531a153b537160 00000100:00080000:3.0:1788574514.443128:0:19598:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1788574514.443135:0:19598:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff90a7a6d51800 using connection 192.168.201.157@tcp/0@lo 00000100:00100000:3.0:1788574514.443175:0:19598:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff90a7bbebf800 x1875455747684224/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788574514.443232:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a7bbebf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3311:1875455747684224:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1788574514.443309:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788574514.443967:0:18888:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747684224 00000100:00100000:3.0:1788574514.443977:0:18888:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747684224 00000100:00100000:3.0:1788574514.444021:0:18888:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788574514.444040:0:18888:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7bbebc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3311:x1875455747684224:12345-0@lo:38:llog_process_th.0 00010000:00080000:3.0:1788574514.444071:0:18888:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 640 last 0 00000020:00000080:3.0:1788574514.444118:0:18888:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0x10531a153b537167 00000004:00100000:3.0:1788574514.444135:0:18888:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1788574514.444174:0:18888:0:(import.c:65:import_set_state_nolock()) ffff90a785f00800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788574514.444242:0:18888:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7bbebc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1875455747684224:12345-0@lo:38:llog_process_th.0 Request processed in 201us (932us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574514.444250:0:18888:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:3.0:1788574514.444322:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff90a7bbebf800 x1875455747684224/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788574524 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788574514.444333:0:3311:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1788574514.444340:0:3311:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 3 00000100:00080000:3.0:1788574514.444348:0:3311:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:3.0:1788574514.444352:0:3311:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1788574514.444355:0:3311:0:(import.c:65:import_set_state_nolock()) ffff90a7a6d51800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1788574514.444360:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a7bbebf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3311:1875455747684224:0@lo:38:llog_process_th.0 00000100:00080000:3.0:1788574514.446650:0:19598:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00080000:3.0:1788574514.446684:0:489:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788574514.446689:0:489:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788574514.446692:0:489:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788574514.446694:0:489:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1788574514.446762:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a7bbebf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3313:1875455747684352:0@lo:400:kworker.0 00000100:00100000:3.0:1788574514.447188:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788574514.447272:0:18887:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747684352 00000100:00100000:3.0:1788574514.447524:0:18887:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747684352 00000100:00100000:3.0:1788574514.447592:0:18887:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788574514.447603:0:18887:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7bbebd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1875455747684352:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788574514.447672:0:18887:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7bbebd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1875455747684352:12345-0@lo:400:kworker.0 Request processed in 71us (485us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574514.447680:0:18887:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:3.0:1788574514.447729:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff90a7bbebf800 x1875455747684352/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788574530 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788574514.447750:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a7bbebf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3313:1875455747684352:0@lo:400:kworker.0 00000040:00080000:1.0:1788574514.455674:0:19598:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x10:0x0] index 42 count 42 00000020:01000000:0.0:1788574514.456079:0:19574:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:0.0:1788574514.456111:0:19574:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.157@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1788574514.456143:0:19574:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.157@tcp lock: ffff90a790a20800/0x10531a153b53714b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x10531a153b537152 expref: -99 pid: 19574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574514.456158:0:19574:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.157@tcp lock: ffff90a790a20800/0x10531a153b53714b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x10531a153b537152 expref: -99 pid: 19574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1788574514.456228:0:19574:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1788574514.456231:0:19574:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1788574514.456232:0:19574:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788574514.456234:0:19574:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788574514.456240:0:19574:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788574514.456242:0:19574:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788574514.456243:0:19574:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788574514.456245:0:19574:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788574514.456246:0:19574:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1788574514.456250:0:19574:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020002 00000020:01000004:0.0:1788574514.456253:0:19574:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1788574514.456254:0:19574:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1788574514.456255:0:19574:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788574514.456255:0:19574:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788574514.456256:0:19574:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788574514.456257:0:19574:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788574514.456258:0:19574:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788574514.456259:0:19574:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788574514.456260:0:19574:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1788574514.456287:0:19574:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:0.0:1788574514.456322:0:19574:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a6839d1c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:64047b6f-0fa6-4004-9f51-bd636ae04daf:19574:1875455747684480:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1788574514.459440:0:19574:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788574514.459515:0:19574:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a78e242840 going to sleep for 11 seconds 00000100:00100000:1.0:1788574514.460341:0:18879:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747684480 00000100:00100000:1.0:1788574514.460355:0:18879:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747684480 00000100:00100000:1.0:1788574514.460469:0:18879:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1788574514.460481:0:18879:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a785535c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:64047b6f-0fa6-4004-9f51-bd636ae04daf+16:19574:x1875455747684480:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1788574514.460522:0:18879:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:1.0:1788574514.460539:0:18879:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:2.0:1788574514.606106:0:18879:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1788574514.606121:0:18879:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:0.0:1788574514.606623:0:18902:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1788574514.606632:0:18902:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1788574514.606668:0:18902:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff90a68116a200/0x10531a153b53716e lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574514.606693:0:18902:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90a68116a400/0x10531a153b5370db lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x10531a153b5370d4 expref: 16 pid: 18881 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574514.606703:0:18902:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff90a68116a200/0x10531a153b53716e lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 18902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574514.606759:0:18902:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90a68116a400/0x10531a153b5370db lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x10531a153b5370d4 expref: 16 pid: 18881 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574514.606776:0:18902:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff90a68116a400/0x10531a153b5370db lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x10531a153b5370d4 expref: 16 pid: 18881 timeout: 740 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788574514.606816:0:18902:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a6839d0380 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:18902:1875455747684608:0@lo:104: 00000100:00100000:0.0:1788574514.606885:0:18902:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788574514.606956:0:18902:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a79b147b40 going to sleep for 11 seconds 00000100:00100000:2.0:1788574514.607172:0:18869:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747684608 00000100:00100000:2.0:1788574514.607181:0:18869:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747684608 00000100:00100000:2.0:1788574514.607228:0:18869:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788574514.607239:0:18869:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6839d1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:64047b6f-0fa6-4004-9f51-bd636ae04daf+3:18902:x1875455747684608:12345-0@lo:104: 00010000:00010000:2.0:1788574514.607253:0:18869:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.157@tcp lock: ffff90a78165a400/0x10531a153b5370d4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x10531a153b5370db expref: -99 pid: 18883 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574514.607305:0:18869:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788574514.607312:0:18869:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6839d1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:64047b6f-0fa6-4004-9f51-bd636ae04daf+3:18902:x1875455747684608:12345-0@lo:104: Request processed in 75us (428us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574514.607320:0:18869:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00010000:2.0:1788574514.607343:0:18875:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788574514.607349:0:18875:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.157@tcp lock: ffff90a78165a400/0x10531a153b5370d4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x10531a153b5370db expref: -99 pid: 18883 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574514.607358:0:18875:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a78165a400 already unused, calling callback (ffffffffc1bbcc20) 10000000:00010000:2.0:1788574514.607362:0:18875:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.157@tcp lock: ffff90a78165a400/0x10531a153b5370d4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x10531a153b5370db expref: -99 pid: 18883 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574514.607428:0:18875:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.157@tcp lock: ffff90a78165a400/0x10531a153b5370d4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x10531a153b5370db expref: -99 pid: 18883 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788574514.607436:0:18875:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.157@tcp lock: ffff90a78165a400/0x10531a153b5370d4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x10531a153b5370db expref: -99 pid: 18883 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788574514.607442:0:18875:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1788574514.607471:0:18875:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.157@tcp lock: ffff90a78165a400/0x10531a153b5370d4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x10531a153b5370db expref: -99 pid: 18883 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574514.607478:0:18875:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788574514.607496:0:18875:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.157@tcp lock: ffff90a78165a400/0x10531a153b5370d4 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x10531a153b5370db expref: -99 pid: 18883 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574514.607606:0:18875:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.157@tcp lock: ffff90a78165a400/0x10531a153b5370d4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x10531a153b5370db expref: -99 pid: 18883 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574514.607625:0:18875:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788574514.607626:0:18875:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788574514.607628:0:18875:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788574514.607649:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788574514.607659:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a7bb28aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:64047b6f-0fa6-4004-9f51-bd636ae04daf:3315:1875455747684736:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788574514.607692:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788574514.607729:0:18871:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747684736 00000100:00100000:2.0:1788574514.607734:0:18871:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747684736 00010000:00010000:2.0:1788574514.607749:0:18871:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90a68116a400/0x10531a153b5370db lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x10531a153b5370d4 expref: 17 pid: 18881 timeout: 740 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788574514.607768:0:18871:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788574514.608044:0:18871:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7bb289f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:64047b6f-0fa6-4004-9f51-bd636ae04daf+17:3315:x1875455747684736:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788574514.608056:0:18871:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788574514.608062:0:18871:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90a68116a400/0x10531a153b5370db lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x10531a153b5370d4 expref: 17 pid: 18881 timeout: 740 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574514.608075:0:18871:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90a68116a400/0x10531a153b5370db lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x10531a153b5370d4 expref: 17 pid: 18881 timeout: 740 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574514.608093:0:18871:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff90a68116a200/0x10531a153b53716e lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 18902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574514.608102:0:18871:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90a68116a200/0x10531a153b53716e lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 18902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1788574514.608116:0:18871:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.001487345s 00010000:00010000:2.0:1788574514.608121:0:18871:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff90a68116a200/0x10531a153b53716e lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 18902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574514.608128:0:18871:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff90a68116a200/0x10531a153b53716e lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 18902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574514.608137:0:18871:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff90a68116a200/0x10531a153b53716e lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 18902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574514.608144:0:18871:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff90a68116a200/0x10531a153b53716e lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 18902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574514.608149:0:18871:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a68116a200 already unused, calling callback (ffffffffc159f4f0) 00010000:00010000:2.0:1788574514.608154:0:18871:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff90a68116a200/0x10531a153b53716e lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 18902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574514.608172:0:18871:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff90a68116a200/0x10531a153b53716e lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 18902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574514.608182:0:18871:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff90a68116a200/0x10531a153b53716e lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 18902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574514.608193:0:18871:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788574514.608224:0:18871:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7bb289f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:64047b6f-0fa6-4004-9f51-bd636ae04daf+17:3315:x1875455747684736:12345-0@lo:103:ldlm_bl.0 Request processed in 183us (531us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574514.608232:0:18871:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788574514.608267:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a7bb28aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:64047b6f-0fa6-4004-9f51-bd636ae04daf:3315:1875455747684736:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788574514.608428:0:18902:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90a68116a400/0x10531a153b5370db lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x10531a153b5370d4 expref: 16 pid: 18881 timeout: 740 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788574514.608441:0:18902:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a6839d0380 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:18902:1875455747684608:0@lo:104: 00010000:00010000:0.0:1788574514.608453:0:18902:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff90a68116a200/0x10531a153b53716e lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 18902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574514.608462:0:18902:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff90a68116a200/0x10531a153b53716e lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 18902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574514.608468:0:18902:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff90a68116a200/0x10531a153b53716e lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 18902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574514.608473:0:18902:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90a68116a200/0x10531a153b53716e lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 18902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788574514.666273:0:18879:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a785535c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:64047b6f-0fa6-4004-9f51-bd636ae04daf+15:19574:x1875455747684480:12345-0@lo:253:mount.lustre.0 Request processed in 205784us (206843us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574514.666287:0:18879:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1788574514.666445:0:19574:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a6839d1c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:64047b6f-0fa6-4004-9f51-bd636ae04daf:19574:1875455747684480:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1788574514.666464:0:19574:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:1.0:1788574514.666468:0:19574:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1788574514.666469:0:19574:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1788574514.666471:0:19574:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788574514.666472:0:19574:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788574514.666473:0:19574:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788574514.666474:0:19574:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788574514.666476:0:19574:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788574514.666496:0:19574:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788574514.666498:0:19574:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:1.0:1788574514.666527:0:19574:0:(tgt_mount.c:2698:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:1.0:1788574514.667067:0:19574:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:1.0:1788574514.667245:0:19574:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:1.0:1788574514.667401:0:19574:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:1.0:1788574514.667520:0:19574:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:1.0:1788574514.667653:0:19574:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:1.0:1788574514.667848:0:19574:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:3.0:1788574514.676131:0:19574:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 3, last_transno is 12884901888 00002000:00080000:3.0:1788574514.856047:0:19574:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:3.0:1788574514.856059:0:19574:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:3.0:1788574514.856097:0:19574:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:3.0:1788574514.856166:0:19574:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.201.157@tcp: cl_mgc_mutex unlock 00000020:01000004:3.0:1788574514.856184:0:19574:0:(tgt_mount.c:2464:server_fill_super_common()) Server sb, dev=48 00000080:00000004:3.0:1788574514.856221:0:19574:0:(super25.c:182:lustre_fill_super()) lustre-ost1/ost1: Mount complete 00010000:00010000:2.0:1788574515.017078:0:18874:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788574516.033003:0:18875:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1788574516.097437:0:18883:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1788574516.097445:0:18883:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff90a79fbec800 from 10 10000000:01000000:2.0:1788574516.097450:0:18883:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1788574516.097499:0:18883:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.157@tcp lock: ffff90a79e984000/0x10531a153b537175 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 18883 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574516.097513:0:18883:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.157@tcp lock: ffff90a79e984000/0x10531a153b537175 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 18883 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574516.097525:0:18883:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.157@tcp lock: ffff90a79e984000/0x10531a153b537175 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 18883 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788574516.097551:0:18883:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a7bb28aa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:64047b6f-0fa6-4004-9f51-bd636ae04daf:18883:1875455747684864:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788574516.097632:0:18883:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788574516.097692:0:18883:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a785ffe180 going to sleep for 11 seconds 00000100:00100000:3.0:1788574516.098861:0:18880:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747684864 00000100:00100000:3.0:1788574516.098878:0:18880:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747684864 00000100:00100000:3.0:1788574516.098941:0:18880:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1788574516.098951:0:18880:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a79e7eb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:64047b6f-0fa6-4004-9f51-bd636ae04daf+15:18883:x1875455747684864:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788574516.098968:0:18880:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788574516.098986:0:18880:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90a78165a200/0x10531a153b53717c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x10531a153b537175 expref: -99 pid: 18880 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574516.099010:0:18880:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90a78165a200/0x10531a153b53717c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x10531a153b537175 expref: 16 pid: 18880 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574516.099034:0:18880:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90a78165a200/0x10531a153b53717c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x10531a153b537175 expref: 16 pid: 18880 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574516.099045:0:18880:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a78165a200, rc 0) 00000100:00100000:3.0:1788574516.099119:0:18880:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a79e7eb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:64047b6f-0fa6-4004-9f51-bd636ae04daf+16:18883:x1875455747684864:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 170us (1486us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574516.099127:0:18880:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1788574516.099942:0:18883:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a7bb28aa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:64047b6f-0fa6-4004-9f51-bd636ae04daf:18883:1875455747684864:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788574516.099967:0:18883:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.157@tcp lock: ffff90a79e984000/0x10531a153b537175 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x10531a153b53717c expref: -99 pid: 18883 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574516.099978:0:18883:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.157@tcp lock: ffff90a79e984000/0x10531a153b537175 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x10531a153b53717c expref: -99 pid: 18883 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788574516.100046:0:18883:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a7a72b8a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:64047b6f-0fa6-4004-9f51-bd636ae04daf:18883:1875455747684992:0@lo:256:ll_cfg_requeue.0 00000100:00100000:1.0:1788574516.100088:0:18883:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788574516.100115:0:18883:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a7932d1540 going to sleep for 11 seconds 00000100:00100000:2.0:1788574516.101393:0:18881:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747684992 00000100:00100000:2.0:1788574516.101410:0:18881:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747684992 00000100:00100000:2.0:1788574516.101476:0:18881:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1788574516.101486:0:18881:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a79e7eb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:64047b6f-0fa6-4004-9f51-bd636ae04daf+16:18883:x1875455747684992:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:2.0:1788574516.101515:0:18881:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1788574516.101543:0:18881:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1788574516.101547:0:18881:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 10 00000100:00100000:2.0:1788574516.108628:0:18881:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a79e7eb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:64047b6f-0fa6-4004-9f51-bd636ae04daf+16:18883:x1875455747684992:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 7130us (8525us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574516.108645:0:18881:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1788574516.108741:0:18883:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a7a72b8a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:64047b6f-0fa6-4004-9f51-bd636ae04daf:18883:1875455747684992:0@lo:256:ll_cfg_requeue.0 10000000:01000000:1.0:1788574516.110133:0:18883:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.157@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1788574516.110152:0:18883:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.157@tcp lock: ffff90a79e984000/0x10531a153b537175 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x10531a153b53717c expref: -99 pid: 18883 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574516.110170:0:18883:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.157@tcp lock: ffff90a79e984000/0x10531a153b537175 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x10531a153b53717c expref: -99 pid: 18883 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574517.066144:0:18874:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788574518.089057:0:18875:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788574519.114053:0:18874:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1788574519.936909:0:489:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788574519.936916:0:489:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1788574519.936919:0:489:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788574519.936923:0:489:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1788574519.936967:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a6839d0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:64047b6f-0fa6-4004-9f51-bd636ae04daf:3315:1875455747685120:0@lo:400:kworker.0 00000100:00100000:0.0:1788574519.937042:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788574519.937107:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a6839d1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3312:1875455747685248:0@lo:400:kworker.0 00000100:00100000:0.0:1788574519.937143:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788574519.937163:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788574519.937178:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a6839d0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3312:1875455747685376:0@lo:400:kworker.0 00000100:00100000:0.0:1788574519.937200:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788574519.937228:0:18879:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747685120 00000100:00100000:0.0:1788574519.937237:0:18879:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747685120 00000100:00100000:0.0:1788574519.937297:0:18879:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1788574519.937308:0:18879:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a79e7e9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:64047b6f-0fa6-4004-9f51-bd636ae04daf+16:3315:x1875455747685120:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788574519.937352:0:18879:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a79e7e9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:64047b6f-0fa6-4004-9f51-bd636ae04daf+16:3315:x1875455747685120:12345-0@lo:400:kworker.0 Request processed in 44us (309us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574519.937358:0:18879:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1788574519.937413:0:18886:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747685248 00000100:00100000:0.0:1788574519.937416:0:18886:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747685248 00000100:00100000:0.0:1788574519.937435:0:18886:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747685376 00000100:00100000:0.0:1788574519.937437:0:18886:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747685376 00000100:00100000:0.0:1788574519.937459:0:18886:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788574519.937464:0:18886:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6839d3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1875455747685248:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788574519.937492:0:18886:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6839d3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1875455747685248:12345-0@lo:400:kworker.0 Request processed in 28us (348us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574519.937498:0:18886:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788574519.937507:0:18886:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788574519.937512:0:18886:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6839d3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1875455747685376:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788574519.937531:0:18886:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6839d3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1875455747685376:12345-0@lo:400:kworker.0 Request processed in 19us (331us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574519.937536:0:18886:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:0.0:1788574519.937585:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff90a6839d0a80 x1875455747685376/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788574535 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788574519.937610:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a6839d0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3312:1875455747685376:0@lo:400:kworker.0 00010000:00080000:0.0:1788574519.937620:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff90a6839d1f80 x1875455747685248/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788574535 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788574519.937628:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a6839d1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3312:1875455747685248:0@lo:400:kworker.0 00000100:00100000:0.0:1788574519.937649:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a6839d0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:64047b6f-0fa6-4004-9f51-bd636ae04daf:3315:1875455747685120:0@lo:400:kworker.0 00000100:00080000:3.0:1788574519.938939:0:18882:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1788574520.138686:0:18875:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788574520.641431:0:18921:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1788574521.156869:0:18874:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788574522.179769:0:18875:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788574522.628009:0:3311:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788574507/real 1788574507] req@ffff90a7a72baa00 x1875455747680768/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788574522 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788574522.628044:0:3311:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff90a7a72baa00 x1875455747680768/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788574522 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788574522.628063:0:3311:0:(import.c:65:import_set_state_nolock()) ffff90a7b1b65000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788574522.628084:0:3311:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1788574522.628088:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a7a72baa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3311:1875455747680768:0@lo:8:kworker.0 00000100:00080000:1.0:1788574522.628218:0:13890:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788574522.628222:0:13890:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:1.0:1788574522.628225:0:13890:0:(import.c:65:import_set_state_nolock()) ffff90a7b1b65000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788574522.628230:0:13890:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 633 00000100:00080000:1.0:1788574522.628244:0:13890:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:1.0:1788574522.628253:0:13890:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff90a7b1b65000 using connection 192.168.201.157@tcp/0@lo 00000100:00100000:1.0:1788574522.628275:0:13890:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff90a7a72b8000 x1875455747685632/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788574522.628490:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a7a72b8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:64047b6f-0fa6-4004-9f51-bd636ae04daf:3314:1875455747685504:0@lo:400:kworker.0 00000100:00100000:2.0:1788574522.628568:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788574522.628639:0:18880:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747685504 00000100:00100000:2.0:1788574522.628649:0:18880:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747685504 00000100:00100000:2.0:1788574522.628707:0:18880:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1788574522.628731:0:18880:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a79e7e9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:64047b6f-0fa6-4004-9f51-bd636ae04daf+16:3314:x1875455747685504:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788574522.628788:0:18880:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a79e7e9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:64047b6f-0fa6-4004-9f51-bd636ae04daf+16:3314:x1875455747685504:12345-0@lo:400:kworker.0 Request processed in 58us (219us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574522.628796:0:18880:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1788574522.628850:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a7a72b8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:64047b6f-0fa6-4004-9f51-bd636ae04daf:3314:1875455747685504:0@lo:400:kworker.0 00000100:00080000:1.0:1788574522.628982:0:13890:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788574522.628986:0:13890:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1788574522.629069:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a7a72b8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3311:1875455747685632:0@lo:8:kworker.0 00000100:00100000:2.0:1788574522.629098:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788574522.629136:0:19575:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747685632 00000100:00100000:2.0:1788574522.629139:0:19575:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747685632 00000100:00100000:0.0:1788574522.630223:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a7a72bad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3315:1875455747685760:0@lo:400:kworker.0 00000100:00100000:0.0:1788574522.630292:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788574522.630341:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a7a72ba300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3312:1875455747685888:0@lo:400:kworker.0 00000100:00100000:0.0:1788574522.630391:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788574522.630428:0:18887:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747685760 00000100:00100000:0.0:1788574522.630434:0:18887:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747685760 00000100:00100000:0.0:1788574522.630759:0:18887:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747685888 00000100:00100000:0.0:1788574522.630763:0:18887:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747685888 00000100:00100000:0.0:1788574522.630804:0:18887:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788574522.630814:0:18887:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6839d0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1875455747685760:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788574522.630881:0:18887:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6839d0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1875455747685760:12345-0@lo:400:kworker.0 Request processed in 68us (588us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574522.630890:0:18887:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788574522.630909:0:18887:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788574522.630916:0:18887:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6839d1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1875455747685888:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788574522.630949:0:18887:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6839d1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1875455747685888:12345-0@lo:400:kworker.0 Request processed in 34us (583us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574522.630968:0:18887:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00080000:0.0:1788574522.630990:0:18882:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1788574522.631022:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff90a7a72bad80 x1875455747685760/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788574538 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788574522.631038:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a7a72bad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3315:1875455747685760:0@lo:400:kworker.0 00010000:00080000:0.0:1788574522.631065:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff90a7a72ba300 x1875455747685888/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788574538 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788574522.631074:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a7a72ba300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3312:1875455747685888:0@lo:400:kworker.0 00000100:00100000:2.0:1788574522.633689:0:19575:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788574522.633702:0:19575:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7bb28b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3311:x1875455747685632:12345-0@lo:8:kworker.0 00010000:00080000:2.0:1788574522.633738:0:19575:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 648 last 0 00000020:00000080:2.0:1788574522.633769:0:19575:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x10531a153b537183 00002000:00100000:2.0:1788574522.633785:0:19575:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff90a681291000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a03 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:2.0:1788574522.633789:0:19575:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00002000:00100000:2.0:1788574522.633792:0:19575:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:2.0:1788574522.634155:0:19575:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1788574522.634183:0:19575:0:(import.c:65:import_set_state_nolock()) ffff90a681293800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788574522.634277:0:19575:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7bb28b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3311:x1875455747685632:12345-0@lo:8:kworker.0 Request processed in 575us (5178us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574522.634296:0:19575:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:3.0:1788574522.648907:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff90a7a72b8000 x1875455747685632/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788574542 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788574522.648925:0:3311:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1788574522.648941:0:3311:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 3 00000100:00080000:3.0:1788574522.648952:0:3311:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:3.0:1788574522.648959:0:3311:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:3.0:1788574522.648963:0:3311:0:(import.c:65:import_set_state_nolock()) ffff90a7b1b65000 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:3.0:1788574522.648991:0:3311:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:3.0:1788574522.648998:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a7a72b8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3311:1875455747685632:0@lo:8:kworker.0 00000004:00080000:1.0:1788574522.649158:0:18909:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x240000400:0x6:0x0] 00000100:00100000:1.0:1788574522.649184:0:18909:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a7a72b8380 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:18909:1875455747686144:0@lo:5:osp-pre-0-0.0 00000100:00100000:1.0:1788574522.649271:0:18909:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788574522.649306:0:18909:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a79e8e9c00 going to sleep for 11 seconds 00000100:00100000:3.0:1788574522.651396:0:19577:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747686144 00000100:00100000:3.0:1788574522.651411:0:19577:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747686144 00000100:00100000:3.0:1788574522.651488:0:19577:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788574522.651499:0:19577:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7a72b9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:18909:x1875455747686144:12345-0@lo:5:osp-pre-0-0.0 00000100:00080000:1.0:1788574522.651574:0:18882:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788574522.652847:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a7a72b8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1875455747686016:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788574522.652934:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00080000:3.0:1788574522.661752:0:19577:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x240000400 00002000:00080000:3.0:1788574522.661769:0:19577:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 65 -> diff = -59 00002000:02000040:3.0:1788574522.661775:0:19577:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x240000400:7 to 0x240000400:65) 00000100:00100000:2.0:1788574522.663038:0:19579:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747686016 00000100:00100000:2.0:1788574522.663050:0:19579:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747686016 00000100:00100000:2.0:1788574522.663110:0:19579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788574522.663121:0:19579:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7a72bb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3313:x1875455747686016:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788574522.663160:0:19579:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788574522.663286:0:19579:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7a72bb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3313:x1875455747686016:12345-0@lo:13:osp-pre-0-0.0 Request processed in 161us (10347us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574522.663293:0:19579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000004:00080000:2.0:1788574522.663327:0:18908:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:2.0:1788574522.663726:0:18908:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 648838356955ns, next at 0ns, rc = 0 00010000:00080000:2.0:1788574522.663888:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff90a7a72b8e00 x1875455747686016/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788574538 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788574522.663911:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a7a72b8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1875455747686016:0@lo:13:osp-pre-0-0.0 00002000:00010000:3.0:1788574522.693714:0:19577:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x41:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788574522.693725:0:19577:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001cf035e6/0x10531a153b53718a lrc: 3/0,1 mode: --/PW res: [0x240000400:0x41:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574522.693741:0:19577:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x41:0x0].0x0 since=648s v=(0 0) 00010000:00010000:3.0:1788574522.693746:0:19577:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x41:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788574522.693752:0:19577:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001cf035e6/0x10531a153b53718a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574522.694396:0:19577:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001cf035e6/0x10531a153b53718a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574522.694410:0:19577:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001cf035e6/0x10531a153b53718a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574522.694419:0:19577:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001cf035e6/0x10531a153b53718a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574522.694439:0:19577:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788574522.694452:0:18874:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788574522.694458:0:18874:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001cf035e6/0x10531a153b53718a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574522.694466:0:18874:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a78165aa00 already unused, calling callback (ffffffffc159f4f0) 00010000:00010000:3.0:1788574522.694472:0:18874:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001cf035e6/0x10531a153b53718a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574522.694495:0:18874:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001cf035e6/0x10531a153b53718a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574522.694512:0:18874:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001cf035e6/0x10531a153b53718a lrc: 1/0,0 mode: --/PW res: [0x240000400:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574522.694521:0:18874:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001cf035e6/0x10531a153b53718a lrc: 0/0,0 mode: --/PW res: [0x240000400:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574522.694540:0:18874:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788574522.694542:0:18874:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788574522.694544:0:18874:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788574522.699675:0:19577:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x40:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788574522.699693:0:19577:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e43053d4/0x10531a153b537191 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x40:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574522.699710:0:19577:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x40:0x0].0x0 since=648s v=(0 0) 00010000:00010000:3.0:1788574522.699715:0:19577:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x40:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788574522.699721:0:19577:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e43053d4/0x10531a153b537191 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574522.699738:0:19577:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e43053d4/0x10531a153b537191 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574522.699750:0:19577:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e43053d4/0x10531a153b537191 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574522.701935:0:19577:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e43053d4/0x10531a153b537191 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574522.702000:0:19577:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788574522.702017:0:18875:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788574522.702022:0:18875:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e43053d4/0x10531a153b537191 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574522.702878:0:18875:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a78165a400 already unused, calling callback (ffffffffc159f4f0) 00010000:00010000:3.0:1788574522.702887:0:18875:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e43053d4/0x10531a153b537191 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574522.702903:0:18875:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e43053d4/0x10531a153b537191 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574522.702923:0:18875:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e43053d4/0x10531a153b537191 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574522.702931:0:18875:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e43053d4/0x10531a153b537191 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574522.702953:0:18875:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788574522.702955:0:18875:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788574522.702957:0:18875:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788574522.710673:0:19577:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x3f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788574522.710703:0:19577:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001cf035e6/0x10531a153b537198 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574522.710720:0:19577:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3f:0x0].0x0 since=648s v=(0 0) 00010000:00010000:3.0:1788574522.710725:0:19577:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788574522.710731:0:19577:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001cf035e6/0x10531a153b537198 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574522.710747:0:19577:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001cf035e6/0x10531a153b537198 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574522.710758:0:19577:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001cf035e6/0x10531a153b537198 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574522.710766:0:19577:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001cf035e6/0x10531a153b537198 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574522.710787:0:19577:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788574522.710802:0:18874:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788574522.710809:0:18874:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001cf035e6/0x10531a153b537198 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574522.710816:0:18874:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a78165aa00 already unused, calling callback (ffffffffc159f4f0) 00010000:00010000:3.0:1788574522.710820:0:18874:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001cf035e6/0x10531a153b537198 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574522.710829:0:18874:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001cf035e6/0x10531a153b537198 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574522.710852:0:18874:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001cf035e6/0x10531a153b537198 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574522.710860:0:18874:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001cf035e6/0x10531a153b537198 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574522.710878:0:18874:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788574522.710880:0:18874:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788574522.710882:0:18874:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788574522.714453:0:19577:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x3e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788574522.714471:0:19577:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000129c9b7b/0x10531a153b53719f lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574522.714487:0:19577:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3e:0x0].0x0 since=648s v=(0 0) 00010000:00010000:3.0:1788574522.714492:0:19577:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788574522.714498:0:19577:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000129c9b7b/0x10531a153b53719f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574522.714512:0:19577:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000129c9b7b/0x10531a153b53719f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574522.714523:0:19577:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000129c9b7b/0x10531a153b53719f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574522.714530:0:19577:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000129c9b7b/0x10531a153b53719f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574522.714556:0:19577:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788574522.714568:0:18875:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788574522.714573:0:18875:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000129c9b7b/0x10531a153b53719f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574522.714580:0:18875:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a78165a000 already unused, calling callback (ffffffffc159f4f0) 00010000:00010000:3.0:1788574522.714585:0:18875:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000129c9b7b/0x10531a153b53719f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574522.714593:0:18875:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000129c9b7b/0x10531a153b53719f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574522.714609:0:18875:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000129c9b7b/0x10531a153b53719f lrc: 1/0,0 mode: --/PW res: [0x240000400:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574522.714618:0:18875:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000129c9b7b/0x10531a153b53719f lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574522.714636:0:18875:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788574522.714638:0:18875:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788574522.714639:0:18875:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788574522.718479:0:19577:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x3d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788574522.718496:0:19577:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000007e165f1/0x10531a153b5371a6 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574522.718513:0:19577:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3d:0x0].0x0 since=648s v=(0 0) 00010000:00010000:3.0:1788574522.718525:0:19577:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788574522.718532:0:19577:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000007e165f1/0x10531a153b5371a6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574522.718547:0:19577:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000007e165f1/0x10531a153b5371a6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574522.718557:0:19577:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000007e165f1/0x10531a153b5371a6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574522.718565:0:19577:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000007e165f1/0x10531a153b5371a6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574522.718589:0:19577:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788574522.720517:0:18874:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788574522.720529:0:18874:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000007e165f1/0x10531a153b5371a6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574522.720543:0:18874:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a78165a800 already unused, calling callback (ffffffffc159f4f0) 00010000:00010000:2.0:1788574522.720547:0:18874:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000007e165f1/0x10531a153b5371a6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574522.720557:0:18874:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000007e165f1/0x10531a153b5371a6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574522.720582:0:18874:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000007e165f1/0x10531a153b5371a6 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574522.720589:0:18874:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000007e165f1/0x10531a153b5371a6 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574522.720616:0:18874:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788574522.720629:0:18874:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788574522.720631:0:18874:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788574522.722406:0:19577:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x3c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788574522.722420:0:19577:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e43053d4/0x10531a153b5371ad lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574522.722440:0:19577:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3c:0x0].0x0 since=648s v=(0 0) 00010000:00010000:3.0:1788574522.722446:0:19577:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788574522.722453:0:19577:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e43053d4/0x10531a153b5371ad lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574522.722470:0:19577:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e43053d4/0x10531a153b5371ad lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574522.722481:0:19577:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e43053d4/0x10531a153b5371ad lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574522.722494:0:19577:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e43053d4/0x10531a153b5371ad lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574522.722510:0:19577:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788574522.722523:0:18875:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788574522.722529:0:18875:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e43053d4/0x10531a153b5371ad lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574522.722537:0:18875:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a78165a400 already unused, calling callback (ffffffffc159f4f0) 00010000:00010000:3.0:1788574522.722541:0:18875:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e43053d4/0x10531a153b5371ad lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574522.722552:0:18875:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e43053d4/0x10531a153b5371ad lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574522.722567:0:18875:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e43053d4/0x10531a153b5371ad lrc: 1/0,0 mode: --/PW res: [0x240000400:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574522.722574:0:18875:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e43053d4/0x10531a153b5371ad lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574522.722591:0:18875:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788574522.722593:0:18875:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788574522.722594:0:18875:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788574522.723048:0:19577:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x3b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788574522.723061:0:19577:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ece4f6e4/0x10531a153b5371b4 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574522.723070:0:19577:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3b:0x0].0x0 since=648s v=(0 0) 00010000:00010000:3.0:1788574522.723073:0:19577:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788574522.723078:0:19577:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ece4f6e4/0x10531a153b5371b4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574522.723087:0:19577:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ece4f6e4/0x10531a153b5371b4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574522.723096:0:19577:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ece4f6e4/0x10531a153b5371b4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574522.723104:0:19577:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ece4f6e4/0x10531a153b5371b4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574522.723121:0:19577:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788574522.723130:0:18874:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788574522.723135:0:18874:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ece4f6e4/0x10531a153b5371b4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574522.723142:0:18874:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a78165b400 already unused, calling callback (ffffffffc159f4f0) 00010000:00010000:3.0:1788574522.723146:0:18874:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ece4f6e4/0x10531a153b5371b4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574522.723155:0:18874:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ece4f6e4/0x10531a153b5371b4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574522.723172:0:18874:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ece4f6e4/0x10531a153b5371b4 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574522.723179:0:18874:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ece4f6e4/0x10531a153b5371b4 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574522.723193:0:18874:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788574522.723195:0:18874:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788574522.723196:0:18874:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788574522.730395:0:19577:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x3a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788574522.730408:0:19577:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004586ca36/0x10531a153b5371bb lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574522.730425:0:19577:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3a:0x0].0x0 since=648s v=(0 0) 00010000:00010000:3.0:1788574522.730430:0:19577:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788574522.730436:0:19577:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004586ca36/0x10531a153b5371bb lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574522.730451:0:19577:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004586ca36/0x10531a153b5371bb lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574522.730462:0:19577:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004586ca36/0x10531a153b5371bb lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574522.730470:0:19577:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004586ca36/0x10531a153b5371bb lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574522.730505:0:19577:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788574522.731204:0:18875:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788574522.731212:0:18875:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004586ca36/0x10531a153b5371bb lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574522.731221:0:18875:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a78165b600 already unused, calling callback (ffffffffc159f4f0) 00010000:00010000:1.0:1788574522.731226:0:18875:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004586ca36/0x10531a153b5371bb lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574522.731258:0:18875:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004586ca36/0x10531a153b5371bb lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574522.731276:0:18875:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004586ca36/0x10531a153b5371bb lrc: 1/0,0 mode: --/PW res: [0x240000400:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574522.731294:0:18875:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004586ca36/0x10531a153b5371bb lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574522.731316:0:18875:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788574522.731318:0:18875:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788574522.731319:0:18875:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788574522.733002:0:19577:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x39:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788574522.733014:0:19577:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000129c9b7b/0x10531a153b5371c2 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x39:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574522.733027:0:19577:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x39:0x0].0x0 since=648s v=(0 0) 00010000:00010000:3.0:1788574522.733909:0:19577:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x39:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788574522.733918:0:19577:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000129c9b7b/0x10531a153b5371c2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574522.733936:0:19577:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000129c9b7b/0x10531a153b5371c2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574522.733948:0:19577:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000129c9b7b/0x10531a153b5371c2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574522.733955:0:19577:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000129c9b7b/0x10531a153b5371c2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574522.733977:0:19577:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788574522.733993:0:18874:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788574522.733998:0:18874:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000129c9b7b/0x10531a153b5371c2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574522.734005:0:18874:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a78165a000 already unused, calling callback (ffffffffc159f4f0) 00010000:00010000:3.0:1788574522.734021:0:18874:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000129c9b7b/0x10531a153b5371c2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574522.734100:0:18874:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000129c9b7b/0x10531a153b5371c2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574522.734117:0:18874:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000129c9b7b/0x10531a153b5371c2 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574522.734126:0:18874:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000129c9b7b/0x10531a153b5371c2 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574522.734145:0:18874:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788574522.734147:0:18874:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788574522.734149:0:18874:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788574522.738461:0:19577:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x38:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788574522.738476:0:19577:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001cf035e6/0x10531a153b5371c9 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x38:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574522.738494:0:19577:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x38:0x0].0x0 since=648s v=(0 0) 00010000:00010000:3.0:1788574522.738499:0:19577:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x38:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788574522.738507:0:19577:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001cf035e6/0x10531a153b5371c9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574522.738524:0:19577:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001cf035e6/0x10531a153b5371c9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574522.738536:0:19577:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001cf035e6/0x10531a153b5371c9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574522.738552:0:19577:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001cf035e6/0x10531a153b5371c9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574522.738570:0:19577:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788574522.738926:0:18875:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788574522.738935:0:18875:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001cf035e6/0x10531a153b5371c9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574522.738944:0:18875:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a78165aa00 already unused, calling callback (ffffffffc159f4f0) 00010000:00010000:1.0:1788574522.738949:0:18875:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001cf035e6/0x10531a153b5371c9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574522.738959:0:18875:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001cf035e6/0x10531a153b5371c9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574522.738975:0:18875:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001cf035e6/0x10531a153b5371c9 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574522.738996:0:18875:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001cf035e6/0x10531a153b5371c9 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574522.739015:0:18875:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788574522.739017:0:18875:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788574522.739019:0:18875:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788574522.742694:0:19577:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x37:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788574522.742712:0:19577:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008e36426c/0x10531a153b5371d0 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x37:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574522.742735:0:19577:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x37:0x0].0x0 since=648s v=(0 0) 00010000:00010000:3.0:1788574522.742740:0:19577:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x37:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788574522.742748:0:19577:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008e36426c/0x10531a153b5371d0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574522.742842:0:19577:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008e36426c/0x10531a153b5371d0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574522.742857:0:19577:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008e36426c/0x10531a153b5371d0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574522.742865:0:19577:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008e36426c/0x10531a153b5371d0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574522.742890:0:19577:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788574522.742907:0:18874:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788574522.742913:0:18874:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008e36426c/0x10531a153b5371d0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574522.742927:0:18874:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a78165b800 already unused, calling callback (ffffffffc159f4f0) 00010000:00010000:3.0:1788574522.742933:0:18874:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008e36426c/0x10531a153b5371d0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574522.742943:0:18874:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008e36426c/0x10531a153b5371d0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574522.742961:0:18874:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008e36426c/0x10531a153b5371d0 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574522.742968:0:18874:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008e36426c/0x10531a153b5371d0 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574522.742991:0:18874:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788574522.742993:0:18874:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788574522.742995:0:18874:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788574522.746666:0:19577:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x36:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788574522.746678:0:19577:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000129c9b7b/0x10531a153b5371d7 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x36:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574522.746694:0:19577:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x36:0x0].0x0 since=648s v=(0 0) 00010000:00010000:3.0:1788574522.746699:0:19577:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x36:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788574522.746706:0:19577:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000129c9b7b/0x10531a153b5371d7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574522.746720:0:19577:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000129c9b7b/0x10531a153b5371d7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574522.746736:0:19577:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000129c9b7b/0x10531a153b5371d7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574522.746743:0:19577:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000129c9b7b/0x10531a153b5371d7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574522.748944:0:19577:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788574522.752128:0:18875:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788574522.752144:0:18875:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000129c9b7b/0x10531a153b5371d7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574522.752158:0:18875:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a78165a000 already unused, calling callback (ffffffffc159f4f0) 00010000:00010000:1.0:1788574522.752163:0:18875:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000129c9b7b/0x10531a153b5371d7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574522.752174:0:18875:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000129c9b7b/0x10531a153b5371d7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574522.752195:0:18875:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000129c9b7b/0x10531a153b5371d7 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574522.752203:0:18875:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000129c9b7b/0x10531a153b5371d7 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574522.752225:0:18875:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788574522.752227:0:18875:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788574522.752229:0:18875:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788574522.761143:0:19577:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x35:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788574522.761160:0:19577:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ece4f6e4/0x10531a153b5371de lrc: 3/0,1 mode: --/PW res: [0x240000400:0x35:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574522.761177:0:19577:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x35:0x0].0x0 since=648s v=(0 0) 00010000:00010000:3.0:1788574522.761181:0:19577:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x35:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788574522.761188:0:19577:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ece4f6e4/0x10531a153b5371de lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574522.761202:0:19577:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ece4f6e4/0x10531a153b5371de lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574522.761213:0:19577:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ece4f6e4/0x10531a153b5371de lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574522.761220:0:19577:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ece4f6e4/0x10531a153b5371de lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574522.761264:0:19577:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788574522.761334:0:18874:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788574522.761341:0:18874:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ece4f6e4/0x10531a153b5371de lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574522.761349:0:18874:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a78165b400 already unused, calling callback (ffffffffc159f4f0) 00010000:00010000:3.0:1788574522.761354:0:18874:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ece4f6e4/0x10531a153b5371de lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574522.761363:0:18874:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ece4f6e4/0x10531a153b5371de lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574522.761394:0:18874:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ece4f6e4/0x10531a153b5371de lrc: 1/0,0 mode: --/PW res: [0x240000400:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574522.761402:0:18874:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ece4f6e4/0x10531a153b5371de lrc: 0/0,0 mode: --/PW res: [0x240000400:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574522.761422:0:18874:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788574522.761424:0:18874:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788574522.761425:0:18874:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788574522.766695:0:19577:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x34:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788574522.766708:0:19577:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008e36426c/0x10531a153b5371e5 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x34:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574522.766725:0:19577:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x34:0x0].0x0 since=648s v=(0 0) 00010000:00010000:3.0:1788574522.766735:0:19577:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x34:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788574522.766741:0:19577:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008e36426c/0x10531a153b5371e5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574522.766757:0:19577:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008e36426c/0x10531a153b5371e5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574522.766767:0:19577:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008e36426c/0x10531a153b5371e5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574522.766774:0:19577:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008e36426c/0x10531a153b5371e5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574522.766794:0:19577:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1788574522.767223:0:19577:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x33:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788574522.767592:0:18875:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788574522.767600:0:18875:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008e36426c/0x10531a153b5371e5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574522.767610:0:18875:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a78165b800 already unused, calling callback (ffffffffc159f4f0) 00010000:00010000:1.0:1788574522.767615:0:18875:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008e36426c/0x10531a153b5371e5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574522.767626:0:18875:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008e36426c/0x10531a153b5371e5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574522.767644:0:18875:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008e36426c/0x10531a153b5371e5 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574522.767653:0:18875:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008e36426c/0x10531a153b5371e5 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574522.767671:0:18875:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788574522.767672:0:18875:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788574522.767674:0:18875:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788574522.769424:0:19577:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e43053d4/0x10531a153b5371ec lrc: 3/0,1 mode: --/PW res: [0x240000400:0x33:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574522.769448:0:19577:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x33:0x0].0x0 since=648s v=(0 0) 00010000:00010000:3.0:1788574522.769453:0:19577:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x33:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788574522.769462:0:19577:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e43053d4/0x10531a153b5371ec lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574522.769478:0:19577:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e43053d4/0x10531a153b5371ec lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574522.769489:0:19577:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e43053d4/0x10531a153b5371ec lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574522.769504:0:19577:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e43053d4/0x10531a153b5371ec lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574522.770180:0:19577:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788574522.770195:0:18874:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788574522.770200:0:18874:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e43053d4/0x10531a153b5371ec lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574522.770210:0:18874:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a78165a400 already unused, calling callback (ffffffffc159f4f0) 00010000:00010000:3.0:1788574522.770214:0:18874:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e43053d4/0x10531a153b5371ec lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574522.770223:0:18874:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e43053d4/0x10531a153b5371ec lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574522.770249:0:18874:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e43053d4/0x10531a153b5371ec lrc: 1/0,0 mode: --/PW res: [0x240000400:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574522.770257:0:18874:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e43053d4/0x10531a153b5371ec lrc: 0/0,0 mode: --/PW res: [0x240000400:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574522.771120:0:18874:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788574522.771125:0:18874:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788574522.771127:0:18874:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788574522.778243:0:19577:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x32:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788574522.778271:0:19577:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ece4f6e4/0x10531a153b5371f3 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x32:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574522.778527:0:19577:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x32:0x0].0x0 since=648s v=(0 0) 00010000:00010000:3.0:1788574522.778534:0:19577:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x32:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788574522.778542:0:19577:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ece4f6e4/0x10531a153b5371f3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574522.778563:0:19577:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ece4f6e4/0x10531a153b5371f3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574522.778578:0:19577:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ece4f6e4/0x10531a153b5371f3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574522.778586:0:19577:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ece4f6e4/0x10531a153b5371f3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574522.778653:0:19577:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1788574522.780611:0:19577:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x31:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788574522.780626:0:19577:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001cf035e6/0x10531a153b5371fa lrc: 3/0,1 mode: --/PW res: [0x240000400:0x31:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574522.780641:0:19577:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x31:0x0].0x0 since=648s v=(0 0) 00010000:00010000:3.0:1788574522.780646:0:19577:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x31:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788574522.780651:0:19577:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001cf035e6/0x10531a153b5371fa lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574522.780664:0:19577:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001cf035e6/0x10531a153b5371fa lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574522.780680:0:19577:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001cf035e6/0x10531a153b5371fa lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574522.780687:0:19577:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001cf035e6/0x10531a153b5371fa lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574522.783450:0:18875:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788574522.783470:0:18875:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ece4f6e4/0x10531a153b5371f3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574522.783487:0:18875:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a78165b400 already unused, calling callback (ffffffffc159f4f0) 00010000:00010000:0.0:1788574522.783493:0:18875:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ece4f6e4/0x10531a153b5371f3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574522.783505:0:18875:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ece4f6e4/0x10531a153b5371f3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574522.783539:0:18875:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ece4f6e4/0x10531a153b5371f3 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574522.783549:0:18875:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ece4f6e4/0x10531a153b5371f3 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574522.783593:0:18875:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788574522.783598:0:18875:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001cf035e6/0x10531a153b5371fa lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574522.783604:0:18875:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a78165aa00 already unused, calling callback (ffffffffc159f4f0) 00010000:00010000:0.0:1788574522.783608:0:18875:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001cf035e6/0x10531a153b5371fa lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574522.783615:0:18875:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001cf035e6/0x10531a153b5371fa lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574522.783625:0:18875:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001cf035e6/0x10531a153b5371fa lrc: 2/0,0 mode: --/PW res: [0x240000400:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574522.783633:0:18875:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788574522.783634:0:18875:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788574522.783636:0:18875:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788574522.785409:0:19577:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1788574522.785426:0:19577:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001cf035e6/0x10531a153b5371fa lrc: 0/0,0 mode: --/PW res: [0x240000400:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788574522.786268:0:19577:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x30:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788574522.786276:0:19577:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004586ca36/0x10531a153b537201 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x30:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574522.786289:0:19577:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x30:0x0].0x0 since=648s v=(0 0) 00010000:00010000:3.0:1788574522.786294:0:19577:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x30:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788574522.786300:0:19577:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004586ca36/0x10531a153b537201 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574522.786315:0:19577:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004586ca36/0x10531a153b537201 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574522.786324:0:19577:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004586ca36/0x10531a153b537201 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574522.786343:0:19577:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004586ca36/0x10531a153b537201 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574522.786359:0:19577:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1788574522.786788:0:19577:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x2f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788574522.786795:0:19577:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000007e165f1/0x10531a153b537208 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x2f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574522.786803:0:19577:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2f:0x0].0x0 since=648s v=(0 0) 00010000:00010000:3.0:1788574522.786806:0:19577:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788574522.786810:0:19577:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000007e165f1/0x10531a153b537208 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574522.786819:0:19577:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000007e165f1/0x10531a153b537208 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574522.786826:0:19577:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000007e165f1/0x10531a153b537208 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574522.786833:0:19577:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000007e165f1/0x10531a153b537208 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574522.787050:0:18874:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788574522.787058:0:18874:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004586ca36/0x10531a153b537201 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574522.787066:0:18874:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a78165b600 already unused, calling callback (ffffffffc159f4f0) 00010000:00010000:0.0:1788574522.787071:0:18874:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004586ca36/0x10531a153b537201 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574522.787091:0:18874:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004586ca36/0x10531a153b537201 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574522.787107:0:18874:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004586ca36/0x10531a153b537201 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574522.787114:0:18874:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004586ca36/0x10531a153b537201 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574522.787134:0:18874:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788574522.787135:0:18874:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788574522.787137:0:18874:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788574522.787143:0:18875:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788574522.787601:0:19577:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788574522.788240:0:18874:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788574522.788245:0:18874:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000007e165f1/0x10531a153b537208 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574522.788253:0:18874:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a78165a800 already unused, calling callback (ffffffffc159f4f0) 00010000:00010000:0.0:1788574522.788257:0:18874:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000007e165f1/0x10531a153b537208 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574522.788266:0:18874:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000007e165f1/0x10531a153b537208 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574522.788288:0:18874:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000007e165f1/0x10531a153b537208 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574522.788301:0:18874:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000007e165f1/0x10531a153b537208 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574522.788316:0:18874:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788574522.788317:0:18874:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788574522.788319:0:18874:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788574522.788790:0:19577:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x2e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788574522.788797:0:19577:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000918afcc1/0x10531a153b53720f lrc: 3/0,1 mode: --/PW res: [0x240000400:0x2e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574522.788812:0:19577:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2e:0x0].0x0 since=648s v=(0 0) 00010000:00010000:3.0:1788574522.788816:0:19577:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788574522.788821:0:19577:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000918afcc1/0x10531a153b53720f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574522.788842:0:19577:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000918afcc1/0x10531a153b53720f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574522.788852:0:19577:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000918afcc1/0x10531a153b53720f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574522.788859:0:19577:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000918afcc1/0x10531a153b53720f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574522.788878:0:19577:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788574522.789262:0:18875:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788574522.789268:0:18875:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000918afcc1/0x10531a153b53720f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574522.789290:0:18875:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a6824f8800 already unused, calling callback (ffffffffc159f4f0) 00010000:00010000:0.0:1788574522.789293:0:18875:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000918afcc1/0x10531a153b53720f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574522.789302:0:18875:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000918afcc1/0x10531a153b53720f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574522.789314:0:18875:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000918afcc1/0x10531a153b53720f lrc: 1/0,0 mode: --/PW res: [0x240000400:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574522.789321:0:18875:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000918afcc1/0x10531a153b53720f lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574522.789334:0:18875:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788574522.789336:0:18875:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788574522.789338:0:18875:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:0.0:1788574522.792642:0:5879:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00002000:00010000:3.0:1788574522.793091:0:19577:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x2d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788574522.793102:0:19577:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000223263b8/0x10531a153b537216 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x2d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574522.793121:0:19577:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2d:0x0].0x0 since=648s v=(0 0) 00010000:00010000:3.0:1788574522.793126:0:19577:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788574522.793133:0:19577:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000223263b8/0x10531a153b537216 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574522.793148:0:19577:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000223263b8/0x10531a153b537216 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574522.793168:0:19577:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000223263b8/0x10531a153b537216 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574522.793176:0:19577:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000223263b8/0x10531a153b537216 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574522.793202:0:19577:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788574522.794576:0:18874:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788574522.794587:0:18874:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000223263b8/0x10531a153b537216 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574522.794597:0:18874:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a6824f8000 already unused, calling callback (ffffffffc159f4f0) 00010000:00010000:0.0:1788574522.794602:0:18874:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000223263b8/0x10531a153b537216 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574522.794611:0:18874:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000223263b8/0x10531a153b537216 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574522.794629:0:18874:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000223263b8/0x10531a153b537216 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574522.794637:0:18874:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000223263b8/0x10531a153b537216 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574522.794658:0:18874:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788574522.794660:0:18874:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788574522.794662:0:18874:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788574522.795177:0:19577:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x2c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788574522.795186:0:19577:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001f69996f/0x10531a153b53721d lrc: 3/0,1 mode: --/PW res: [0x240000400:0x2c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574522.795197:0:19577:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2c:0x0].0x0 since=648s v=(0 0) 00010000:00010000:3.0:1788574522.795201:0:19577:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788574522.795206:0:19577:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001f69996f/0x10531a153b53721d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574522.795217:0:19577:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001f69996f/0x10531a153b53721d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574522.795227:0:19577:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001f69996f/0x10531a153b53721d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574522.795244:0:19577:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001f69996f/0x10531a153b53721d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574522.796983:0:19577:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1788574522.797897:0:19577:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x2b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788574522.797906:0:19577:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006e81cbbd/0x10531a153b537224 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x2b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574522.797921:0:19577:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2b:0x0].0x0 since=648s v=(0 0) 00010000:00010000:3.0:1788574522.797926:0:19577:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788574522.797933:0:19577:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006e81cbbd/0x10531a153b537224 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574522.797947:0:19577:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006e81cbbd/0x10531a153b537224 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574522.797956:0:19577:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006e81cbbd/0x10531a153b537224 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574522.797963:0:19577:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006e81cbbd/0x10531a153b537224 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574522.797985:0:19577:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1788574522.797999:0:18874:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788574522.798004:0:18874:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001f69996f/0x10531a153b53721d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574522.798012:0:18874:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a6824f8a00 already unused, calling callback (ffffffffc159f4f0) 00010000:00010000:3.0:1788574522.798021:0:18874:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001f69996f/0x10531a153b53721d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574522.798912:0:18874:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001f69996f/0x10531a153b53721d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574522.798940:0:18874:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001f69996f/0x10531a153b53721d lrc: 1/0,0 mode: --/PW res: [0x240000400:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574522.798946:0:18874:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001f69996f/0x10531a153b53721d lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574522.798969:0:18874:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788574522.798972:0:18874:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006e81cbbd/0x10531a153b537224 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574522.798979:0:18874:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a6824f8e00 already unused, calling callback (ffffffffc159f4f0) 00010000:00010000:3.0:1788574522.798983:0:18874:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006e81cbbd/0x10531a153b537224 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574522.798991:0:18874:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006e81cbbd/0x10531a153b537224 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574522.798999:0:18874:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006e81cbbd/0x10531a153b537224 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574522.799005:0:18874:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006e81cbbd/0x10531a153b537224 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574522.799025:0:18874:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788574522.799027:0:18874:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788574522.799041:0:18874:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788574522.803602:0:18875:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788574522.805427:0:19577:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x2a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788574522.805441:0:19577:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000077a8800f/0x10531a153b53722b lrc: 3/0,1 mode: --/PW res: [0x240000400:0x2a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574522.805458:0:19577:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2a:0x0].0x0 since=648s v=(0 0) 00010000:00010000:3.0:1788574522.805463:0:19577:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788574522.805470:0:19577:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000077a8800f/0x10531a153b53722b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574522.805485:0:19577:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000077a8800f/0x10531a153b53722b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574522.805495:0:19577:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000077a8800f/0x10531a153b53722b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574522.805503:0:19577:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000077a8800f/0x10531a153b53722b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574522.805524:0:19577:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788574522.806136:0:18874:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788574522.806146:0:18874:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000077a8800f/0x10531a153b53722b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574522.806157:0:18874:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a6824f8c00 already unused, calling callback (ffffffffc159f4f0) 00010000:00010000:2.0:1788574522.806163:0:18874:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000077a8800f/0x10531a153b53722b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574522.806174:0:18874:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000077a8800f/0x10531a153b53722b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574522.806195:0:18874:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000077a8800f/0x10531a153b53722b lrc: 1/0,0 mode: --/PW res: [0x240000400:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574522.806204:0:18874:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000077a8800f/0x10531a153b53722b lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574522.806223:0:18874:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788574522.806225:0:18874:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788574522.806227:0:18874:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788574522.806291:0:19577:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x29:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788574522.806297:0:19577:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003bea45df/0x10531a153b537232 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x29:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574522.806315:0:19577:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x29:0x0].0x0 since=648s v=(0 0) 00010000:00010000:3.0:1788574522.806319:0:19577:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x29:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788574522.806323:0:19577:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003bea45df/0x10531a153b537232 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574522.806333:0:19577:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003bea45df/0x10531a153b537232 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574522.806341:0:19577:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003bea45df/0x10531a153b537232 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574522.806348:0:19577:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003bea45df/0x10531a153b537232 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574522.806381:0:19577:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788574522.806391:0:18875:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788574522.806395:0:18875:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003bea45df/0x10531a153b537232 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574522.806402:0:18875:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a6824f8600 already unused, calling callback (ffffffffc159f4f0) 00010000:00010000:3.0:1788574522.806406:0:18875:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003bea45df/0x10531a153b537232 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574522.806413:0:18875:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003bea45df/0x10531a153b537232 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574522.806437:0:18875:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003bea45df/0x10531a153b537232 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574522.806445:0:18875:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003bea45df/0x10531a153b537232 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574522.806459:0:18875:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788574522.806461:0:18875:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788574522.806462:0:18875:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788574522.807111:0:19577:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x28:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788574522.807119:0:19577:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bcc2a3f2/0x10531a153b537239 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x28:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574522.807127:0:19577:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x28:0x0].0x0 since=648s v=(0 0) 00010000:00010000:3.0:1788574522.807131:0:19577:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x28:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788574522.807135:0:19577:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bcc2a3f2/0x10531a153b537239 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574522.807143:0:19577:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000bcc2a3f2/0x10531a153b537239 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574522.807152:0:19577:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bcc2a3f2/0x10531a153b537239 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574522.807159:0:19577:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000bcc2a3f2/0x10531a153b537239 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574522.807187:0:19577:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788574522.809440:0:18874:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788574522.809455:0:18874:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000bcc2a3f2/0x10531a153b537239 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574522.809468:0:18874:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a6824f9c00 already unused, calling callback (ffffffffc159f4f0) 00010000:00010000:2.0:1788574522.809485:0:18874:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000bcc2a3f2/0x10531a153b537239 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574522.809511:0:18874:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000bcc2a3f2/0x10531a153b537239 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574522.809533:0:18874:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000bcc2a3f2/0x10531a153b537239 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574522.809542:0:18874:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bcc2a3f2/0x10531a153b537239 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574522.809569:0:18874:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788574522.809571:0:18874:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788574522.809573:0:18874:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788574522.814335:0:19577:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x27:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788574522.814350:0:19577:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007abc4593/0x10531a153b537240 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x27:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574522.814384:0:19577:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x27:0x0].0x0 since=648s v=(0 0) 00010000:00010000:3.0:1788574522.814389:0:19577:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x27:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788574522.814395:0:19577:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007abc4593/0x10531a153b537240 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574522.814410:0:19577:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007abc4593/0x10531a153b537240 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574522.814421:0:19577:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007abc4593/0x10531a153b537240 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574522.814429:0:19577:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007abc4593/0x10531a153b537240 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574522.814451:0:19577:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1788574522.814927:0:19577:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x26:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788574522.814934:0:19577:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000077db82e1/0x10531a153b537247 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x26:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574522.814942:0:19577:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x26:0x0].0x0 since=648s v=(0 0) 00010000:00010000:3.0:1788574522.814952:0:19577:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x26:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788574522.814957:0:19577:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000077db82e1/0x10531a153b537247 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574522.814967:0:19577:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000077db82e1/0x10531a153b537247 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574522.814975:0:19577:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000077db82e1/0x10531a153b537247 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574522.814982:0:19577:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000077db82e1/0x10531a153b537247 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574522.815001:0:19577:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1788574522.815014:0:18874:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788574522.815021:0:18874:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007abc4593/0x10531a153b537240 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574522.815029:0:18874:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a6824f9200 already unused, calling callback (ffffffffc159f4f0) 00010000:00010000:3.0:1788574522.815033:0:18874:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007abc4593/0x10531a153b537240 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574522.815042:0:18874:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007abc4593/0x10531a153b537240 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574522.815058:0:18874:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007abc4593/0x10531a153b537240 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574522.815075:0:18874:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007abc4593/0x10531a153b537240 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574522.815094:0:18874:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788574522.815097:0:18874:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000077db82e1/0x10531a153b537247 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574522.815104:0:18874:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a6824f9a00 already unused, calling callback (ffffffffc159f4f0) 00010000:00010000:3.0:1788574522.815107:0:18874:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000077db82e1/0x10531a153b537247 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574522.815115:0:18874:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000077db82e1/0x10531a153b537247 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574522.815124:0:18874:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000077db82e1/0x10531a153b537247 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574522.815131:0:18874:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000077db82e1/0x10531a153b537247 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574522.815140:0:18874:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788574522.815141:0:18874:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788574522.815143:0:18874:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788574522.816462:0:18875:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788574522.824762:0:19577:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x25:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788574522.824776:0:19577:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000df9a001d/0x10531a153b53724e lrc: 3/0,1 mode: --/PW res: [0x240000400:0x25:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574522.825494:0:19577:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x25:0x0].0x0 since=648s v=(0 0) 00010000:00010000:1.0:1788574522.825500:0:19577:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x25:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788574522.825513:0:19577:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000df9a001d/0x10531a153b53724e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574522.825532:0:19577:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000df9a001d/0x10531a153b53724e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574522.825545:0:19577:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000df9a001d/0x10531a153b53724e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574522.825553:0:19577:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000df9a001d/0x10531a153b53724e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574522.825585:0:19577:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788574522.825601:0:18874:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788574522.825609:0:18874:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000df9a001d/0x10531a153b53724e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574522.825621:0:18874:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a790a21c00 already unused, calling callback (ffffffffc159f4f0) 00010000:00010000:3.0:1788574522.825627:0:18874:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000df9a001d/0x10531a153b53724e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574522.825638:0:18874:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000df9a001d/0x10531a153b53724e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574522.825657:0:18874:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000df9a001d/0x10531a153b53724e lrc: 1/0,0 mode: --/PW res: [0x240000400:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574522.825664:0:18874:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000df9a001d/0x10531a153b53724e lrc: 0/0,0 mode: --/PW res: [0x240000400:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574522.825684:0:18874:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788574522.825686:0:18874:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788574522.825687:0:18874:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788574522.826222:0:19577:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x24:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788574522.826239:0:19577:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000059982c06/0x10531a153b537255 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x24:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574522.826249:0:19577:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x24:0x0].0x0 since=649s v=(0 0) 00010000:00010000:1.0:1788574522.826252:0:19577:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x24:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788574522.826257:0:19577:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000059982c06/0x10531a153b537255 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574522.826269:0:19577:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000059982c06/0x10531a153b537255 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574522.829621:0:19577:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000059982c06/0x10531a153b537255 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574522.829646:0:19577:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000059982c06/0x10531a153b537255 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574522.835387:0:19577:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788574522.835416:0:18875:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788574522.835425:0:18875:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000059982c06/0x10531a153b537255 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574522.835443:0:18875:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a790a21a00 already unused, calling callback (ffffffffc159f4f0) 00010000:00010000:0.0:1788574522.835449:0:18875:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000059982c06/0x10531a153b537255 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574522.835468:0:18875:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000059982c06/0x10531a153b537255 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574522.835493:0:18875:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000059982c06/0x10531a153b537255 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574522.835500:0:18875:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000059982c06/0x10531a153b537255 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574522.835521:0:18875:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788574522.835523:0:18875:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788574522.835524:0:18875:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788574522.838569:0:19577:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x23:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788574522.838581:0:19577:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cd412172/0x10531a153b53725c lrc: 3/0,1 mode: --/PW res: [0x240000400:0x23:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574522.838598:0:19577:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x23:0x0].0x0 since=649s v=(0 0) 00010000:00010000:0.0:1788574522.838602:0:19577:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x23:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788574522.838609:0:19577:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cd412172/0x10531a153b53725c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574522.838624:0:19577:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000cd412172/0x10531a153b53725c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574522.838634:0:19577:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cd412172/0x10531a153b53725c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574522.838649:0:19577:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000cd412172/0x10531a153b53725c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574522.838679:0:19577:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788574522.838701:0:18874:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788574522.838707:0:18874:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000cd412172/0x10531a153b53725c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574522.838715:0:18874:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a68116b200 already unused, calling callback (ffffffffc159f4f0) 00010000:00010000:0.0:1788574522.838720:0:18874:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000cd412172/0x10531a153b53725c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574522.838729:0:18874:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000cd412172/0x10531a153b53725c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574522.838748:0:18874:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000cd412172/0x10531a153b53725c lrc: 1/0,0 mode: --/PW res: [0x240000400:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574522.838756:0:18874:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000cd412172/0x10531a153b53725c lrc: 0/0,0 mode: --/PW res: [0x240000400:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574522.838774:0:18874:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788574522.838776:0:18874:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788574522.838778:0:18874:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788574522.841622:0:19577:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x22:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788574522.841644:0:19577:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000299615fe/0x10531a153b537263 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574522.841662:0:19577:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=649s v=(0 0) 00010000:00010000:0.0:1788574522.841667:0:19577:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788574522.841673:0:19577:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000299615fe/0x10531a153b537263 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574522.841687:0:19577:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000299615fe/0x10531a153b537263 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574522.841697:0:19577:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000299615fe/0x10531a153b537263 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574522.841705:0:19577:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000299615fe/0x10531a153b537263 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574522.841729:0:19577:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788574522.841746:0:18875:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788574522.841753:0:18875:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000299615fe/0x10531a153b537263 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574522.842357:0:18875:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a68116a000 already unused, calling callback (ffffffffc159f4f0) 00010000:00010000:0.0:1788574522.842364:0:18875:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000299615fe/0x10531a153b537263 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574522.842408:0:18875:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000299615fe/0x10531a153b537263 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574522.842436:0:18875:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000299615fe/0x10531a153b537263 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574522.842446:0:18875:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000299615fe/0x10531a153b537263 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574522.842470:0:18875:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788574522.842472:0:18875:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788574522.842474:0:18875:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00080000:0.0:1788574522.844803:0:19577:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0000: after destroy: set last_id to 0x240000400:6 00000100:00100000:0.0:1788574522.846005:0:19577:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7a72b9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:18909:x1875455747686144:12345-0@lo:5:osp-pre-0-0.0 Request processed in 194499us (196724us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574522.846023:0:19577:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788574522.849941:0:18909:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a7a72b8380 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:18909:1875455747686144:0@lo:5:osp-pre-0-0.0 00000004:00080000:3.0:1788574522.849965:0:18909:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x240000400:0x41:0x0] from OST, last_created [0x240000400:0x41:0x0]last_used is [0x240000400:0x6:0x0] 00000100:00100000:3.0:1788574522.850036:0:18909:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a7bbebf800 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:18909:1875455747686272:0@lo:5:osp-pre-0-0.0 00000100:00100000:3.0:1788574522.850115:0:18909:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788574522.850170:0:18909:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a78538b180 going to sleep for 11 seconds 00000100:00100000:3.0:1788574522.850208:0:19575:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747686272 00000100:00100000:3.0:1788574522.850217:0:19575:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747686272 00000100:00100000:3.0:1788574522.850273:0:19575:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788574522.850283:0:19575:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7bbebce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:18909:x1875455747686272:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:3.0:1788574522.850341:0:19575:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x240000400 at 66 00000100:00100000:3.0:1788574522.853151:0:19575:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7bbebce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:18909:x1875455747686272:12345-0@lo:5:osp-pre-0-0.0 Request processed in 2863us (3029us total) trans 12884901889 rc 0/0 00000100:00100000:3.0:1788574522.853166:0:19575:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788574522.853324:0:18909:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a7bbebf800 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:18909:1875455747686272:0@lo:5:osp-pre-0-0.0 00000004:00080000:1.0:1788574522.853346:0:18909:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x240000400:0x41:0x0]-[0x240000400:0x61:0x0] 00010000:00010000:0.0:1788574523.200488:0:18874:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788574523.657072:0:3311:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788574508/real 1788574508] req@ffff90a7a72b9880 x1875455747681408/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788574523 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788574523.657112:0:3311:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff90a7a72b9880 x1875455747681408/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788574523 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1788574523.657138:0:3311:0:(import.c:65:import_set_state_nolock()) ffff90a786924800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788574523.657161:0:3311:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:3.0:1788574523.657165:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a7a72b9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3311:1875455747681408:0@lo:8:kworker.0 00000100:00080000:3.0:1788574523.657263:0:13890:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788574523.657268:0:13890:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1788574523.657271:0:13890:0:(import.c:65:import_set_state_nolock()) ffff90a786924800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788574523.657277:0:13890:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 634 00000100:00080000:3.0:1788574523.657283:0:13890:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:3.0:1788574523.657290:0:13890:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff90a786924800 using connection 192.168.201.157@tcp/0@lo 00000100:00100000:3.0:1788574523.657315:0:13890:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff90a7bbebfb80 x1875455747686528/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788574523.657423:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a7bbebed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:64047b6f-0fa6-4004-9f51-bd636ae04daf:3314:1875455747686400:0@lo:400:kworker.0 00000100:00100000:3.0:1788574523.657544:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788574523.657622:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788574523.657629:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a7bbebc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3314:1875455747686656:0@lo:400:kworker.0 00000100:00100000:3.0:1788574523.657662:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788574523.657713:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a7bbebfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3311:1875455747686528:0@lo:8:kworker.0 00000100:00100000:3.0:1788574523.657744:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788574523.657784:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788574523.657793:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a7bbebdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3313:1875455747686784:0@lo:400:kworker.0 00000100:00100000:3.0:1788574523.658563:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788574523.658672:0:18881:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747686400 00000100:00100000:3.0:1788574523.658687:0:18881:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747686400 00000100:00100000:3.0:1788574523.658922:0:18881:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1788574523.658937:0:18881:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a79e7eac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:64047b6f-0fa6-4004-9f51-bd636ae04daf+16:3314:x1875455747686400:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788574523.659016:0:18881:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a79e7eac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:64047b6f-0fa6-4004-9f51-bd636ae04daf+16:3314:x1875455747686400:12345-0@lo:400:kworker.0 Request processed in 82us (1471us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574523.659024:0:18881:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1788574523.659066:0:18887:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747686656 00000100:00100000:3.0:1788574523.659070:0:18887:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747686656 00000100:00100000:3.0:1788574523.659094:0:18887:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747686784 00000100:00100000:3.0:1788574523.659096:0:18887:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747686784 00000100:00100000:3.0:1788574523.659112:0:18887:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788574523.659119:0:18887:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7bbebe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1875455747686656:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788574523.659151:0:18887:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7bbebe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1875455747686656:12345-0@lo:400:kworker.0 Request processed in 33us (1488us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574523.659158:0:18887:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788574523.659168:0:18887:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788574523.659174:0:18887:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7bbebc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1875455747686784:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788574523.659203:0:18887:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7bbebc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1875455747686784:12345-0@lo:400:kworker.0 Request processed in 29us (1382us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574523.659209:0:18887:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00010000:00080000:3.0:1788574523.659261:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff90a7bbebc700 x1875455747686656/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788574539 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788574523.659289:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a7bbebc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3314:1875455747686656:0@lo:400:kworker.0 00000100:00100000:3.0:1788574523.659301:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a7bbebed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:64047b6f-0fa6-4004-9f51-bd636ae04daf:3314:1875455747686400:0@lo:400:kworker.0 00010000:00080000:3.0:1788574523.659336:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff90a7bbebdf80 x1875455747686784/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788574539 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788574523.659346:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a7bbebdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3313:1875455747686784:0@lo:400:kworker.0 00000100:00100000:0.0:1788574523.666640:0:19577:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747686528 00000100:00100000:0.0:1788574523.666660:0:19577:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747686528 00000100:00100000:0.0:1788574523.666732:0:19577:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788574523.666756:0:19577:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7bbebea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3311:x1875455747686528:12345-0@lo:8:kworker.0 00010000:00020000:0.0:1788574523.666787:0:19577:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1788574523.701017:0:19577:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7bbebea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3311:x1875455747686528:12345-0@lo:8:kworker.0 Request processed in 34265us (43261us total) trans 0 rc -19/-19 00000100:00100000:0.0:1788574523.701034:0:19577:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00080000:3.0:1788574523.701761:0:3311:0:(import.c:65:import_set_state_nolock()) ffff90a786924800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788574523.701776:0:3311:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1788574523.701781:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a7bbebfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3311:1875455747686528:0@lo:8:kworker.0 00010000:00010000:0.0:1788574524.226353:0:18875:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1788574525.179602:0:6739:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00080000:1.0:1788574525.179616:0:6739:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 12884901889 is committed 00010000:00010000:0.0:1788574525.249489:0:18874:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1788574525.854531:0:19946:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg157-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:1.0:1788574526.274888:0:18875:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788574527.339741:0:18874:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788574528.137961:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a7bb288a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1875455747686912:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788574528.138085:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788574528.138400:0:19579:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747686912 00000100:00100000:1.0:1788574528.138426:0:19579:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747686912 00000100:00100000:1.0:1788574528.138829:0:19579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788574528.138841:0:19579:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7bbebfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1875455747686912:12345-0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1788574528.138905:0:18882:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00000024:1.0:1788574528.143478:0:19579:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788574528.144282:0:19579:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7bbebfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1875455747686912:12345-0@lo:13:osp-pre-0-0.0 Request processed in 5438us (6192us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574528.144315:0:19579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788574528.145465:0:3313:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 12884901889 gen 2 00000100:00100000:1.0:1788574528.145524:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a7bb288a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1875455747686912:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1788574528.389166:0:18875:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1788574529.153708:0:489:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788574529.153718:0:489:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1788574529.153732:0:489:0:(import.c:65:import_set_state_nolock()) ffff90a786924800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788574529.153743:0:489:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 649 00000100:00080000:0.0:1788574529.153750:0:489:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:0.0:1788574529.153757:0:489:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff90a786924800 using connection 192.168.201.157@tcp/0@lo 00000100:00100000:0.0:1788574529.153780:0:489:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff90a6839d0700 x1875455747687296/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788574529.153840:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a6839d3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1875455747687168:0@lo:400:kworker.0 00000100:00100000:0.0:1788574529.153947:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788574529.154283:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788574529.154291:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a6839d0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:64047b6f-0fa6-4004-9f51-bd636ae04daf:3315:1875455747687040:0@lo:400:kworker.0 00000100:00100000:0.0:1788574529.154326:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788574529.154362:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a6839d0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3311:1875455747687296:0@lo:8:kworker.0 00000100:00100000:0.0:1788574529.154422:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788574529.154453:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a6839d1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3312:1875455747687424:0@lo:400:kworker.0 00000100:00100000:0.0:1788574529.154484:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788574529.154505:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788574529.154511:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a6839d2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3312:1875455747687552:0@lo:400:kworker.0 00000100:00100000:0.0:1788574529.154533:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788574529.154587:0:19576:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747687168 00000100:00100000:0.0:1788574529.154596:0:19576:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747687168 00000100:00100000:0.0:1788574529.154631:0:19576:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747687296 00000100:00100000:0.0:1788574529.154634:0:19576:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747687296 00000100:00100000:0.0:1788574529.155056:0:19576:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788574529.155066:0:19576:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6839d2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3315:x1875455747687168:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788574529.155141:0:19576:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6839d2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3315:x1875455747687168:12345-0@lo:400:kworker.0 Request processed in 77us (1194us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574529.155149:0:19576:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788574529.155170:0:19576:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788574529.155174:0:19576:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6839d2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3311:x1875455747687296:12345-0@lo:8:kworker.0 00010000:00020000:0.0:1788574529.155190:0:19576:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1788574529.155675:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a6839d3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1875455747687168:0@lo:400:kworker.0 00000100:00100000:1.0:1788574529.156400:0:18879:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747687040 00000100:00100000:1.0:1788574529.156407:0:18879:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747687040 00000100:00100000:1.0:1788574529.156474:0:18879:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1788574529.156483:0:18879:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a79e7e8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:64047b6f-0fa6-4004-9f51-bd636ae04daf+16:3315:x1875455747687040:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788574529.156551:0:18879:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a79e7e8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:64047b6f-0fa6-4004-9f51-bd636ae04daf+16:3315:x1875455747687040:12345-0@lo:400:kworker.0 Request processed in 68us (2223us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574529.156558:0:18879:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1788574529.156617:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a6839d0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:64047b6f-0fa6-4004-9f51-bd636ae04daf:3315:1875455747687040:0@lo:400:kworker.0 00000100:00100000:1.0:1788574529.158450:0:18887:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747687424 00000100:00100000:1.0:1788574529.158478:0:18887:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747687424 00000100:00100000:1.0:1788574529.158527:0:18887:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747687552 00000100:00100000:1.0:1788574529.158531:0:18887:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747687552 00000100:00100000:1.0:1788574529.158565:0:18887:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1788574529.158575:0:18887:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6839d0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1875455747687424:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788574529.158672:0:18887:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6839d0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1875455747687424:12345-0@lo:400:kworker.0 Request processed in 98us (4186us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574529.158679:0:18887:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1788574529.158696:0:18887:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788574529.158702:0:18887:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6839d1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1875455747687552:12345-0@lo:400:kworker.0 00000100:00080000:2.0:1788574529.158905:0:18882:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788574529.159848:0:18887:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6839d1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1875455747687552:12345-0@lo:400:kworker.0 Request processed in 1142us (5309us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574529.159858:0:18887:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00080000:1.0:1788574529.166800:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff90a6839d2a00 x1875455747687552/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788574545 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788574529.166829:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a6839d2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3312:1875455747687552:0@lo:400:kworker.0 00010000:00080000:1.0:1788574529.166848:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff90a6839d1c00 x1875455747687424/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788574545 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788574529.166857:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a6839d1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3312:1875455747687424:0@lo:400:kworker.0 00000100:00100000:0.0:1788574529.188209:0:19576:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6839d2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3311:x1875455747687296:12345-0@lo:8:kworker.0 Request processed in 33019us (33771us total) trans 0 rc -19/-19 00000100:00100000:0.0:1788574529.188228:0:19576:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00080000:0.0:1788574529.188314:0:3311:0:(import.c:65:import_set_state_nolock()) ffff90a786924800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788574529.188320:0:3311:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1788574529.188325:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a6839d0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3311:1875455747687296:0@lo:8:kworker.0 00010000:00010000:0.0:1788574529.410253:0:18874:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788574530.432969:0:18875:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788574530.881165:0:18921:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1788574531.456591:0:18874:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788574532.480658:0:18875:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788574533.251195:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788574533.251227:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a6839d0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1875455747687680:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788574533.251336:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788574533.251506:0:19580:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747687680 00000100:00100000:0.0:1788574533.251517:0:19580:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747687680 00000100:00100000:0.0:1788574533.251581:0:19580:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788574533.251596:0:19580:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7a72b9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1875455747687680:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788574533.251637:0:19580:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788574533.251711:0:19580:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7a72b9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1875455747687680:12345-0@lo:13:osp-pre-0-0.0 Request processed in 118us (375us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574533.251823:0:19580:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788574533.251980:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a6839d0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1875455747687680:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1788574533.252761:0:18882:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1788574533.508596:0:18874:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1788574534.273202:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788574534.273212:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1788574534.273217:0:8:0:(import.c:65:import_set_state_nolock()) ffff90a786924800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788574534.273227:0:8:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 655 00000100:00080000:2.0:1788574534.273234:0:8:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1788574534.273242:0:8:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff90a786924800 using connection 192.168.201.157@tcp/0@lo 00000100:00100000:1.0:1788574534.273250:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a7bb28bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:64047b6f-0fa6-4004-9f51-bd636ae04daf:3315:1875455747687808:0@lo:400:kworker.0 00000100:00100000:2.0:1788574534.273252:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a7bb288e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1875455747687936:0@lo:400:kworker.0 00000100:00100000:3.0:1788574534.277130:0:8:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff90a7bbebdf80 x1875455747688064/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788574534.277193:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a7bbebc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3314:1875455747688320:0@lo:400:kworker.0 00000100:00100000:0.0:1788574534.277391:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a7bbebdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3311:1875455747688064:0@lo:8:kworker.0 00000100:00100000:2.0:1788574534.279161:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788574534.279234:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788574534.279243:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a7bbebed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3312:1875455747688192:0@lo:400:kworker.0 00000100:00100000:2.0:1788574534.279287:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788574534.282969:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788574534.283085:0:19575:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747687936 00000100:00100000:1.0:1788574534.283097:0:19575:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747687936 00000100:00100000:1.0:1788574534.283149:0:19575:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788574534.283158:0:19575:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7bb289880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3312:x1875455747687936:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788574534.283219:0:19575:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7bb289880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3312:x1875455747687936:12345-0@lo:400:kworker.0 Request processed in 63us (4064us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574534.283226:0:19575:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788574534.283249:0:18887:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747688192 00000100:00100000:1.0:1788574534.283253:0:18887:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747688192 00000100:00100000:1.0:1788574534.283279:0:18887:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788574534.283286:0:18887:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7bb288700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1875455747688192:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788574534.283316:0:18887:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7bb288700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1875455747688192:12345-0@lo:400:kworker.0 Request processed in 31us (4029us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574534.283321:0:18887:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788574534.283337:0:18880:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747687808 00000100:00100000:1.0:1788574534.283341:0:18880:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747687808 00000100:00100000:1.0:1788574534.283364:0:18880:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1788574534.283390:0:18880:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a79e7ea850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:64047b6f-0fa6-4004-9f51-bd636ae04daf+16:3315:x1875455747687808:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788574534.283422:0:18880:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a79e7ea850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:64047b6f-0fa6-4004-9f51-bd636ae04daf+16:3315:x1875455747687808:12345-0@lo:400:kworker.0 Request processed in 33us (465us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574534.283428:0:18880:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1788574534.283477:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a7bb28bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:64047b6f-0fa6-4004-9f51-bd636ae04daf:3315:1875455747687808:0@lo:400:kworker.0 00010000:00080000:1.0:1788574534.283530:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff90a7bbebed80 x1875455747688192/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788574550 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788574534.283543:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a7bbebed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3312:1875455747688192:0@lo:400:kworker.0 00000100:00100000:1.0:1788574534.283558:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a7bb288e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1875455747687936:0@lo:400:kworker.0 00000100:00100000:3.0:1788574534.285691:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788574534.285777:0:18886:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747688320 00000100:00100000:3.0:1788574534.285788:0:18886:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747688320 00000100:00080000:1.0:1788574534.285836:0:18882:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788574534.285973:0:18886:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1788574534.285985:0:18886:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7bbebd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1875455747688320:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788574534.286055:0:18886:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7bbebd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1875455747688320:12345-0@lo:400:kworker.0 Request processed in 73us (416us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574534.286079:0:18886:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00010000:00080000:1.0:1788574534.286189:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff90a7bbebc700 x1875455747688320/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788574550 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788574534.286202:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a7bbebc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3314:1875455747688320:0@lo:400:kworker.0 00000100:00100000:0.0:1788574534.286409:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788574534.286928:0:19576:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747688064 00000100:00100000:3.0:1788574534.286935:0:19576:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747688064 00000100:00100000:3.0:1788574534.286966:0:19576:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788574534.286972:0:19576:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6839d1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3311:x1875455747688064:12345-0@lo:8:kworker.0 00010000:00020000:3.0:1788574534.286993:0:19576:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1788574534.301575:0:19576:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6839d1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3311:x1875455747688064:12345-0@lo:8:kworker.0 Request processed in 14592us (15156us total) trans 0 rc -19/-19 00000100:00100000:2.0:1788574534.301589:0:19576:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00080000:1.0:1788574534.301630:0:3311:0:(import.c:65:import_set_state_nolock()) ffff90a786924800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788574534.301636:0:3311:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1788574534.301640:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a7bbebdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3311:1875455747688064:0@lo:8:kworker.0 00010000:00010000:1.0:1788574534.529753:0:18875:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788574535.556898:0:18874:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788574536.576816:0:18875:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1788574537.305080:0:20301:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1788574537.305085:0:20301:0:(obd_mount.c:926:lmd_print()) device: lustre-ost2/ost2 00000080:01200004:2.0:1788574537.305485:0:20301:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff90a681297000 00000020:01000004:2.0:1788574537.305505:0:20301:0:(tgt_mount.c:2506:osd_start()) Attempting to start lustre-OST0001, type=osd-zfs, lsifl=200002, mountfl=0 00000020:01000004:2.0:1788574537.305518:0:20301:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-zfs) 00000020:00000080:2.0:1788574537.305530:0:20301:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff90a7924bcd40) 00000020:00000080:2.0:1788574537.305551:0:20301:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type osd-zfs with refcount 2 00100000:10000000:3.0:1788574537.357518:0:20301:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:3.0:1788574537.357900:0:20301:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0001: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:3.0:1788574537.359105:0:20301:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:3.0:1788574537.360550:0:20301:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00100000:10000000:2.0:1788574537.370784:0:20301:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0001: registered index [0x200000003:0xb:0x0] (8/32) 00100000:10000000:2.0:1788574537.372509:0:20301:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled lustre-client under 503: rc = 0 00100000:10000000:2.0:1788574537.372601:0:20301:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled lustre-OST0001 under 503: rc = 0 00100000:10000000:2.0:1788574537.373119:0:20301:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled params under 503: rc = 0 00100000:10000000:2.0:1788574537.375068:0:20301:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x2020000-OST0001 under 177: rc = 0 00100000:10000000:2.0:1788574537.375421:0:20301:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x1020000 under 177: rc = 0 00100000:10000000:2.0:1788574537.375666:0:20301:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x2020000 under 177: rc = 0 00100000:10000000:2.0:1788574537.383958:0:20301:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x1020000-OST0001 under 177: rc = 0 00100000:10000000:2.0:1788574537.384509:0:20301:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x20000 under 177: rc = 0 00100000:10000000:2.0:1788574537.384755:0:20301:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x20000-OST0001 under 177: rc = 0 00000020:00000080:2.0:1788574537.392505:0:20301:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:2.0:1788574537.392531:0:20301:0:(osd_handler.c:1574:osd_obd_connect()) connect #0 00000020:00000080:2.0:1788574537.392556:0:20301:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x10531a153b537271 00000020:01000004:2.0:1788574537.392569:0:20301:0:(tgt_mount.c:2591:server_fill_super()) Found service lustre-OST0001 on device lustre-ost2/ost2 00000020:01000004:2.0:1788574537.392603:0:20301:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.201.157@tcp:Set MGC reconnect 1 10000000:01000000:2.0:1788574537.392607:0:20301:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.201.157@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:2.0:1788574537.392850:0:20301:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-OST0001 00000020:01000004:2.0:1788574537.392892:0:20301:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost2/ost2 10000000:01000000:2.0:1788574537.392911:0:20301:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.201.157@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:0.0:1788574537.421488:0:20301:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.201.157@tcp ctxt 0 is initialized 00000020:01000004:0.0:1788574537.421541:0:20301:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.201.157@tcp, index=0001, flags=0x20002 00000020:01000004:0.0:1788574537.421547:0:20301:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:0.0:1788574537.421549:0:20301:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1788574537.421550:0:20301:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788574537.421552:0:20301:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788574537.421554:0:20301:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788574537.421556:0:20301:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788574537.421557:0:20301:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788574537.421559:0:20301:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788574537.421560:0:20301:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1788574537.421566:0:20301:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020002 00000020:01000004:0.0:1788574537.421568:0:20301:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1788574537.421569:0:20301:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1788574537.421570:0:20301:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788574537.421571:0:20301:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788574537.421572:0:20301:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788574537.421574:0:20301:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788574537.421575:0:20301:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788574537.421576:0:20301:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788574537.421577:0:20301:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1788574537.421606:0:20301:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:0.0:1788574537.421628:0:20301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a6839d2300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:64047b6f-0fa6-4004-9f51-bd636ae04daf:20301:1875455747688448:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1788574537.422172:0:20301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788574537.422245:0:20301:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a781254840 going to sleep for 11 seconds 00000100:00100000:2.0:1788574537.422681:0:18881:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747688448 00000100:00100000:2.0:1788574537.422700:0:18881:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747688448 00000100:00100000:2.0:1788574537.422768:0:18881:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1788574537.422779:0:18881:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a79e7e8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:64047b6f-0fa6-4004-9f51-bd636ae04daf+16:20301:x1875455747688448:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1788574537.422846:0:18881:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:2.0:1788574537.422849:0:18881:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0001 is running on 0@lo 20000000:01000000:2.0:1788574537.422854:0:18881:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:2.0:1788574537.435257:0:18881:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a79e7e8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:64047b6f-0fa6-4004-9f51-bd636ae04daf+16:20301:x1875455747688448:12345-0@lo:253:mount.lustre.0 Request processed in 12466us (13075us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574537.435605:0:18881:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1788574537.435845:0:20301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a6839d2300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:64047b6f-0fa6-4004-9f51-bd636ae04daf:20301:1875455747688448:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1788574537.435865:0:20301:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:0.0:1788574537.435870:0:20301:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1788574537.435872:0:20301:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1788574537.435873:0:20301:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788574537.435874:0:20301:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788574537.435892:0:20301:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788574537.435893:0:20301:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788574537.435895:0:20301:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788574537.435896:0:20301:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788574537.435898:0:20301:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:0.0:1788574537.435919:0:20301:0:(tgt_mount.c:101:server_register_mount()) register mount ffff90a681297000 from lustre-OST0001 10000000:01000000:0.0:1788574537.435954:0:20301:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:0.0:1788574537.435957:0:20301:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:0.0:1788574537.435965:0:20301:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff90a79f8fcd40 local copy 00010000:00010000:0.0:1788574537.435975:0:20301:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.157@tcp lock: ffff90a79e984200/0x10531a153b536ffb lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x10531a153b537002 expref: -99 pid: 18868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788574537.436318:0:20301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a6839d2300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:64047b6f-0fa6-4004-9f51-bd636ae04daf:20301:1875455747688576:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788574537.436357:0:20301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788574537.436427:0:20301:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a781254840 going to sleep for 11 seconds 00000100:00100000:1.0:1788574537.436615:0:18879:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747688576 00000100:00100000:1.0:1788574537.436625:0:18879:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747688576 00000100:00100000:1.0:1788574537.436749:0:18879:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1788574537.436763:0:18879:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a79e7ea050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:64047b6f-0fa6-4004-9f51-bd636ae04daf+16:20301:x1875455747688576:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788574537.437093:0:18879:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a79e7ea050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:64047b6f-0fa6-4004-9f51-bd636ae04daf+16:20301:x1875455747688576:12345-0@lo:501:mount.lustre.0 Request processed in 333us (734us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788574537.437100:0:18879:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1788574537.437239:0:20301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a6839d2300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:64047b6f-0fa6-4004-9f51-bd636ae04daf:20301:1875455747688576:0@lo:501:mount.lustre.0 10000000:01000000:2.0:1788574537.437255:0:20301:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.201.157@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:2.0:1788574537.437435:0:20301:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.201.157@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:2.0:1788574537.437444:0:20301:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.157@tcp lock: ffff90a79e984200/0x10531a153b536ffb lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x10531a153b537002 expref: -99 pid: 18868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574537.437455:0:20301:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.157@tcp lock: ffff90a79e984200/0x10531a153b536ffb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x10531a153b537002 expref: -99 pid: 18868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788574537.437477:0:20301:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff90a681297000 10000000:01000000:2.0:1788574537.437482:0:20301:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:2.0:1788574537.437487:0:20301:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:2.0:1788574537.437489:0:20301:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1788574537.437495:0:20301:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:2.0:1788574537.437498:0:20301:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:2.0:1788574537.437652:0:20301:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.157@tcp lock: ffff90a79e985800/0x10531a153b537278 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 20301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574537.437673:0:20301:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.157@tcp lock: ffff90a79e985800/0x10531a153b537278 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 20301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574537.437746:0:20301:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.157@tcp lock: ffff90a79e985800/0x10531a153b537278 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 20301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788574537.437764:0:20301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a7bb289180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:64047b6f-0fa6-4004-9f51-bd636ae04daf:20301:1875455747688704:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1788574537.437860:0:20301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788574537.437894:0:18881:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747688704 00000100:00100000:2.0:1788574537.437898:0:18881:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747688704 00000100:00100000:2.0:1788574537.437922:0:18881:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1788574537.437929:0:18881:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a79e7e9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:64047b6f-0fa6-4004-9f51-bd636ae04daf+16:20301:x1875455747688704:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788574537.437938:0:18881:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788574537.437949:0:18881:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90a79e984400/0x10531a153b53727f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x10531a153b537278 expref: -99 pid: 18881 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574537.437970:0:18881:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90a79e984400/0x10531a153b53727f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x10531a153b537278 expref: 17 pid: 18881 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574537.437991:0:18881:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90a79e984400/0x10531a153b53727f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x10531a153b537278 expref: 17 pid: 18881 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574537.438000:0:18881:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a79e984400, rc 0) 00000100:00100000:2.0:1788574537.438023:0:18881:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a79e7e9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:64047b6f-0fa6-4004-9f51-bd636ae04daf+17:20301:x1875455747688704:12345-0@lo:101:mount.lustre.0 Request processed in 95us (165us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574537.438029:0:18881:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1788574537.438053:0:20301:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a7bfb69000 going to sleep for 11 seconds 00000100:00100000:2.0:1788574537.438071:0:20301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a7bb289180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:64047b6f-0fa6-4004-9f51-bd636ae04daf:20301:1875455747688704:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788574537.438082:0:20301:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.157@tcp lock: ffff90a79e985800/0x10531a153b537278 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x10531a153b53727f expref: -99 pid: 20301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574537.438092:0:20301:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.157@tcp lock: ffff90a79e985800/0x10531a153b537278 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x10531a153b53727f expref: -99 pid: 20301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788574537.439974:0:20301:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 11 count 11 00000040:00080000:2.0:1788574537.441322:0:20301:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788574537.441917:0:20301:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].1, 224 off8416 00000040:00080000:2.0:1788574537.441961:0:20301:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].2, 128 off8544 00000040:00080000:2.0:1788574537.442004:0:20301:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].3, 112 off8656 00000040:00080000:2.0:1788574537.442053:0:20301:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].4, 224 off8880 00000040:00080000:2.0:1788574537.442086:0:20301:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].5, 224 off9104 00000040:00080000:2.0:1788574537.442113:0:20301:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].6, 80 off9184 00000040:00080000:2.0:1788574537.442230:0:20301:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].7, 224 off9408 00000040:00080000:2.0:1788574537.442263:0:20301:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].8, 224 off9632 00000040:00080000:2.0:1788574537.442301:0:20301:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].9, 120 off9752 00000040:00080000:2.0:1788574537.442350:0:20301:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].10, 224 off9976 00000040:00080000:2.0:1788574537.442357:0:20301:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 10 count 11 00000100:00100000:2.0:1788574537.442608:0:20301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a7bb289180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:64047b6f-0fa6-4004-9f51-bd636ae04daf:20301:1875455747688832:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788574537.442681:0:20301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788574537.442892:0:20301:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a7bfb69780 going to sleep for 11 seconds 00000100:00100000:0.0:1788574537.442933:0:18881:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747688832 00000100:00100000:0.0:1788574537.442940:0:18881:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747688832 00000100:00100000:0.0:1788574537.443038:0:18881:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1788574537.443049:0:18881:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a79e7eb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:64047b6f-0fa6-4004-9f51-bd636ae04daf+17:20301:x1875455747688832:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788574537.443596:0:18881:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a79e7eb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:64047b6f-0fa6-4004-9f51-bd636ae04daf+17:20301:x1875455747688832:12345-0@lo:501:mount.lustre.0 Request processed in 548us (914us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574537.443605:0:18881:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1788574537.443715:0:20301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a7bb289180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:64047b6f-0fa6-4004-9f51-bd636ae04daf:20301:1875455747688832:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788574537.443749:0:20301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a7bb289180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:64047b6f-0fa6-4004-9f51-bd636ae04daf:20301:1875455747688960:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788574537.443946:0:20301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788574537.444102:0:20301:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a7bfb69780 going to sleep for 11 seconds 00000100:00100000:1.0:1788574537.444230:0:18879:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747688960 00000100:00100000:1.0:1788574537.444236:0:18879:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747688960 00000100:00100000:1.0:1788574537.444261:0:18879:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1788574537.444268:0:18879:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a79e7e9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:64047b6f-0fa6-4004-9f51-bd636ae04daf+17:20301:x1875455747688960:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788574537.444643:0:18879:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a79e7e9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:64047b6f-0fa6-4004-9f51-bd636ae04daf+17:20301:x1875455747688960:12345-0@lo:503:mount.lustre.0 Request processed in 375us (857us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574537.444650:0:18879:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1788574537.444807:0:20301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a7bb289180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:64047b6f-0fa6-4004-9f51-bd636ae04daf:20301:1875455747688960:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1788574537.445865:0:20301:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1788574537.445939:0:20301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a7bb289180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:64047b6f-0fa6-4004-9f51-bd636ae04daf:20301:1875455747689088:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788574537.445994:0:20301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788574537.446025:0:20301:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a7bfb69780 going to sleep for 11 seconds 00000100:00100000:1.0:1788574537.446099:0:18879:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747689088 00000100:00100000:1.0:1788574537.446104:0:18879:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747689088 00000100:00100000:1.0:1788574537.446202:0:18879:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1788574537.446214:0:18879:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a79e7e8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:64047b6f-0fa6-4004-9f51-bd636ae04daf+17:20301:x1875455747689088:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788574537.446775:0:18879:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a79e7e8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:64047b6f-0fa6-4004-9f51-bd636ae04daf+17:20301:x1875455747689088:12345-0@lo:502:mount.lustre.0 Request processed in 563us (779us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574537.446783:0:18879:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1788574537.446970:0:20301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a7bb289180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:64047b6f-0fa6-4004-9f51-bd636ae04daf:20301:1875455747689088:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788574537.447352:0:20301:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].1, 224 off8416 00000040:00080000:2.0:1788574537.447422:0:20301:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].2, 128 off8544 00000040:00080000:2.0:1788574537.447452:0:20301:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].3, 112 off8656 00000040:00080000:2.0:1788574537.447491:0:20301:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].4, 224 off8880 00000040:00080000:2.0:1788574537.447521:0:20301:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].5, 224 off9104 00000040:00080000:2.0:1788574537.447547:0:20301:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].6, 80 off9184 00000040:00080000:2.0:1788574537.447587:0:20301:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].7, 224 off9408 00000040:00080000:2.0:1788574537.447615:0:20301:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].8, 224 off9632 00000040:00080000:2.0:1788574537.447654:0:20301:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].9, 120 off9752 00000100:00100000:2.0:1788574537.447784:0:20301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a7bb289180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:64047b6f-0fa6-4004-9f51-bd636ae04daf:20301:1875455747689216:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788574537.448016:0:20301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788574537.448054:0:20301:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a7bfb69780 going to sleep for 11 seconds 00000100:00100000:0.0:1788574537.448416:0:18879:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747689216 00000100:00100000:0.0:1788574537.448425:0:18879:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747689216 00000100:00100000:0.0:1788574537.448471:0:18879:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1788574537.448480:0:18879:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a79e7e8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:64047b6f-0fa6-4004-9f51-bd636ae04daf+17:20301:x1875455747689216:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788574537.448860:0:18879:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a79e7e8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:64047b6f-0fa6-4004-9f51-bd636ae04daf+17:20301:x1875455747689216:12345-0@lo:502:mount.lustre.0 Request processed in 380us (842us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574537.448869:0:18879:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1788574537.449095:0:20301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a7bb289180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:64047b6f-0fa6-4004-9f51-bd636ae04daf:20301:1875455747689216:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788574537.449290:0:20301:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].10, 224 off9976 00000040:00080000:2.0:1788574537.449304:0:20301:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 10 count 11 00000020:01000000:1.0:1788574537.454409:0:20302:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1788574537.454424:0:20302:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-ost2/ost2 00000020:00000080:1.0:1788574537.454431:0:20302:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788574537.454434:0:20302:0:(obd_config.c:1563:class_process_config()) marker 17 (0x1) lustre-OST0001 add ost 00000020:00000080:1.0:1788574537.454439:0:20302:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1788574537.454456:0:20302:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff90a786784d40) 00000020:00000080:1.0:1788574537.454483:0:20302:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type obdfilter with refcount 2 00000020:00000080:1.0:1788574537.454487:0:20302:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1788574537.454563:0:20302:0:(tgt_mount.c:153:server_get_mount()) get mount ffff90a681297000 from lustre-OST0001, refs=2 00080000:01000000:1.0:1788574537.454571:0:20302:0:(osd_handler.c:1574:osd_obd_connect()) connect #1 00000020:00000080:1.0:1788574537.454599:0:20302:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x10531a153b53728d 00010000:00010000:1.0:1788574537.463899:0:20302:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-3 is initialized 00000001:00000004:1.0:1788574537.465970:0:20302:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 3, last_transno is 8589934605 00080000:10000000:1.0:1788574537.475082:0:20302:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0xc:0x0] (8/8/4) registered 00000020:00000080:1.0:1788574537.487751:0:20302:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:1.0:1788574537.487765:0:20302:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788574537.487771:0:20302:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788574537.487773:0:20302:0:(obd_config.c:1563:class_process_config()) marker 17 (0x2) lustre-OST0001 add ost 00000020:01000000:1.0:1788574537.487776:0:20302:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788574537.487849:0:20302:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788574537.487851:0:20302:0:(obd_config.c:1563:class_process_config()) marker 20 (0x1) lustre sys.timeout 00000020:00000080:1.0:1788574537.487855:0:20302:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1788574537.487857:0:20302:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:1.0:1788574537.487859:0:20302:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788574537.487862:0:20302:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788574537.487863:0:20302:0:(obd_config.c:1563:class_process_config()) marker 20 (0x2) lustre sys.timeout 00000020:01000000:1.0:1788574537.487865:0:20302:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788574537.487867:0:20302:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788574537.487869:0:20302:0:(obd_config.c:1563:class_process_config()) marker 24 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1788574537.487872:0:20302:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:1.0:1788574537.487930:0:20302:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788574537.487932:0:20302:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788574537.487934:0:20302:0:(obd_config.c:1563:class_process_config()) marker 24 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1788574537.487936:0:20302:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xc:0x0] index 11 count 11 00000020:01000000:2.0:1788574537.502418:0:20301:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-10 (rc=0) 10000000:01000000:2.0:1788574537.502470:0:20301:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.157@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:2.0:1788574537.502501:0:20301:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.157@tcp lock: ffff90a79e985800/0x10531a153b537278 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x10531a153b53727f expref: -99 pid: 20301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574537.502524:0:20301:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.157@tcp lock: ffff90a79e985800/0x10531a153b537278 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x10531a153b53727f expref: -99 pid: 20301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788574537.502554:0:20301:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff90a681297000 from 1 10000000:01000000:2.0:1788574537.502557:0:20301:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788574537.502601:0:20301:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.157@tcp lock: ffff90a79e984e00/0x10531a153b537294 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 20301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574537.502609:0:20301:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.157@tcp lock: ffff90a79e984e00/0x10531a153b537294 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 20301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574537.502621:0:20301:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.157@tcp lock: ffff90a79e984e00/0x10531a153b537294 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 20301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788574537.502647:0:20301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a7bb289180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:64047b6f-0fa6-4004-9f51-bd636ae04daf:20301:1875455747689344:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1788574537.502899:0:20301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788574537.502945:0:20301:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a7bfb69900 going to sleep for 11 seconds 00000100:00100000:0.0:1788574537.503135:0:18879:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747689344 00000100:00100000:0.0:1788574537.503151:0:18879:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747689344 00000100:00100000:0.0:1788574537.503208:0:18879:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1788574537.503216:0:18879:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a786371850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:64047b6f-0fa6-4004-9f51-bd636ae04daf+17:20301:x1875455747689344:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788574537.503229:0:18879:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788574537.503242:0:18879:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90a68116ae00/0x10531a153b53729b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x10531a153b537294 expref: -99 pid: 18879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574537.503277:0:18879:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90a68116ae00/0x10531a153b53729b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x10531a153b537294 expref: 18 pid: 18879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574537.503287:0:18879:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90a68116ae00/0x10531a153b53729b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x10531a153b537294 expref: 18 pid: 18879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574537.503295:0:18879:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a68116ae00, rc 0) 00000100:00100000:0.0:1788574537.503333:0:18879:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a786371850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:64047b6f-0fa6-4004-9f51-bd636ae04daf+18:20301:x1875455747689344:12345-0@lo:101:mount.lustre.0 Request processed in 118us (436us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574537.503339:0:18879:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1788574537.503402:0:20301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a7bb289180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:64047b6f-0fa6-4004-9f51-bd636ae04daf:20301:1875455747689344:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788574537.503417:0:20301:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.157@tcp lock: ffff90a79e984e00/0x10531a153b537294 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x10531a153b53729b expref: -99 pid: 20301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574537.503425:0:20301:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.157@tcp lock: ffff90a79e984e00/0x10531a153b537294 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x10531a153b53729b expref: -99 pid: 20301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788574537.504282:0:20301:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 10 count 10 00000040:00080000:0.0:1788574537.508956:0:20301:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788574537.511079:0:20301:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].1, 224 off8416 00000040:00080000:0.0:1788574537.511158:0:20301:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].2, 112 off8528 00000040:00080000:0.0:1788574537.511202:0:20301:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].3, 224 off8752 00000040:00080000:0.0:1788574537.511246:0:20301:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].4, 224 off8976 00000040:00080000:0.0:1788574537.511286:0:20301:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].5, 112 off9088 00000040:00080000:0.0:1788574537.511326:0:20301:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].6, 224 off9312 00000040:00080000:0.0:1788574537.511353:0:20301:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].7, 224 off9536 00000040:00080000:0.0:1788574537.511397:0:20301:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].8, 128 off9664 00000040:00080000:0.0:1788574537.511470:0:20301:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].9, 224 off9888 00000040:00080000:0.0:1788574537.511477:0:20301:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 9 count 10 00000100:00100000:0.0:1788574537.511580:0:20301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a6839d2300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:64047b6f-0fa6-4004-9f51-bd636ae04daf:20301:1875455747689472:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788574537.511649:0:20301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788574537.512818:0:18880:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747689472 00000100:00100000:3.0:1788574537.512831:0:18880:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747689472 00000100:00100000:3.0:1788574537.512901:0:18880:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1788574537.512912:0:18880:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a786370850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:64047b6f-0fa6-4004-9f51-bd636ae04daf+18:20301:x1875455747689472:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788574537.513257:0:18880:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a786370850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:64047b6f-0fa6-4004-9f51-bd636ae04daf+18:20301:x1875455747689472:12345-0@lo:501:mount.lustre.0 Request processed in 346us (1606us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574537.513266:0:18880:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1788574537.518776:0:20301:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a797a2bcc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788574537.518835:0:20301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a6839d2300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:64047b6f-0fa6-4004-9f51-bd636ae04daf:20301:1875455747689472:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788574537.518899:0:20301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a6839d2300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:64047b6f-0fa6-4004-9f51-bd636ae04daf:20301:1875455747689600:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788574537.518995:0:20301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788574537.519041:0:20301:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a797a2bcc0 going to sleep for 11 seconds 00000100:00100000:3.0:1788574537.519157:0:18881:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747689600 00000100:00100000:3.0:1788574537.519164:0:18881:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747689600 00000100:00100000:3.0:1788574537.519221:0:18881:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1788574537.519229:0:18881:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a79e8e2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:64047b6f-0fa6-4004-9f51-bd636ae04daf+18:20301:x1875455747689600:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788574537.519623:0:18881:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a79e8e2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:64047b6f-0fa6-4004-9f51-bd636ae04daf+18:20301:x1875455747689600:12345-0@lo:503:mount.lustre.0 Request processed in 394us (628us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574537.519630:0:18881:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1788574537.522544:0:20301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a6839d2300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:64047b6f-0fa6-4004-9f51-bd636ae04daf:20301:1875455747689600:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1788574537.526602:0:20301:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1788574537.526717:0:20301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a6839d2300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:64047b6f-0fa6-4004-9f51-bd636ae04daf:20301:1875455747689728:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788574537.527341:0:20301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788574537.527514:0:20301:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a7bb7e0f00 going to sleep for 11 seconds 00000100:00100000:3.0:1788574537.532616:0:18879:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747689728 00000100:00100000:3.0:1788574537.532632:0:18879:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747689728 00000100:00100000:3.0:1788574537.532770:0:18879:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1788574537.532789:0:18879:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a79e8e3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:64047b6f-0fa6-4004-9f51-bd636ae04daf+18:20301:x1875455747689728:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788574537.535330:0:18879:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a79e8e3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:64047b6f-0fa6-4004-9f51-bd636ae04daf+18:20301:x1875455747689728:12345-0@lo:502:mount.lustre.0 Request processed in 2539us (7979us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574537.535346:0:18879:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1788574537.536943:0:20301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a6839d2300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:64047b6f-0fa6-4004-9f51-bd636ae04daf:20301:1875455747689728:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1788574537.539029:0:20301:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].1, 224 off8416 00000040:00080000:0.0:1788574537.539107:0:20301:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].2, 112 off8528 00000040:00080000:0.0:1788574537.539621:0:20301:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].3, 224 off8752 00000040:00080000:0.0:1788574537.539660:0:20301:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].4, 224 off8976 00000040:00080000:0.0:1788574537.539758:0:20301:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].5, 112 off9088 00000040:00080000:0.0:1788574537.540229:0:20301:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].6, 224 off9312 00000040:00080000:0.0:1788574537.540264:0:20301:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].7, 224 off9536 00000040:00080000:0.0:1788574537.540312:0:20301:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].8, 128 off9664 00000100:00100000:0.0:1788574537.540599:0:20301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a6839d2300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:64047b6f-0fa6-4004-9f51-bd636ae04daf:20301:1875455747689856:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788574537.540677:0:20301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788574537.541701:0:20301:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a7852ac900 going to sleep for 11 seconds 00000100:00100000:3.0:1788574537.542449:0:18879:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747689856 00000100:00100000:3.0:1788574537.542461:0:18879:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747689856 00000100:00100000:2.0:1788574537.542731:0:18879:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1788574537.542743:0:18879:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a79e8e2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:64047b6f-0fa6-4004-9f51-bd636ae04daf+18:20301:x1875455747689856:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788574537.543075:0:18879:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a79e8e2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:64047b6f-0fa6-4004-9f51-bd636ae04daf+18:20301:x1875455747689856:12345-0@lo:502:mount.lustre.0 Request processed in 333us (2397us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574537.543082:0:18879:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1788574537.543812:0:20301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a6839d2300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:64047b6f-0fa6-4004-9f51-bd636ae04daf:20301:1875455747689856:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1788574537.544022:0:20301:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].9, 224 off9888 00000040:00080000:0.0:1788574537.544040:0:20301:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 9 count 10 00000020:01000000:3.0:1788574537.546998:0:20306:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788574537.547013:0:20306:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788574537.547015:0:20306:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1788574537.547024:0:20306:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff90a681297000 00000020:00000080:3.0:1788574537.547026:0:20306:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1788574537.547033:0:20306:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788574537.547035:0:20306:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788574537.547037:0:20306:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:3.0:1788574537.547039:0:20306:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788574537.547041:0:20306:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788574537.547043:0:20306:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1788574537.547047:0:20306:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff90a681297000 00000020:00000080:3.0:1788574537.547049:0:20306:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1788574537.547107:0:20306:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788574537.547110:0:20306:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788574537.547111:0:20306:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:3.0:1788574537.547114:0:20306:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788574537.547116:0:20306:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788574537.547117:0:20306:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1788574537.547120:0:20306:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff90a681297000 00000020:00000080:3.0:1788574537.547122:0:20306:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1788574537.547162:0:20306:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788574537.547165:0:20306:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788574537.547176:0:20306:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:3.0:1788574537.547180:0:20306:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xe:0x0] index 10 count 10 00000020:01000000:2.0:1788574537.547438:0:20301:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-9 (rc=0) 10000000:01000000:2.0:1788574537.547464:0:20301:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.157@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788574537.547484:0:20301:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.157@tcp lock: ffff90a79e984e00/0x10531a153b537294 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x10531a153b53729b expref: -99 pid: 20301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574537.547497:0:20301:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.157@tcp lock: ffff90a79e984e00/0x10531a153b537294 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x10531a153b53729b expref: -99 pid: 20301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788574537.547635:0:20301:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1788574537.547637:0:20301:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff90a681297000 10000000:01000000:2.0:1788574537.547640:0:20301:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff90a681297000 10000000:01000000:2.0:1788574537.547645:0:20301:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1788574537.547649:0:20301:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff90a681297000 from 1 10000000:01000000:2.0:1788574537.547652:0:20301:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1788574537.547744:0:20301:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.157@tcp lock: ffff90a79e984c00/0x10531a153b5372a2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 20301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574537.547753:0:20301:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.157@tcp lock: ffff90a79e984c00/0x10531a153b5372a2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 20301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574537.547765:0:20301:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.157@tcp lock: ffff90a79e984c00/0x10531a153b5372a2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 20301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788574537.547846:0:20301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a7bb288000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:64047b6f-0fa6-4004-9f51-bd636ae04daf:20301:1875455747689984:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1788574537.547914:0:20301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788574537.548760:0:20301:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a7bfb69540 going to sleep for 11 seconds 00000100:00100000:3.0:1788574537.561628:0:18879:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747689984 00000100:00100000:3.0:1788574537.561649:0:18879:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747689984 00000100:00100000:3.0:1788574537.561761:0:18881:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1788574537.561773:0:18881:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a79f2d0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:64047b6f-0fa6-4004-9f51-bd636ae04daf+18:20301:x1875455747689984:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788574537.561804:0:18881:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788574537.561828:0:18881:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90a6824f8600/0x10531a153b5372a9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x10531a153b5372a2 expref: -99 pid: 18881 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574537.561862:0:18881:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90a6824f8600/0x10531a153b5372a9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x10531a153b5372a2 expref: 19 pid: 18881 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574537.561875:0:18881:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90a6824f8600/0x10531a153b5372a9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x10531a153b5372a2 expref: 19 pid: 18881 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574537.561888:0:18881:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a6824f8600, rc 0) 00000100:00100000:3.0:1788574537.561984:0:18881:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a79f2d0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:64047b6f-0fa6-4004-9f51-bd636ae04daf+19:20301:x1875455747689984:12345-0@lo:101:mount.lustre.0 Request processed in 204us (14060us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574537.561991:0:18881:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1788574537.562045:0:20301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a7bb288000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:64047b6f-0fa6-4004-9f51-bd636ae04daf:20301:1875455747689984:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788574537.562062:0:20301:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.157@tcp lock: ffff90a79e984c00/0x10531a153b5372a2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x10531a153b5372a9 expref: -99 pid: 20301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574537.562071:0:20301:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.157@tcp lock: ffff90a79e984c00/0x10531a153b5372a2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x10531a153b5372a9 expref: -99 pid: 20301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788574537.563033:0:20301:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 42 count 42 00000040:00080000:3.0:1788574537.565972:0:20301:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788574537.571657:0:20301:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].1, 224 off8416 00000040:00080000:3.0:1788574537.582229:0:20301:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].2, 120 off8536 00000040:00080000:3.0:1788574537.582309:0:20301:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].3, 168 off8704 00000040:00080000:3.0:1788574537.582422:0:20301:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].4, 224 off8928 00000040:00080000:3.0:1788574537.582458:0:20301:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].5, 224 off9152 00000040:00080000:3.0:1788574537.582501:0:20301:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].6, 120 off9272 00000040:00080000:3.0:1788574537.583426:0:20301:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].7, 168 off9440 00000040:00080000:3.0:1788574537.583461:0:20301:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].8, 224 off9664 00000040:00080000:3.0:1788574537.583530:0:20301:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].9, 224 off9888 00000040:00080000:3.0:1788574537.583564:0:20301:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].10, 120 off10008 00000040:00080000:3.0:1788574537.583592:0:20301:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].11, 224 off10232 00000040:00080000:3.0:1788574537.583632:0:20301:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].12, 224 off10456 00000040:00080000:3.0:1788574537.583662:0:20301:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].13, 88 off10544 00000040:00080000:3.0:1788574537.583899:0:20301:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].14, 128 off10672 00000040:00080000:3.0:1788574537.583948:0:20301:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].15, 144 off10816 00000040:00080000:3.0:1788574537.583991:0:20301:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].16, 160 off10976 00000040:00080000:3.0:1788574537.584028:0:20301:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].17, 224 off11200 00000040:00080000:3.0:1788574537.584074:0:20301:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].18, 224 off11424 00000040:00080000:3.0:1788574537.584105:0:20301:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].19, 80 off11504 00000040:00080000:3.0:1788574537.584131:0:20301:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].20, 224 off11728 00000040:00080000:3.0:1788574537.584167:0:20301:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].21, 224 off11952 00000040:00080000:3.0:1788574537.584193:0:20301:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].22, 88 off12040 00000040:00080000:3.0:1788574537.584217:0:20301:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].23, 128 off12168 00000040:00080000:3.0:1788574537.584254:0:20301:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].24, 144 off12312 00000040:00080000:3.0:1788574537.588516:0:20301:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].25, 128 off12440 00000040:00080000:3.0:1788574537.588565:0:20301:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].26, 224 off12664 00000040:00080000:3.0:1788574537.588638:0:20301:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].27, 224 off12888 00000040:00080000:3.0:1788574537.588669:0:20301:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].28, 80 off12968 00000040:00080000:3.0:1788574537.589456:0:20301:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].29, 224 off13192 00000040:00080000:3.0:1788574537.589610:0:20301:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].30, 224 off13416 00000040:00080000:3.0:1788574537.589644:0:20301:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].31, 88 off13504 00000040:00080000:3.0:1788574537.589671:0:20301:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].32, 128 off13632 00000040:00080000:3.0:1788574537.589993:0:20301:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].33, 144 off13776 00000040:00080000:3.0:1788574537.590058:0:20301:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].34, 128 off13904 00000040:00080000:3.0:1788574537.590091:0:20301:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].35, 224 off14128 00000040:00080000:3.0:1788574537.590609:0:20301:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].36, 224 off14352 00000040:00080000:3.0:1788574537.590648:0:20301:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].37, 80 off14432 00000040:00080000:3.0:1788574537.590673:0:20301:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].38, 224 off14656 00000040:00080000:3.0:1788574537.593019:0:20301:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].39, 224 off14880 00000040:00080000:3.0:1788574537.595916:0:20301:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].40, 120 off15000 00000040:00080000:3.0:1788574537.596074:0:20301:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].41, 224 off15224 00000040:00080000:3.0:1788574537.596081:0:20301:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 41 count 42 00000100:00100000:3.0:1788574537.596594:0:20301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a7bbebd180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:64047b6f-0fa6-4004-9f51-bd636ae04daf:20301:1875455747690112:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788574537.596663:0:20301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788574537.600830:0:20301:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a785e94480 going to sleep for 11 seconds 00010000:00010000:0.0:1788574537.603942:0:18874:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788574537.603961:0:18881:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747690112 00000100:00100000:0.0:1788574537.603972:0:18881:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747690112 00000100:00100000:0.0:1788574537.604047:0:18881:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1788574537.604058:0:18881:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a79f2d0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:64047b6f-0fa6-4004-9f51-bd636ae04daf+19:20301:x1875455747690112:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788574537.604394:0:18881:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a79f2d0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:64047b6f-0fa6-4004-9f51-bd636ae04daf+19:20301:x1875455747690112:12345-0@lo:501:mount.lustre.0 Request processed in 337us (7729us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574537.604402:0:18881:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1788574537.605245:0:20301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a7bbebd180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:64047b6f-0fa6-4004-9f51-bd636ae04daf:20301:1875455747690112:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788574537.605406:0:20301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a7bbebd180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:64047b6f-0fa6-4004-9f51-bd636ae04daf:20301:1875455747690240:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788574537.605483:0:20301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788574537.606025:0:20301:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a785e94480 going to sleep for 11 seconds 00000100:00100000:3.0:1788574537.610187:0:18879:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747690240 00000100:00100000:3.0:1788574537.610209:0:18879:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747690240 00000100:00100000:0.0:1788574537.610466:0:18880:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1788574537.610484:0:18880:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a79f2d0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:64047b6f-0fa6-4004-9f51-bd636ae04daf+19:20301:x1875455747690240:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788574537.611242:0:18880:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a79f2d0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:64047b6f-0fa6-4004-9f51-bd636ae04daf+19:20301:x1875455747690240:12345-0@lo:503:mount.lustre.0 Request processed in 761us (5757us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574537.611251:0:18880:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1788574537.611480:0:20301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a7bbebd180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:64047b6f-0fa6-4004-9f51-bd636ae04daf:20301:1875455747690240:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1788574537.620098:0:20301:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1788574537.620232:0:20301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a6839d2300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:64047b6f-0fa6-4004-9f51-bd636ae04daf:20301:1875455747690368:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788574537.620358:0:20301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788574537.620444:0:20301:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a78318f840 going to sleep for 11 seconds 00000100:00100000:3.0:1788574537.621731:0:18879:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747690368 00000100:00100000:3.0:1788574537.621742:0:18879:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747690368 00000100:00100000:3.0:1788574537.621808:0:18880:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1788574537.621818:0:18880:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a79f2d2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:64047b6f-0fa6-4004-9f51-bd636ae04daf+19:20301:x1875455747690368:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788574537.622201:0:18880:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a79f2d2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:64047b6f-0fa6-4004-9f51-bd636ae04daf+19:20301:x1875455747690368:12345-0@lo:502:mount.lustre.0 Request processed in 385us (1842us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574537.622210:0:18880:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1788574537.622942:0:20301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a6839d2300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:64047b6f-0fa6-4004-9f51-bd636ae04daf:20301:1875455747690368:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1788574537.631287:0:20301:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].1, 224 off8416 00000040:00080000:0.0:1788574537.631419:0:20301:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].2, 120 off8536 00000040:00080000:0.0:1788574537.631451:0:20301:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].3, 168 off8704 00000040:00080000:0.0:1788574537.631494:0:20301:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].4, 224 off8928 00000040:00080000:0.0:1788574537.631537:0:20301:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].5, 224 off9152 00000040:00080000:0.0:1788574537.631580:0:20301:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].6, 120 off9272 00000040:00080000:0.0:1788574537.631611:0:20301:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].7, 168 off9440 00000040:00080000:0.0:1788574537.631639:0:20301:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].8, 224 off9664 00000040:00080000:0.0:1788574537.631679:0:20301:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].9, 224 off9888 00000040:00080000:0.0:1788574537.631933:0:20301:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].10, 120 off10008 00000040:00080000:0.0:1788574537.631962:0:20301:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].11, 224 off10232 00000040:00080000:0.0:1788574537.632022:0:20301:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].12, 224 off10456 00000040:00080000:0.0:1788574537.632096:0:20301:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].13, 88 off10544 00000040:00080000:0.0:1788574537.632125:0:20301:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].14, 128 off10672 00000040:00080000:0.0:1788574537.632167:0:20301:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].15, 144 off10816 00000040:00080000:0.0:1788574537.632196:0:20301:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].16, 160 off10976 00000040:00080000:0.0:1788574537.632224:0:20301:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].17, 224 off11200 00000040:00080000:0.0:1788574537.632268:0:20301:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].18, 224 off11424 00000040:00080000:0.0:1788574537.632298:0:20301:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].19, 80 off11504 00000040:00080000:0.0:1788574537.632325:0:20301:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].20, 224 off11728 00000040:00080000:0.0:1788574537.632363:0:20301:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].21, 224 off11952 00000040:00080000:0.0:1788574537.632413:0:20301:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].22, 88 off12040 00000040:00080000:0.0:1788574537.632438:0:20301:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].23, 128 off12168 00000040:00080000:0.0:1788574537.632478:0:20301:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].24, 144 off12312 00000040:00080000:0.0:1788574537.634436:0:20301:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].25, 128 off12440 00000040:00080000:0.0:1788574537.634914:0:20301:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].26, 224 off12664 00000040:00080000:0.0:1788574537.635000:0:20301:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].27, 224 off12888 00000040:00080000:0.0:1788574537.635038:0:20301:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].28, 80 off12968 00000040:00080000:0.0:1788574537.635097:0:20301:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].29, 224 off13192 00000040:00080000:0.0:1788574537.636013:0:20301:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].30, 224 off13416 00000040:00080000:0.0:1788574537.636067:0:20301:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].31, 88 off13504 00000040:00080000:0.0:1788574537.636095:0:20301:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].32, 128 off13632 00000040:00080000:0.0:1788574537.636122:0:20301:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].33, 144 off13776 00000040:00080000:0.0:1788574537.637664:0:20301:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].34, 128 off13904 00000040:00080000:0.0:1788574537.638670:0:20301:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].35, 224 off14128 00000040:00080000:0.0:1788574537.638866:0:20301:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].36, 224 off14352 00000040:00080000:0.0:1788574537.638902:0:20301:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].37, 80 off14432 00000040:00080000:0.0:1788574537.638930:0:20301:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].38, 224 off14656 00000040:00080000:0.0:1788574537.638971:0:20301:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].39, 224 off14880 00000040:00080000:0.0:1788574537.639017:0:20301:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].40, 120 off15000 00000100:00100000:0.0:1788574537.639068:0:20301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a6839d2300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:64047b6f-0fa6-4004-9f51-bd636ae04daf:20301:1875455747690496:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788574537.640489:0:20301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788574537.640627:0:20301:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a78318f840 going to sleep for 11 seconds 00000100:00100000:2.0:1788574537.652673:0:18881:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747690496 00000100:00100000:2.0:1788574537.652705:0:18881:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747690496 00000100:00100000:3.0:1788574537.653177:0:18881:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1788574537.653203:0:18881:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a79f2d1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:64047b6f-0fa6-4004-9f51-bd636ae04daf+19:20301:x1875455747690496:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788574537.662955:0:18881:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a79f2d1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:64047b6f-0fa6-4004-9f51-bd636ae04daf+19:20301:x1875455747690496:12345-0@lo:502:mount.lustre.0 Request processed in 9743us (22457us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574537.662981:0:18881:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1788574537.663120:0:20301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a6839d2300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:64047b6f-0fa6-4004-9f51-bd636ae04daf:20301:1875455747690496:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1788574537.663325:0:20301:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].41, 224 off15224 00000040:00080000:0.0:1788574537.663340:0:20301:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 41 count 42 00000020:01000004:0.0:1788574537.665066:0:20311:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:0.0:1788574537.665085:0:20311:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff90a79241cd40) 00000020:00000080:0.0:1788574537.665113:0:20311:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type lwp with refcount 2 00000020:01000004:0.0:1788574537.666015:0:20311:0:(tgt_mount.c:153:server_get_mount()) get mount ffff90a681297000 from lustre-OST0001, refs=3 00000020:01000004:0.0:1788574537.666023:0:20311:0:(tgt_mount.c:187:server_put_mount()) put mount ffff90a681297000 from lustre-OST0001, refs=3 00000020:01000004:0.0:1788574537.666027:0:20311:0:(obd_mount.c:710:lustre_put_lsi()) put ffff90a681297000 3 00010000:00080000:0.0:1788574537.666066:0:20311:0:(ldlm_lib.c:102:import_set_conn()) imp ffff90a785e19800@lustre-MDT0000-lwp-OST0001: add connection 192.168.201.157@tcp at head 00010000:00010000:3.0:1788574537.670192:0:20311:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-5 is initialized 00000020:00000080:3.0:1788574537.670467:0:20311:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:3.0:1788574537.670527:0:20311:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1788574537.670541:0:20311:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0x10531a153b5372b7 00000100:00080000:3.0:1788574537.670553:0:20311:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1788574537.670560:0:20311:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff90a785e19800 using connection 192.168.201.157@tcp/0@lo 00000100:00100000:3.0:1788574537.670625:0:20311:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff90a7bbebd180 x1875455747690624/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788574537.670646:0:20311:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00100000:1.0:1788574537.671647:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a7bbebd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3311:1875455747690624:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1788574537.671757:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788574537.671955:0:18888:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747690624 00000100:00100000:3.0:1788574537.671963:0:18888:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747690624 00000100:00100000:3.0:1788574537.672015:0:18888:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788574537.672023:0:18888:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7a72b8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3311:x1875455747690624:12345-0@lo:38:llog_process_th.0 00010000:00080000:3.0:1788574537.672049:0:18888:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 663 last 0 00000020:00000080:3.0:1788574537.672084:0:18888:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0x10531a153b5372be 00000004:00100000:3.0:1788574537.672105:0:18888:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1788574537.672145:0:18888:0:(import.c:65:import_set_state_nolock()) ffff90a68328b800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788574537.672204:0:18888:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7a72b8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1875455747690624:12345-0@lo:38:llog_process_th.0 Request processed in 181us (446us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574537.672212:0:18888:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00080000:0.0:1788574537.672580:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788574537.672585:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1788574537.672587:0:8:0:(import.c:65:import_set_state_nolock()) ffff90a786924800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788574537.672592:0:8:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 660 00000100:00080000:0.0:1788574537.672595:0:8:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1788574537.672600:0:8:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff90a786924800 using connection 192.168.201.157@tcp/0@lo 00000100:00100000:0.0:1788574537.672615:0:8:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff90a6839d0700 x1875455747690880/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788574537.673233:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788574537.673249:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a6839d2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1875455747690752:0@lo:400:kworker.0 00000100:00100000:1.0:1788574537.673305:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788574537.673340:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a6839d1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3312:1875455747691008:0@lo:400:kworker.0 00000100:00100000:1.0:1788574537.673363:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788574537.673408:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788574537.673414:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a6839d2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3312:1875455747691136:0@lo:400:kworker.0 00000100:00100000:1.0:1788574537.673433:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788574537.673465:0:19577:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747690752 00000100:00100000:1.0:1788574537.673472:0:19577:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747690752 00000100:00100000:1.0:1788574537.673530:0:19577:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788574537.673538:0:19577:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7a72b8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3314:x1875455747690752:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788574537.673577:0:19577:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7a72b8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3314:x1875455747690752:12345-0@lo:400:kworker.0 Request processed in 40us (271us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574537.673592:0:19577:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788574537.673610:0:18886:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747691008 00000100:00100000:1.0:1788574537.673613:0:18886:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747691008 00000100:00100000:1.0:1788574537.673631:0:18886:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747691136 00000100:00100000:1.0:1788574537.673633:0:18886:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747691136 00000100:00100000:1.0:1788574537.673648:0:18886:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1788574537.673653:0:18886:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7a72b8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1875455747691008:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788574537.673893:0:18886:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7a72b8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1875455747691008:12345-0@lo:400:kworker.0 Request processed in 238us (528us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574537.673899:0:18886:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1788574537.673912:0:18886:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1788574537.673918:0:18886:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7a72ba300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1875455747691136:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788574537.673944:0:18886:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7a72ba300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1875455747691136:12345-0@lo:400:kworker.0 Request processed in 27us (510us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574537.673950:0:18886:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00080000:1.0:1788574537.673963:0:18882:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788574537.673968:0:18882:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1788574537.674017:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90a6839d2a00 x1875455747691136/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788574553 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788574537.674035:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a6839d2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3312:1875455747691136:0@lo:400:kworker.0 00010000:00080000:1.0:1788574537.674047:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90a6839d1c00 x1875455747691008/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788574553 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788574537.674055:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a6839d1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3312:1875455747691008:0@lo:400:kworker.0 00000100:00100000:1.0:1788574537.674088:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a6839d2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1875455747690752:0@lo:400:kworker.0 00000100:00100000:1.0:1788574537.674105:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a6839d0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3311:1875455747690880:0@lo:8:kworker.0 00000100:00100000:1.0:1788574537.674207:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:1.0:1788574537.674237:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90a7bbebd180 x1875455747690624/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788574547 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788574537.674244:0:3311:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:1.0:1788574537.674254:0:3311:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 3 00000100:00080000:1.0:1788574537.674858:0:3311:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:1.0:1788574537.674867:0:3311:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1788574537.674873:0:3311:0:(import.c:65:import_set_state_nolock()) ffff90a785e19800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1788574537.674882:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a7bbebd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3311:1875455747690624:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1788574537.674911:0:19576:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747690880 00000100:00100000:1.0:1788574537.674916:0:19576:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747690880 00000040:00080000:3.0:1788574537.676486:0:20311:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x10:0x0] index 42 count 42 00000100:00100000:1.0:1788574537.676746:0:19576:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788574537.676762:0:19576:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7a72bad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3311:x1875455747690880:12345-0@lo:8:kworker.0 00000100:00100000:1.0:1788574537.676938:0:19576:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7a72bad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3311:x1875455747690880:12345-0@lo:8:kworker.0 Request processed in 177us (2729us total) trans 0 rc -11/-11 00000100:00100000:1.0:1788574537.676946:0:19576:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788574537.687492:0:3311:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1788574537.687546:0:3311:0:(import.c:65:import_set_state_nolock()) ffff90a786924800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788574537.687556:0:3311:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-11) 00000100:00100000:3.0:1788574537.687561:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a6839d0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3311:1875455747690880:0@lo:8:kworker.0 00000020:01000000:3.0:1788574537.690691:0:20301:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:3.0:1788574537.690746:0:20301:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.157@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1788574537.690770:0:20301:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.157@tcp lock: ffff90a79e984c00/0x10531a153b5372a2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x10531a153b5372a9 expref: -99 pid: 20301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574537.690791:0:20301:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.157@tcp lock: ffff90a79e984c00/0x10531a153b5372a2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x10531a153b5372a9 expref: -99 pid: 20301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:3.0:1788574537.690882:0:20301:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:3.0:1788574537.690885:0:20301:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1788574537.690886:0:20301:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788574537.690888:0:20301:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788574537.690889:0:20301:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788574537.690891:0:20301:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788574537.690892:0:20301:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788574537.690894:0:20301:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788574537.690895:0:20301:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1788574537.690900:0:20301:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020002 00000020:01000004:3.0:1788574537.690902:0:20301:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1788574537.690904:0:20301:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1788574537.690905:0:20301:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788574537.690906:0:20301:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788574537.690907:0:20301:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788574537.690908:0:20301:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788574537.690910:0:20301:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788574537.690911:0:20301:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788574537.690912:0:20301:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1788574537.690942:0:20301:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:3.0:1788574537.690962:0:20301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a7bbebca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:64047b6f-0fa6-4004-9f51-bd636ae04daf:20301:1875455747691264:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1788574537.691061:0:20301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788574537.691113:0:20301:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a785e94a80 going to sleep for 11 seconds 00000100:00100000:3.0:1788574537.691166:0:18879:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747691264 00000100:00100000:3.0:1788574537.691175:0:18879:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747691264 00000100:00100000:3.0:1788574537.691246:0:18879:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1788574537.691254:0:18879:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a79f2d0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:64047b6f-0fa6-4004-9f51-bd636ae04daf+19:20301:x1875455747691264:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1788574537.691305:0:18879:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:3.0:1788574537.691323:0:18879:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:0.0:1788574537.759385:0:18879:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1788574537.759413:0:18879:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:0.0:1788574537.759445:0:18902:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1788574537.759450:0:18902:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1788574537.759475:0:18902:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff90a68116bc00/0x10531a153b5372c5 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574537.759495:0:18902:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90a78165a200/0x10531a153b53717c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x10531a153b537175 expref: 19 pid: 18880 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574537.759758:0:18902:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff90a68116bc00/0x10531a153b5372c5 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 18902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574537.759813:0:18902:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90a78165a200/0x10531a153b53717c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x10531a153b537175 expref: 19 pid: 18880 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574537.759826:0:18902:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff90a78165a200/0x10531a153b53717c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x10531a153b537175 expref: 19 pid: 18880 timeout: 763 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788574537.759840:0:18902:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a6839d0a80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:18902:1875455747691392:0@lo:104: 00000100:00100000:0.0:1788574537.759905:0:18902:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788574537.759952:0:18902:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a78c8cf540 going to sleep for 11 seconds 00000100:00100000:2.0:1788574537.760150:0:18870:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747691392 00000100:00100000:2.0:1788574537.760159:0:18870:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747691392 00000100:00100000:2.0:1788574537.760216:0:18870:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788574537.760225:0:18870:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6839d3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:64047b6f-0fa6-4004-9f51-bd636ae04daf+3:18902:x1875455747691392:12345-0@lo:104: 00010000:00010000:2.0:1788574537.760239:0:18870:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.157@tcp lock: ffff90a79e984000/0x10531a153b537175 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x10531a153b53717c expref: -99 pid: 18883 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574537.760299:0:18870:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788574537.760311:0:18870:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6839d3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:64047b6f-0fa6-4004-9f51-bd636ae04daf+3:18902:x1875455747691392:12345-0@lo:104: Request processed in 87us (406us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574537.760317:0:18870:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00010000:2.0:1788574537.760339:0:18875:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788574537.760346:0:18875:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.157@tcp lock: ffff90a79e984000/0x10531a153b537175 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x10531a153b53717c expref: -99 pid: 18883 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574537.760354:0:18875:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a79e984000 already unused, calling callback (ffffffffc1bbcc20) 10000000:00010000:2.0:1788574537.760358:0:18875:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.157@tcp lock: ffff90a79e984000/0x10531a153b537175 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x10531a153b53717c expref: -99 pid: 18883 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574537.760394:0:18875:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.157@tcp lock: ffff90a79e984000/0x10531a153b537175 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x10531a153b53717c expref: -99 pid: 18883 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788574537.760403:0:18875:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.157@tcp lock: ffff90a79e984000/0x10531a153b537175 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x10531a153b53717c expref: -99 pid: 18883 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788574537.760408:0:18875:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1788574537.760432:0:18875:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.157@tcp lock: ffff90a79e984000/0x10531a153b537175 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x10531a153b53717c expref: -99 pid: 18883 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574537.760438:0:18875:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788574537.760455:0:18875:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.157@tcp lock: ffff90a79e984000/0x10531a153b537175 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x10531a153b53717c expref: -99 pid: 18883 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574537.760463:0:18875:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.157@tcp lock: ffff90a79e984000/0x10531a153b537175 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x10531a153b53717c expref: -99 pid: 18883 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574537.760480:0:18875:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788574537.760482:0:18875:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788574537.760484:0:18875:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788574537.760500:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a7bb28a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:64047b6f-0fa6-4004-9f51-bd636ae04daf:3314:1875455747691520:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788574537.760538:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788574537.760569:0:18871:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747691520 00000100:00100000:2.0:1788574537.760573:0:18871:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747691520 00010000:00010000:2.0:1788574537.760587:0:18871:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90a78165a200/0x10531a153b53717c lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x10531a153b537175 expref: 20 pid: 18880 timeout: 763 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788574537.760605:0:18871:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788574537.760610:0:18871:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7bb289500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:64047b6f-0fa6-4004-9f51-bd636ae04daf+20:3314:x1875455747691520:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788574537.760632:0:18871:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788574537.760638:0:18871:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90a78165a200/0x10531a153b53717c lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x10531a153b537175 expref: 20 pid: 18880 timeout: 763 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574537.760647:0:18871:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90a78165a200/0x10531a153b53717c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x10531a153b537175 expref: 20 pid: 18880 timeout: 763 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574537.760662:0:18871:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff90a68116bc00/0x10531a153b5372c5 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 18902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574537.760670:0:18871:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90a68116bc00/0x10531a153b5372c5 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 18902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1788574537.760942:0:18871:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.001493654s 00010000:00010000:2.0:1788574537.760949:0:18871:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff90a68116bc00/0x10531a153b5372c5 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 18902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574537.760957:0:18871:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff90a68116bc00/0x10531a153b5372c5 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 18902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574537.760964:0:18871:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff90a68116bc00/0x10531a153b5372c5 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 18902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574537.760991:0:18871:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff90a68116bc00/0x10531a153b5372c5 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 18902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574537.760997:0:18871:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a68116bc00 already unused, calling callback (ffffffffc159f4f0) 00010000:00010000:2.0:1788574537.761001:0:18871:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff90a68116bc00/0x10531a153b5372c5 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 18902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574537.761008:0:18871:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff90a68116bc00/0x10531a153b5372c5 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 18902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574537.761017:0:18871:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff90a68116bc00/0x10531a153b5372c5 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 18902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574537.761026:0:18871:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788574537.761062:0:18871:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7bb289500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:64047b6f-0fa6-4004-9f51-bd636ae04daf+20:3314:x1875455747691520:12345-0@lo:103:ldlm_bl.0 Request processed in 451us (523us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574537.761068:0:18871:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788574537.761137:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a7bb28a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:64047b6f-0fa6-4004-9f51-bd636ae04daf:3314:1875455747691520:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788574537.761233:0:18902:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90a78165a200/0x10531a153b53717c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x10531a153b537175 expref: 19 pid: 18880 timeout: 763 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788574537.761243:0:18902:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a6839d0a80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:18902:1875455747691392:0@lo:104: 00010000:00010000:0.0:1788574537.761257:0:18902:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff90a68116bc00/0x10531a153b5372c5 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 18902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574537.761338:0:18902:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff90a68116bc00/0x10531a153b5372c5 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 18902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574537.761345:0:18902:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff90a68116bc00/0x10531a153b5372c5 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 18902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574537.761358:0:18902:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90a68116bc00/0x10531a153b5372c5 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 18902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788574537.792659:0:20301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a7bbebca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:64047b6f-0fa6-4004-9f51-bd636ae04daf:20301:1875455747691264:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1788574537.792659:0:18879:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a79f2d0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:64047b6f-0fa6-4004-9f51-bd636ae04daf+18:20301:x1875455747691264:12345-0@lo:253:mount.lustre.0 Request processed in 101393us (101586us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574537.792675:0:18879:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 10000000:01000000:3.0:1788574537.792683:0:20301:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:3.0:1788574537.792687:0:20301:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1788574537.792689:0:20301:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1788574537.792690:0:20301:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788574537.792691:0:20301:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788574537.792692:0:20301:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788574537.792693:0:20301:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788574537.792695:0:20301:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788574537.792696:0:20301:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788574537.792698:0:20301:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:3.0:1788574537.792714:0:20301:0:(tgt_mount.c:2698:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:2.0:1788574537.800039:0:20301:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:2.0:1788574537.800631:0:20301:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:2.0:1788574537.800928:0:20301:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:2.0:1788574537.801104:0:20301:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:2.0:1788574537.801593:0:20301:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:2.0:1788574537.801948:0:20301:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:2.0:1788574537.804441:0:20301:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 3, last_transno is 12884901888 00002000:00080000:3.0:1788574537.866664:0:20301:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:3.0:1788574537.866674:0:20301:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:3.0:1788574537.866711:0:20301:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:3.0:1788574537.866775:0:20301:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.201.157@tcp: cl_mgc_mutex unlock 00000020:01000004:3.0:1788574537.866906:0:20301:0:(tgt_mount.c:2464:server_fill_super_common()) Server sb, dev=49 00000080:00000004:3.0:1788574537.866937:0:20301:0:(super25.c:182:lustre_fill_super()) lustre-ost2/ost2: Mount complete 00000100:00100000:1.0:1788574538.369978:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788574538.370004:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a6839d0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1875455747691648:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788574538.370087:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788574538.370282:0:19580:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747691648 00000100:00100000:0.0:1788574538.370295:0:19580:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747691648 00000100:00100000:0.0:1788574538.370395:0:19580:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788574538.370407:0:19580:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7a72b8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1875455747691648:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788574538.370453:0:19580:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788574538.370518:0:19580:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7a72b8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1875455747691648:12345-0@lo:13:osp-pre-0-0.0 Request processed in 113us (431us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574538.370526:0:19580:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788574538.371042:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a6839d0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1875455747691648:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1788574538.625539:0:18874:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1788574539.456594:0:18883:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1788574539.456607:0:18883:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff90a79fbec800 from 11 10000000:01000000:3.0:1788574539.456616:0:18883:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1788574539.456690:0:18883:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.157@tcp lock: ffff90a6824f9200/0x10531a153b5372cc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 18883 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574539.456706:0:18883:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.157@tcp lock: ffff90a6824f9200/0x10531a153b5372cc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 18883 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574539.456736:0:18883:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.157@tcp lock: ffff90a6824f9200/0x10531a153b5372cc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 18883 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788574539.456772:0:18883:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a7bbebca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:64047b6f-0fa6-4004-9f51-bd636ae04daf:18883:1875455747691776:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788574539.458035:0:18883:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788574539.458100:0:18883:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a79e8e99c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788574539.458166:0:18881:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747691776 00000100:00100000:1.0:1788574539.458176:0:18881:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747691776 00000100:00100000:1.0:1788574539.458243:0:18881:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1788574539.458254:0:18881:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a79f2d2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:64047b6f-0fa6-4004-9f51-bd636ae04daf+18:18883:x1875455747691776:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788574539.458274:0:18881:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788574539.458307:0:18881:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90a790a21000/0x10531a153b5372d3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x10531a153b5372cc expref: -99 pid: 18881 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574539.458339:0:18881:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90a790a21000/0x10531a153b5372d3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x10531a153b5372cc expref: 19 pid: 18881 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574539.458354:0:18881:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90a790a21000/0x10531a153b5372d3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x10531a153b5372cc expref: 19 pid: 18881 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574539.458390:0:18881:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a790a21000, rc 0) 00000100:00100000:1.0:1788574539.458433:0:18881:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a79f2d2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:64047b6f-0fa6-4004-9f51-bd636ae04daf+19:18883:x1875455747691776:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 181us (402us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574539.458440:0:18881:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1788574539.459046:0:18883:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a7bbebca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:64047b6f-0fa6-4004-9f51-bd636ae04daf:18883:1875455747691776:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788574539.459071:0:18883:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.157@tcp lock: ffff90a6824f9200/0x10531a153b5372cc lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x10531a153b5372d3 expref: -99 pid: 18883 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574539.459081:0:18883:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.157@tcp lock: ffff90a6824f9200/0x10531a153b5372cc lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x10531a153b5372d3 expref: -99 pid: 18883 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788574539.459175:0:18883:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a7bbebca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:64047b6f-0fa6-4004-9f51-bd636ae04daf:18883:1875455747691904:0@lo:256:ll_cfg_requeue.0 00000100:00100000:3.0:1788574539.459229:0:18883:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788574539.459272:0:18883:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a79e8e99c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788574539.459541:0:18879:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747691904 00000100:00100000:1.0:1788574539.459549:0:18879:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747691904 00000100:00100000:1.0:1788574539.459599:0:18879:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1788574539.459611:0:18879:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a79f2d3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:64047b6f-0fa6-4004-9f51-bd636ae04daf+19:18883:x1875455747691904:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:1.0:1788574539.459634:0:18879:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1788574539.459660:0:18879:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1788574539.459665:0:18879:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 11 00000100:00100000:1.0:1788574539.459773:0:18879:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a79f2d3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:64047b6f-0fa6-4004-9f51-bd636ae04daf+19:18883:x1875455747691904:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 163us (541us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574539.459782:0:18879:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1788574539.461071:0:18883:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a7bbebca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:64047b6f-0fa6-4004-9f51-bd636ae04daf:18883:1875455747691904:0@lo:256:ll_cfg_requeue.0 10000000:01000000:3.0:1788574539.461158:0:18883:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.157@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1788574539.461171:0:18883:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.157@tcp lock: ffff90a6824f9200/0x10531a153b5372cc lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x10531a153b5372d3 expref: -99 pid: 18883 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574539.461184:0:18883:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.157@tcp lock: ffff90a6824f9200/0x10531a153b5372cc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x10531a153b5372d3 expref: -99 pid: 18883 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574539.649026:0:18875:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788574540.098625:0:18921:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1788574540.676076:0:18874:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788574541.696960:0:18875:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788574542.723850:0:18874:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1788574542.985804:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788574542.985821:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1788574542.985827:0:8:0:(import.c:65:import_set_state_nolock()) ffff90a786924800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788574542.985854:0:8:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff90a786924800 using connection 192.168.201.157@tcp/0@lo 00000100:00100000:2.0:1788574542.985929:0:8:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff90a7bb288000 x1875455747692288/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788574542.986060:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a7bb288000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3311:1875455747692288:0@lo:8:kworker.0 00000100:00100000:2.0:1788574542.986162:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788574542.990448:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a7bb28a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1875455747692160:0@lo:400:kworker.0 00000100:00100000:0.0:1788574542.990582:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788574542.998623:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a7bb288e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3315:1875455747692544:0@lo:400:kworker.0 00000100:00100000:2.0:1788574542.998754:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788574542.998812:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788574542.998819:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a7bb289180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3315:1875455747692416:0@lo:400:kworker.0 00000100:00100000:2.0:1788574542.998843:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788574542.998892:0:19577:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747692288 00000100:00100000:2.0:1788574542.998903:0:19577:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747692288 00000100:00100000:2.0:1788574542.998943:0:19577:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747692160 00000100:00100000:2.0:1788574542.998946:0:19577:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747692160 00000100:00100000:2.0:1788574542.998984:0:19577:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788574542.998995:0:19577:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6839d0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3313:x1875455747692160:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788574542.999062:0:19577:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6839d0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3313:x1875455747692160:12345-0@lo:400:kworker.0 Request processed in 69us (8481us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574542.999070:0:19577:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788574542.999093:0:19577:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788574542.999097:0:19577:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7bb288a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3311:x1875455747692288:12345-0@lo:8:kworker.0 00010000:00080000:2.0:1788574542.999130:0:19577:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 669 last 0 00000020:00000080:2.0:1788574542.999169:0:19577:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x10531a153b5372da 00002000:00100000:2.0:1788574542.999185:0:19577:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff90a790dc3000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a03 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:2.0:1788574542.999206:0:19577:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00002000:00100000:2.0:1788574542.999210:0:19577:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:2.0:1788574542.999684:0:19577:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1788574542.999714:0:19577:0:(import.c:65:import_set_state_nolock()) ffff90a790dc7800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788574542.999763:0:19577:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7bb288a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3311:x1875455747692288:12345-0@lo:8:kworker.0 Request processed in 664us (13601us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574542.999771:0:19577:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:2.0:1788574543.000138:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90a7bb288000 x1875455747692288/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788574567 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788574543.000156:0:3311:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 3 00000100:00080000:2.0:1788574543.000166:0:3311:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:2.0:1788574543.000174:0:3311:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:2.0:1788574543.000177:0:3311:0:(import.c:65:import_set_state_nolock()) ffff90a786924800 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:2.0:1788574543.000192:0:3311:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:2.0:1788574543.000197:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a7bb288000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3311:1875455747692288:0@lo:8:kworker.0 00000004:00080000:2.0:1788574543.000259:0:18911:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x280000400:0x22:0x0] 00000100:00100000:2.0:1788574543.000281:0:18911:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a7bb288380 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:18911:1875455747692928:0@lo:5:osp-pre-1-0.0 00000100:00100000:2.0:1788574543.000318:0:18911:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788574543.000359:0:18911:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a792777cc0 going to sleep for 11 seconds 00000004:00080000:2.0:1788574543.000425:0:18910:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:2.0:1788574543.001458:0:18910:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 669176087238ns, next at 0ns, rc = 0 00000100:00100000:2.0:1788574543.001516:0:19577:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747692928 00000100:00100000:2.0:1788574543.001529:0:19577:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747692928 00000100:00100000:2.0:1788574543.001607:0:19577:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788574543.001630:0:19577:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7bb28b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:18911:x1875455747692928:12345-0@lo:5:osp-pre-1-0.0 00000100:00100000:0.0:1788574543.002220:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a7bb28a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1875455747692160:0@lo:400:kworker.0 00000100:00100000:0.0:1788574543.002259:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a7bb288000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1875455747692800:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788574543.002342:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788574543.002396:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1788574543.002406:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a7bb28a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:64047b6f-0fa6-4004-9f51-bd636ae04daf:3313:1875455747692032:0@lo:400:kworker.0 00000100:00100000:0.0:1788574543.002438:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788574543.002467:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a7bb28bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3313:1875455747692672:0@lo:400:kworker.0 00000100:00100000:0.0:1788574543.002496:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788574543.002691:0:19580:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747692800 00000100:00100000:0.0:1788574543.002699:0:19580:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747692800 00000100:00100000:0.0:1788574543.002760:0:19580:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788574543.002769:0:19580:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6839d0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3313:x1875455747692800:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788574543.002812:0:19580:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3851419648 avail 3849322496 00000100:00100000:0.0:1788574543.002871:0:19580:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6839d0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3313:x1875455747692800:12345-0@lo:13:osp-pre-1-0.0 Request processed in 104us (530us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574543.002879:0:19580:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788574543.002920:0:18880:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747692032 00000100:00100000:0.0:1788574543.002924:0:18880:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747692032 00000100:00100000:0.0:1788574543.002953:0:18880:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1788574543.002960:0:18880:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a79f2d3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:64047b6f-0fa6-4004-9f51-bd636ae04daf+19:3313:x1875455747692032:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788574543.002992:0:18880:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a79f2d3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:64047b6f-0fa6-4004-9f51-bd636ae04daf+19:3313:x1875455747692032:12345-0@lo:400:kworker.0 Request processed in 32us (552us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574543.002999:0:18880:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1788574543.003029:0:18888:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747692544 00000100:00100000:0.0:1788574543.003033:0:18888:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747692544 00000100:00100000:0.0:1788574543.003059:0:18888:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747692416 00000100:00100000:0.0:1788574543.003062:0:18888:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747692416 00000100:00100000:0.0:1788574543.003073:0:18888:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747692672 00000100:00100000:0.0:1788574543.003076:0:18888:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747692672 00000100:00100000:0.0:1788574543.003090:0:18888:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1788574543.003097:0:18888:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7bb28aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1875455747692544:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788574543.003180:0:18888:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7bb28aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1875455747692544:12345-0@lo:400:kworker.0 Request processed in 81us (4424us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574543.003193:0:18888:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1788574543.003221:0:18888:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1788574543.003236:0:18888:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7bb289c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1875455747692416:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788574543.003304:0:18888:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7bb289c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1875455747692416:12345-0@lo:400:kworker.0 Request processed in 74us (4459us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574543.003310:0:18888:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1788574543.003339:0:18888:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1788574543.003357:0:18888:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6839d2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1875455747692672:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788574543.003436:0:18888:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6839d2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1875455747692672:12345-0@lo:400:kworker.0 Request processed in 89us (939us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574543.003442:0:18888:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00010000:00080000:0.0:1788574543.003485:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90a7bb289180 x1875455747692416/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788574558 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788574543.003510:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a7bb289180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3315:1875455747692416:0@lo:400:kworker.0 00010000:00080000:0.0:1788574543.003540:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90a7bb288e00 x1875455747692544/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788574558 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788574543.003556:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a7bb288e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3315:1875455747692544:0@lo:400:kworker.0 00000100:00100000:0.0:1788574543.003623:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a7bb28a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:64047b6f-0fa6-4004-9f51-bd636ae04daf:3313:1875455747692032:0@lo:400:kworker.0 00010000:00080000:0.0:1788574543.003650:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90a7bb28bb80 x1875455747692672/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788574558 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788574543.003660:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a7bb28bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3313:1875455747692672:0@lo:400:kworker.0 00010000:00080000:0.0:1788574543.003675:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90a7bb288000 x1875455747692800/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788574558 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788574543.003693:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a7bb288000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1875455747692800:0@lo:13:osp-pre-1-0.0 00000100:00080000:1.0:1788574543.006467:0:18882:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788574543.006478:0:18882:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788574543.006481:0:18882:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00080000:2.0:1788574543.031638:0:19577:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x280000400 00002000:00080000:2.0:1788574543.031668:0:19577:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 65 -> diff = -31 00002000:02000040:2.0:1788574543.031676:0:19577:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000400:35 to 0x280000400:65) 00002000:00010000:2.0:1788574543.062332:0:19577:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x41:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788574543.062349:0:19577:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a9b475ed/0x10531a153b5372e1 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x41:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574543.063472:0:19577:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x41:0x0].0x0 since=669s v=(0 0) 00010000:00010000:2.0:1788574543.063485:0:19577:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x41:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788574543.063494:0:19577:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a9b475ed/0x10531a153b5372e1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574543.063520:0:19577:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a9b475ed/0x10531a153b5372e1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574543.063533:0:19577:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a9b475ed/0x10531a153b5372e1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574543.063542:0:19577:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a9b475ed/0x10531a153b5372e1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574543.064000:0:19577:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1788574543.064879:0:19577:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x40:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788574543.064901:0:19577:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e8aa72a5/0x10531a153b5372e8 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x40:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574543.064921:0:19577:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x40:0x0].0x0 since=669s v=(0 0) 00010000:00010000:2.0:1788574543.064926:0:19577:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x40:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788574543.064932:0:19577:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e8aa72a5/0x10531a153b5372e8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574543.064958:0:19577:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e8aa72a5/0x10531a153b5372e8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574543.064967:0:19577:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e8aa72a5/0x10531a153b5372e8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574543.064974:0:19577:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e8aa72a5/0x10531a153b5372e8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574543.065184:0:18875:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788574543.065194:0:18875:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a9b475ed/0x10531a153b5372e1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574543.065211:0:18875:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a79e984000 already unused, calling callback (ffffffffc159f4f0) 00010000:00010000:3.0:1788574543.065217:0:18875:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a9b475ed/0x10531a153b5372e1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574543.065229:0:18875:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a9b475ed/0x10531a153b5372e1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574543.065257:0:18875:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a9b475ed/0x10531a153b5372e1 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574543.065265:0:18875:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a9b475ed/0x10531a153b5372e1 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574543.065291:0:18875:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788574543.065295:0:18875:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e8aa72a5/0x10531a153b5372e8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574543.065301:0:18875:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a79e984a00 already unused, calling callback (ffffffffc159f4f0) 00010000:00010000:3.0:1788574543.065304:0:18875:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e8aa72a5/0x10531a153b5372e8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574543.065312:0:18875:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e8aa72a5/0x10531a153b5372e8 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574543.065321:0:18875:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e8aa72a5/0x10531a153b5372e8 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574543.065335:0:18875:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788574543.065336:0:18875:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788574543.065338:0:18875:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788574543.065609:0:19577:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1788574543.065616:0:19577:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e8aa72a5/0x10531a153b5372e8 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788574543.066235:0:19577:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x3f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788574543.066242:0:19577:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000021fc8140/0x10531a153b5372ef lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574543.066254:0:19577:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3f:0x0].0x0 since=669s v=(0 0) 00010000:00010000:2.0:1788574543.066257:0:19577:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788574543.066263:0:19577:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000021fc8140/0x10531a153b5372ef lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574543.066275:0:19577:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000021fc8140/0x10531a153b5372ef lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574543.066298:0:19577:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000021fc8140/0x10531a153b5372ef lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574543.066306:0:19577:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000021fc8140/0x10531a153b5372ef lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574543.066324:0:19577:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1788574543.066871:0:19577:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x3e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788574543.066878:0:19577:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009720c0f7/0x10531a153b5372f6 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574543.066933:0:19577:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3e:0x0].0x0 since=669s v=(0 0) 00010000:00010000:2.0:1788574543.066937:0:19577:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788574543.066941:0:19577:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009720c0f7/0x10531a153b5372f6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574543.066956:0:19577:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009720c0f7/0x10531a153b5372f6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574543.066967:0:19577:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009720c0f7/0x10531a153b5372f6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574543.066978:0:19577:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009720c0f7/0x10531a153b5372f6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574543.067003:0:19577:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1788574543.067565:0:18875:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788574543.067575:0:18875:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000021fc8140/0x10531a153b5372ef lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574543.067585:0:18875:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a79e985e00 already unused, calling callback (ffffffffc159f4f0) 00010000:00010000:3.0:1788574543.067591:0:18875:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000021fc8140/0x10531a153b5372ef lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574543.067602:0:18875:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000021fc8140/0x10531a153b5372ef lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574543.067623:0:18875:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000021fc8140/0x10531a153b5372ef lrc: 1/0,0 mode: --/PW res: [0x280000400:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574543.067631:0:18875:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000021fc8140/0x10531a153b5372ef lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574543.067653:0:18875:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788574543.067657:0:18875:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009720c0f7/0x10531a153b5372f6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574543.067664:0:18875:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a79e984800 already unused, calling callback (ffffffffc159f4f0) 00010000:00010000:3.0:1788574543.067676:0:18875:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009720c0f7/0x10531a153b5372f6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574543.067684:0:18875:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009720c0f7/0x10531a153b5372f6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574543.067694:0:18875:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009720c0f7/0x10531a153b5372f6 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574543.067701:0:18875:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009720c0f7/0x10531a153b5372f6 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574543.067715:0:18875:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788574543.067717:0:18875:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788574543.067718:0:18875:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788574543.067816:0:18874:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788574543.068263:0:19577:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x3d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788574543.068269:0:19577:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000093697cfd/0x10531a153b5372fd lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574543.068280:0:19577:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3d:0x0].0x0 since=669s v=(0 0) 00010000:00010000:2.0:1788574543.068283:0:19577:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788574543.068288:0:19577:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000093697cfd/0x10531a153b5372fd lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574543.068301:0:19577:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000093697cfd/0x10531a153b5372fd lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574543.068309:0:19577:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000093697cfd/0x10531a153b5372fd lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574543.068317:0:19577:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000093697cfd/0x10531a153b5372fd lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574543.068785:0:19577:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1788574543.076427:0:19577:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x3c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788574543.076443:0:19577:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003fc7bd37/0x10531a153b537304 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574543.076465:0:19577:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3c:0x0].0x0 since=669s v=(0 0) 00010000:00010000:2.0:1788574543.076480:0:19577:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788574543.076489:0:19577:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003fc7bd37/0x10531a153b537304 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574543.077002:0:18875:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788574543.077014:0:18875:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000093697cfd/0x10531a153b5372fd lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574543.077025:0:18875:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a79e985600 already unused, calling callback (ffffffffc159f4f0) 00010000:00010000:3.0:1788574543.077031:0:18875:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000093697cfd/0x10531a153b5372fd lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574543.077046:0:18875:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000093697cfd/0x10531a153b5372fd lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574543.077070:0:18875:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000093697cfd/0x10531a153b5372fd lrc: 1/0,0 mode: --/PW res: [0x280000400:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574543.077088:0:18875:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000093697cfd/0x10531a153b5372fd lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574543.077113:0:18875:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788574543.077115:0:18875:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788574543.077117:0:18875:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788574543.077801:0:19577:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003fc7bd37/0x10531a153b537304 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574543.077819:0:19577:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003fc7bd37/0x10531a153b537304 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574543.077828:0:19577:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003fc7bd37/0x10531a153b537304 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574543.077854:0:19577:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788574543.077876:0:18874:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788574543.077894:0:18874:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003fc7bd37/0x10531a153b537304 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574543.077907:0:18874:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a780030200 already unused, calling callback (ffffffffc159f4f0) 00010000:00010000:2.0:1788574543.077916:0:18874:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003fc7bd37/0x10531a153b537304 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574543.077933:0:18874:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003fc7bd37/0x10531a153b537304 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574543.077959:0:18874:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003fc7bd37/0x10531a153b537304 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574543.077995:0:18874:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003fc7bd37/0x10531a153b537304 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574543.078038:0:18874:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788574543.078043:0:18874:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788574543.078047:0:18874:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788574543.083353:0:19577:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x3b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788574543.083401:0:19577:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000a512e90/0x10531a153b53730b lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574543.083439:0:19577:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3b:0x0].0x0 since=669s v=(0 0) 00010000:00010000:2.0:1788574543.083445:0:19577:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788574543.083452:0:19577:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000a512e90/0x10531a153b53730b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574543.083470:0:19577:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000a512e90/0x10531a153b53730b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574543.083482:0:19577:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000a512e90/0x10531a153b53730b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574543.083490:0:19577:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000a512e90/0x10531a153b53730b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574543.083525:0:19577:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1788574543.084152:0:19577:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x3a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788574543.084167:0:19577:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002444dcda/0x10531a153b537312 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574543.084178:0:19577:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3a:0x0].0x0 since=669s v=(0 0) 00010000:00010000:2.0:1788574543.084181:0:19577:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788574543.084185:0:19577:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002444dcda/0x10531a153b537312 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574543.084197:0:19577:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002444dcda/0x10531a153b537312 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574543.084206:0:19577:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002444dcda/0x10531a153b537312 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574543.084213:0:19577:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002444dcda/0x10531a153b537312 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574543.084239:0:19577:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1788574543.084262:0:18874:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788574543.084272:0:18874:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000a512e90/0x10531a153b53730b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574543.084279:0:18874:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a780031e00 already unused, calling callback (ffffffffc159f4f0) 00010000:00010000:2.0:1788574543.084284:0:18874:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000a512e90/0x10531a153b53730b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574543.084294:0:18874:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000a512e90/0x10531a153b53730b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574543.084322:0:18874:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000a512e90/0x10531a153b53730b lrc: 1/0,0 mode: --/PW res: [0x280000400:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574543.084331:0:18874:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000a512e90/0x10531a153b53730b lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574543.084357:0:18874:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788574543.084360:0:18874:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002444dcda/0x10531a153b537312 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574543.084391:0:18874:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a780031a00 already unused, calling callback (ffffffffc159f4f0) 00010000:00010000:2.0:1788574543.084395:0:18874:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002444dcda/0x10531a153b537312 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574543.084403:0:18874:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002444dcda/0x10531a153b537312 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574543.084413:0:18874:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002444dcda/0x10531a153b537312 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574543.084421:0:18874:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002444dcda/0x10531a153b537312 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574543.084433:0:18874:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788574543.084435:0:18874:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788574543.084443:0:18874:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788574543.084927:0:19577:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x39:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788574543.084934:0:19577:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000001856f10/0x10531a153b537319 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x39:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574543.084942:0:19577:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x39:0x0].0x0 since=669s v=(0 0) 00010000:00010000:2.0:1788574543.084946:0:19577:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x39:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788574543.084950:0:19577:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000001856f10/0x10531a153b537319 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574543.084965:0:19577:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000001856f10/0x10531a153b537319 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574543.084973:0:19577:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000001856f10/0x10531a153b537319 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574543.084980:0:19577:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000001856f10/0x10531a153b537319 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574543.084998:0:19577:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788574543.085007:0:18874:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788574543.085011:0:18874:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000001856f10/0x10531a153b537319 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574543.085017:0:18874:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a780031000 already unused, calling callback (ffffffffc159f4f0) 00010000:00010000:2.0:1788574543.085020:0:18874:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000001856f10/0x10531a153b537319 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574543.085040:0:18874:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000001856f10/0x10531a153b537319 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574543.085052:0:18874:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000001856f10/0x10531a153b537319 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574543.085058:0:18874:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000001856f10/0x10531a153b537319 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574543.085073:0:18874:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788574543.085075:0:18874:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788574543.085076:0:18874:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788574543.085633:0:19577:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x38:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788574543.085646:0:19577:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000077e65b7f/0x10531a153b537320 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x38:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574543.085660:0:19577:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x38:0x0].0x0 since=669s v=(0 0) 00010000:00010000:2.0:1788574543.085664:0:19577:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x38:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788574543.085668:0:19577:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000077e65b7f/0x10531a153b537320 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574543.085678:0:19577:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000077e65b7f/0x10531a153b537320 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574543.085686:0:19577:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000077e65b7f/0x10531a153b537320 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574543.085701:0:19577:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000077e65b7f/0x10531a153b537320 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574543.085718:0:19577:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788574543.085730:0:18874:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788574543.085734:0:18874:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000077e65b7f/0x10531a153b537320 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574543.085740:0:18874:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a780030400 already unused, calling callback (ffffffffc159f4f0) 00010000:00010000:2.0:1788574543.085744:0:18874:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000077e65b7f/0x10531a153b537320 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574543.085752:0:18874:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000077e65b7f/0x10531a153b537320 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574543.085765:0:18874:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000077e65b7f/0x10531a153b537320 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574543.085774:0:18874:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000077e65b7f/0x10531a153b537320 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574543.085789:0:18874:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788574543.085791:0:18874:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788574543.085792:0:18874:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788574543.088282:0:18875:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788574543.089675:0:19577:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x37:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788574543.089703:0:19577:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000524da75f/0x10531a153b537327 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x37:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574543.089729:0:19577:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x37:0x0].0x0 since=669s v=(0 0) 00010000:00010000:2.0:1788574543.089825:0:19577:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x37:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788574543.089836:0:19577:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000524da75f/0x10531a153b537327 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574543.089856:0:19577:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000524da75f/0x10531a153b537327 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574543.089869:0:19577:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000524da75f/0x10531a153b537327 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574543.089877:0:19577:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000524da75f/0x10531a153b537327 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574543.089919:0:19577:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788574543.095568:0:18874:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788574543.095588:0:18874:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000524da75f/0x10531a153b537327 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574543.095605:0:18874:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a780031400 already unused, calling callback (ffffffffc159f4f0) 00010000:00010000:3.0:1788574543.095612:0:18874:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000524da75f/0x10531a153b537327 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574543.095625:0:18874:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000524da75f/0x10531a153b537327 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574543.095657:0:18874:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000524da75f/0x10531a153b537327 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574543.095666:0:18874:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000524da75f/0x10531a153b537327 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574543.095701:0:18874:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788574543.095714:0:18874:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788574543.095716:0:18874:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788574543.096125:0:19577:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x36:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788574543.096135:0:19577:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000df420bb2/0x10531a153b53732e lrc: 3/0,1 mode: --/PW res: [0x280000400:0x36:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574543.096152:0:19577:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x36:0x0].0x0 since=669s v=(0 0) 00010000:00010000:2.0:1788574543.096156:0:19577:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x36:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788574543.096163:0:19577:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000df420bb2/0x10531a153b53732e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574543.096177:0:19577:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000df420bb2/0x10531a153b53732e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574543.096195:0:19577:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000df420bb2/0x10531a153b53732e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574543.096206:0:19577:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000df420bb2/0x10531a153b53732e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574543.096245:0:19577:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788574543.096522:0:18875:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788574543.096530:0:18875:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000df420bb2/0x10531a153b53732e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574543.096538:0:18875:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a780031600 already unused, calling callback (ffffffffc159f4f0) 00010000:00010000:3.0:1788574543.096542:0:18875:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000df420bb2/0x10531a153b53732e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574543.096551:0:18875:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000df420bb2/0x10531a153b53732e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574543.096564:0:18875:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000df420bb2/0x10531a153b53732e lrc: 1/0,0 mode: --/PW res: [0x280000400:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574543.096572:0:18875:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000df420bb2/0x10531a153b53732e lrc: 0/0,0 mode: --/PW res: [0x280000400:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574543.096593:0:18875:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788574543.096594:0:18875:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788574543.096596:0:18875:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788574543.104694:0:19577:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x35:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788574543.104728:0:19577:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e6151c0c/0x10531a153b537335 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x35:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574543.105900:0:19577:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x35:0x0].0x0 since=669s v=(0 0) 00010000:00010000:2.0:1788574543.105908:0:19577:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x35:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788574543.105920:0:19577:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e6151c0c/0x10531a153b537335 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574543.105945:0:19577:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e6151c0c/0x10531a153b537335 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574543.105959:0:19577:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e6151c0c/0x10531a153b537335 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574543.105969:0:19577:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e6151c0c/0x10531a153b537335 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574543.106022:0:19577:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788574543.106670:0:18874:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788574543.106680:0:18874:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e6151c0c/0x10531a153b537335 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574543.106690:0:18874:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a7a7ac9c00 already unused, calling callback (ffffffffc159f4f0) 00010000:00010000:3.0:1788574543.106696:0:18874:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e6151c0c/0x10531a153b537335 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574543.106729:0:18874:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e6151c0c/0x10531a153b537335 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574543.106756:0:18874:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e6151c0c/0x10531a153b537335 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574543.106765:0:18874:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e6151c0c/0x10531a153b537335 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574543.106794:0:18874:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788574543.106795:0:18874:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788574543.106798:0:18874:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788574543.112843:0:19577:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x34:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788574543.112868:0:19577:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000491a6d1c/0x10531a153b53733c lrc: 3/0,1 mode: --/PW res: [0x280000400:0x34:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574543.114019:0:19577:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x34:0x0].0x0 since=669s v=(0 0) 00010000:00010000:2.0:1788574543.114027:0:19577:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x34:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788574543.114652:0:19577:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000491a6d1c/0x10531a153b53733c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574543.114679:0:19577:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000491a6d1c/0x10531a153b53733c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574543.114694:0:19577:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000491a6d1c/0x10531a153b53733c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574543.114703:0:19577:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000491a6d1c/0x10531a153b53733c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574543.115142:0:19577:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788574543.115547:0:18875:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788574543.115557:0:18875:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000491a6d1c/0x10531a153b53733c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574543.115568:0:18875:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a7a7ac9200 already unused, calling callback (ffffffffc159f4f0) 00010000:00010000:3.0:1788574543.115574:0:18875:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000491a6d1c/0x10531a153b53733c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574543.115583:0:18875:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000491a6d1c/0x10531a153b53733c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574543.115606:0:18875:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000491a6d1c/0x10531a153b53733c lrc: 1/0,0 mode: --/PW res: [0x280000400:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574543.115631:0:18875:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000491a6d1c/0x10531a153b53733c lrc: 0/0,0 mode: --/PW res: [0x280000400:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574543.115664:0:18875:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788574543.115666:0:18875:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788574543.115668:0:18875:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788574543.118273:0:19577:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x33:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788574543.118292:0:19577:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000673f7eb/0x10531a153b537343 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x33:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574543.118316:0:19577:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x33:0x0].0x0 since=669s v=(0 0) 00010000:00010000:2.0:1788574543.118339:0:19577:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x33:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788574543.118350:0:19577:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000673f7eb/0x10531a153b537343 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574543.119634:0:19577:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000673f7eb/0x10531a153b537343 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574543.119664:0:19577:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000673f7eb/0x10531a153b537343 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574543.119674:0:19577:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000673f7eb/0x10531a153b537343 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574543.119697:0:19577:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788574543.120251:0:18874:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788574543.120260:0:18874:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000673f7eb/0x10531a153b537343 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574543.120271:0:18874:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a7a7ac9a00 already unused, calling callback (ffffffffc159f4f0) 00010000:00010000:2.0:1788574543.120277:0:18874:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000673f7eb/0x10531a153b537343 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574543.120288:0:18874:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000673f7eb/0x10531a153b537343 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574543.120318:0:18874:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000673f7eb/0x10531a153b537343 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574543.120343:0:18874:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000673f7eb/0x10531a153b537343 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574543.120407:0:18874:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788574543.120935:0:18874:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788574543.120938:0:18874:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788574543.121890:0:19577:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x32:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788574543.121903:0:19577:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000851c29ed/0x10531a153b53734a lrc: 3/0,1 mode: --/PW res: [0x280000400:0x32:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574543.121926:0:19577:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x32:0x0].0x0 since=669s v=(0 0) 00010000:00010000:2.0:1788574543.121933:0:19577:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x32:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788574543.121941:0:19577:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000851c29ed/0x10531a153b53734a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574543.121960:0:19577:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000851c29ed/0x10531a153b53734a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574543.121971:0:19577:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000851c29ed/0x10531a153b53734a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574543.121979:0:19577:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000851c29ed/0x10531a153b53734a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574543.122013:0:19577:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1788574543.122547:0:19577:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x31:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788574543.122560:0:19577:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006a10ace3/0x10531a153b537351 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x31:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574543.122570:0:19577:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x31:0x0].0x0 since=669s v=(0 0) 00010000:00010000:2.0:1788574543.122573:0:19577:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x31:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788574543.122577:0:19577:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006a10ace3/0x10531a153b537351 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574543.122587:0:19577:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006a10ace3/0x10531a153b537351 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574543.122596:0:19577:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006a10ace3/0x10531a153b537351 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574543.122604:0:19577:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006a10ace3/0x10531a153b537351 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574543.122622:0:19577:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1788574543.122644:0:18874:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788574543.122651:0:18874:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000851c29ed/0x10531a153b53734a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574543.122659:0:18874:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a7a7ac9e00 already unused, calling callback (ffffffffc159f4f0) 00010000:00010000:2.0:1788574543.122664:0:18874:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000851c29ed/0x10531a153b53734a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574543.122675:0:18874:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000851c29ed/0x10531a153b53734a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574543.122707:0:18874:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000851c29ed/0x10531a153b53734a lrc: 1/0,0 mode: --/PW res: [0x280000400:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574543.122715:0:18874:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000851c29ed/0x10531a153b53734a lrc: 0/0,0 mode: --/PW res: [0x280000400:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574543.122740:0:18874:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788574543.122743:0:18874:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006a10ace3/0x10531a153b537351 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574543.122751:0:18874:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a7a7ac9600 already unused, calling callback (ffffffffc159f4f0) 00010000:00010000:2.0:1788574543.122754:0:18874:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006a10ace3/0x10531a153b537351 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574543.122762:0:18874:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006a10ace3/0x10531a153b537351 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574543.122772:0:18874:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006a10ace3/0x10531a153b537351 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574543.122780:0:18874:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006a10ace3/0x10531a153b537351 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574543.122791:0:18874:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788574543.122793:0:18874:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788574543.122800:0:18874:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788574543.123614:0:18875:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788574543.136588:0:19577:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x30:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788574543.136613:0:19577:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008d0510fc/0x10531a153b537358 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x30:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574543.136637:0:19577:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x30:0x0].0x0 since=669s v=(0 0) 00010000:00010000:2.0:1788574543.136643:0:19577:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x30:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788574543.136651:0:19577:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008d0510fc/0x10531a153b537358 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574543.136669:0:19577:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008d0510fc/0x10531a153b537358 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574543.136687:0:19577:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008d0510fc/0x10531a153b537358 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574543.136697:0:19577:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008d0510fc/0x10531a153b537358 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574543.136725:0:19577:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788574543.138406:0:18874:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788574543.139249:0:18874:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008d0510fc/0x10531a153b537358 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574543.139266:0:18874:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a7a7ac8200 already unused, calling callback (ffffffffc159f4f0) 00010000:00010000:2.0:1788574543.139272:0:18874:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008d0510fc/0x10531a153b537358 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574543.139304:0:18874:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008d0510fc/0x10531a153b537358 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574543.139329:0:18874:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008d0510fc/0x10531a153b537358 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574543.139339:0:18874:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008d0510fc/0x10531a153b537358 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574543.139404:0:18874:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788574543.139415:0:18874:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788574543.139417:0:18874:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788574543.146202:0:19577:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x2f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788574543.146229:0:19577:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004b63eb09/0x10531a153b53735f lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574543.146258:0:19577:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2f:0x0].0x0 since=669s v=(0 0) 00010000:00010000:2.0:1788574543.146266:0:19577:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788574543.146278:0:19577:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004b63eb09/0x10531a153b53735f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574543.146298:0:19577:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004b63eb09/0x10531a153b53735f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574543.146311:0:19577:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004b63eb09/0x10531a153b53735f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574543.146329:0:19577:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004b63eb09/0x10531a153b53735f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574543.146361:0:19577:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788574543.147805:0:18875:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788574543.147817:0:18875:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004b63eb09/0x10531a153b53735f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574543.147835:0:18875:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a7a7ac9000 already unused, calling callback (ffffffffc159f4f0) 00010000:00010000:3.0:1788574543.147845:0:18875:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004b63eb09/0x10531a153b53735f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574543.147862:0:18875:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004b63eb09/0x10531a153b53735f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574543.147918:0:18875:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004b63eb09/0x10531a153b53735f lrc: 1/0,0 mode: --/PW res: [0x280000400:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574543.147934:0:18875:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004b63eb09/0x10531a153b53735f lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574543.147975:0:18875:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788574543.147978:0:18875:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788574543.148496:0:18875:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:0.0:1788574543.149807:0:5879:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00002000:00010000:2.0:1788574543.150931:0:19577:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x2e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788574543.150952:0:19577:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007814eab0/0x10531a153b537366 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574543.150979:0:19577:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2e:0x0].0x0 since=669s v=(0 0) 00010000:00010000:2.0:1788574543.150986:0:19577:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788574543.151013:0:19577:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007814eab0/0x10531a153b537366 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574543.152693:0:19577:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007814eab0/0x10531a153b537366 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574543.152715:0:19577:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007814eab0/0x10531a153b537366 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574543.152723:0:19577:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007814eab0/0x10531a153b537366 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574543.152745:0:19577:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788574543.152767:0:18874:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788574543.152773:0:18874:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007814eab0/0x10531a153b537366 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574543.152789:0:18874:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a7a7ac9400 already unused, calling callback (ffffffffc159f4f0) 00010000:00010000:2.0:1788574543.152794:0:18874:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007814eab0/0x10531a153b537366 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574543.152803:0:18874:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007814eab0/0x10531a153b537366 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574543.152822:0:18874:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007814eab0/0x10531a153b537366 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574543.152834:0:18874:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007814eab0/0x10531a153b537366 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574543.152876:0:18874:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788574543.152894:0:18874:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788574543.152899:0:18874:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788574543.153784:0:19577:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x2d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788574543.153793:0:19577:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ad2509c2/0x10531a153b53736d lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574543.153808:0:19577:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2d:0x0].0x0 since=669s v=(0 0) 00010000:00010000:2.0:1788574543.153812:0:19577:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788574543.153820:0:19577:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ad2509c2/0x10531a153b53736d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574543.153834:0:19577:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ad2509c2/0x10531a153b53736d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574543.153857:0:19577:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ad2509c2/0x10531a153b53736d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574543.153868:0:19577:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ad2509c2/0x10531a153b53736d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574543.158426:0:19577:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1788574543.160817:0:19577:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x2c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788574543.160830:0:19577:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005101e198/0x10531a153b537374 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574543.160849:0:19577:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2c:0x0].0x0 since=669s v=(0 0) 00010000:00010000:2.0:1788574543.160854:0:19577:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788574543.160861:0:19577:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005101e198/0x10531a153b537374 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574543.160876:0:19577:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005101e198/0x10531a153b537374 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574543.160899:0:19577:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005101e198/0x10531a153b537374 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574543.160908:0:19577:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005101e198/0x10531a153b537374 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574543.160948:0:19577:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1788574543.160968:0:18874:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788574543.160975:0:18874:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ad2509c2/0x10531a153b53736d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574543.160984:0:18874:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a7a7ac8400 already unused, calling callback (ffffffffc159f4f0) 00010000:00010000:3.0:1788574543.162221:0:18875:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788574543.163186:0:18874:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ad2509c2/0x10531a153b53736d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574543.163209:0:18874:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ad2509c2/0x10531a153b53736d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574543.163248:0:18874:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ad2509c2/0x10531a153b53736d lrc: 1/0,0 mode: --/PW res: [0x280000400:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574543.163264:0:18874:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ad2509c2/0x10531a153b53736d lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574543.163291:0:18874:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788574543.163294:0:18874:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788574543.163297:0:18874:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788574543.164769:0:20565:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788574543.164784:0:18875:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005101e198/0x10531a153b537374 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574543.164804:0:18875:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a7a7ac9800 already unused, calling callback (ffffffffc159f4f0) 00010000:00010000:2.0:1788574543.164829:0:18875:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005101e198/0x10531a153b537374 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574543.164848:0:18875:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005101e198/0x10531a153b537374 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574543.164894:0:18875:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005101e198/0x10531a153b537374 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574543.164909:0:18875:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005101e198/0x10531a153b537374 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574543.164947:0:18875:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788574543.164951:0:18875:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788574543.164955:0:18875:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788574543.164965:0:20565:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788574543.164969:0:20565:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788574543.168247:0:19577:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x2b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788574543.168265:0:19577:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000077db82e1/0x10531a153b53737b lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574543.168284:0:19577:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=669s v=(0 0) 00010000:00010000:3.0:1788574543.168288:0:19577:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788574543.168296:0:19577:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000077db82e1/0x10531a153b53737b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574543.168311:0:19577:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000077db82e1/0x10531a153b53737b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574543.168322:0:19577:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000077db82e1/0x10531a153b53737b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574543.168330:0:19577:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000077db82e1/0x10531a153b53737b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574543.168360:0:19577:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1788574543.168904:0:19577:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x2a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788574543.168911:0:19577:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006e81cbbd/0x10531a153b537382 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574543.168921:0:19577:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2a:0x0].0x0 since=669s v=(0 0) 00010000:00010000:3.0:1788574543.168925:0:19577:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788574543.168929:0:19577:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006e81cbbd/0x10531a153b537382 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574543.168949:0:19577:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006e81cbbd/0x10531a153b537382 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574543.168958:0:19577:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006e81cbbd/0x10531a153b537382 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574543.168965:0:19577:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006e81cbbd/0x10531a153b537382 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574543.169408:0:19577:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:3.0:1788574543.169899:0:19577:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x29:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788574543.169908:0:19577:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001f69996f/0x10531a153b537389 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x29:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574543.169920:0:19577:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x29:0x0].0x0 since=669s v=(0 0) 00010000:00010000:3.0:1788574543.169923:0:19577:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x29:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788574543.169929:0:19577:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001f69996f/0x10531a153b537389 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574543.169941:0:19577:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001f69996f/0x10531a153b537389 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574543.169950:0:19577:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001f69996f/0x10531a153b537389 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574543.169967:0:19577:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001f69996f/0x10531a153b537389 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574543.170791:0:18874:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1788574543.170804:0:18874:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000077db82e1/0x10531a153b53737b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574543.170815:0:18874:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a6824f9a00 already unused, calling callback (ffffffffc159f4f0) 00010000:00010000:0.0:1788574543.170820:0:18874:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000077db82e1/0x10531a153b53737b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574543.170830:0:18874:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000077db82e1/0x10531a153b53737b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574543.170853:0:18874:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000077db82e1/0x10531a153b53737b lrc: 1/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574543.170862:0:18874:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000077db82e1/0x10531a153b53737b lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574543.170966:0:18874:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788574543.170972:0:18874:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006e81cbbd/0x10531a153b537382 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574543.170978:0:18874:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a6824f8e00 already unused, calling callback (ffffffffc159f4f0) 00010000:00010000:1.0:1788574543.170981:0:18874:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006e81cbbd/0x10531a153b537382 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574543.170989:0:18874:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006e81cbbd/0x10531a153b537382 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574543.171001:0:18874:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006e81cbbd/0x10531a153b537382 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574543.171008:0:18874:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006e81cbbd/0x10531a153b537382 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574543.171021:0:18874:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788574543.171023:0:18874:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001f69996f/0x10531a153b537389 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574543.171037:0:18874:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a6824f8a00 already unused, calling callback (ffffffffc159f4f0) 00010000:00010000:1.0:1788574543.171039:0:18874:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001f69996f/0x10531a153b537389 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574543.171046:0:18874:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001f69996f/0x10531a153b537389 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574543.171069:0:18874:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001f69996f/0x10531a153b537389 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574543.171076:0:18874:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788574543.171078:0:18874:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788574543.171080:0:18874:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788574543.171228:0:19577:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1788574543.171235:0:19577:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001f69996f/0x10531a153b537389 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788574543.171829:0:19577:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x28:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788574543.171837:0:19577:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000041162d93/0x10531a153b537390 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x28:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574543.171850:0:19577:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x28:0x0].0x0 since=669s v=(0 0) 00010000:00010000:3.0:1788574543.171855:0:19577:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x28:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788574543.171862:0:19577:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000041162d93/0x10531a153b537390 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574543.171875:0:19577:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000041162d93/0x10531a153b537390 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574543.171895:0:19577:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000041162d93/0x10531a153b537390 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574543.171903:0:19577:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000041162d93/0x10531a153b537390 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574543.171928:0:19577:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1788574543.172684:0:19577:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x27:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788574543.172694:0:19577:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000db62b7b9/0x10531a153b537397 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x27:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574543.172712:0:19577:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x27:0x0].0x0 since=669s v=(0 0) 00010000:00010000:3.0:1788574543.172719:0:19577:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x27:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788574543.172728:0:19577:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000db62b7b9/0x10531a153b537397 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574543.172746:0:19577:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000db62b7b9/0x10531a153b537397 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574543.172760:0:19577:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000db62b7b9/0x10531a153b537397 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574543.172768:0:19577:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000db62b7b9/0x10531a153b537397 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574543.172779:0:19577:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1788574543.173786:0:20565:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788574543.173801:0:20565:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000041162d93/0x10531a153b537390 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574543.173812:0:20565:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a6824f9e00 already unused, calling callback (ffffffffc159f4f0) 00010000:00010000:0.0:1788574543.173818:0:20565:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000041162d93/0x10531a153b537390 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574543.173830:0:20565:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000041162d93/0x10531a153b537390 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574543.173876:0:20565:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000041162d93/0x10531a153b537390 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574543.173895:0:20565:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000041162d93/0x10531a153b537390 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574543.173925:0:20565:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788574543.173933:0:20565:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000db62b7b9/0x10531a153b537397 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574543.173946:0:20565:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a6824f9600 already unused, calling callback (ffffffffc159f4f0) 00010000:00010000:0.0:1788574543.173953:0:20565:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000db62b7b9/0x10531a153b537397 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574543.173968:0:20565:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000db62b7b9/0x10531a153b537397 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574543.173983:0:20565:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000db62b7b9/0x10531a153b537397 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574543.173991:0:20565:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000db62b7b9/0x10531a153b537397 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574543.174004:0:20565:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788574543.174006:0:20565:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788574543.174014:0:20565:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788574543.177423:0:18874:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788574543.179592:0:19577:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x26:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788574543.179610:0:19577:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d4b5ab9a/0x10531a153b53739e lrc: 3/0,1 mode: --/PW res: [0x280000400:0x26:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574543.179635:0:19577:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x26:0x0].0x0 since=669s v=(0 0) 00010000:00010000:3.0:1788574543.179649:0:19577:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x26:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788574543.179659:0:19577:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d4b5ab9a/0x10531a153b53739e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574543.179677:0:19577:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d4b5ab9a/0x10531a153b53739e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574543.179690:0:19577:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d4b5ab9a/0x10531a153b53739e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574543.179698:0:19577:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d4b5ab9a/0x10531a153b53739e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574543.179729:0:19577:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788574543.180224:0:18875:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788574543.180234:0:18875:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d4b5ab9a/0x10531a153b53739e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574543.180246:0:18875:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a6824f8200 already unused, calling callback (ffffffffc159f4f0) 00010000:00010000:2.0:1788574543.180256:0:18875:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d4b5ab9a/0x10531a153b53739e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574543.180275:0:18875:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d4b5ab9a/0x10531a153b53739e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574543.180313:0:18875:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d4b5ab9a/0x10531a153b53739e lrc: 1/0,0 mode: --/PW res: [0x280000400:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574543.180327:0:18875:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d4b5ab9a/0x10531a153b53739e lrc: 0/0,0 mode: --/PW res: [0x280000400:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574543.180364:0:18875:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788574543.180407:0:18875:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788574543.180410:0:18875:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788574543.180451:0:20565:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788574543.181017:0:19577:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x25:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788574543.181026:0:19577:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000039ff720d/0x10531a153b5373a5 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x25:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574543.181191:0:19577:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x25:0x0].0x0 since=669s v=(0 0) 00010000:00010000:3.0:1788574543.181198:0:19577:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x25:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788574543.181209:0:19577:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000039ff720d/0x10531a153b5373a5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574543.181231:0:19577:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000039ff720d/0x10531a153b5373a5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574543.181245:0:19577:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000039ff720d/0x10531a153b5373a5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574543.181273:0:19577:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000039ff720d/0x10531a153b5373a5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574543.181344:0:19577:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1788574543.181816:0:19577:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x24:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788574543.181822:0:19577:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000072596c7e/0x10531a153b5373ac lrc: 3/0,1 mode: --/PW res: [0x280000400:0x24:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574543.181830:0:19577:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x24:0x0].0x0 since=669s v=(0 0) 00010000:00010000:3.0:1788574543.181832:0:19577:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x24:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788574543.181836:0:19577:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000072596c7e/0x10531a153b5373ac lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574543.181845:0:19577:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000072596c7e/0x10531a153b5373ac lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574543.181852:0:19577:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000072596c7e/0x10531a153b5373ac lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574543.181859:0:19577:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000072596c7e/0x10531a153b5373ac lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574543.184170:0:18874:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788574543.184192:0:18874:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000039ff720d/0x10531a153b5373a5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574543.184213:0:18874:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a6824f9000 already unused, calling callback (ffffffffc159f4f0) 00010000:00010000:1.0:1788574543.184219:0:18874:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000039ff720d/0x10531a153b5373a5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574543.184233:0:18874:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000039ff720d/0x10531a153b5373a5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574543.184337:0:18874:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000039ff720d/0x10531a153b5373a5 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574543.184346:0:18874:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000039ff720d/0x10531a153b5373a5 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574543.184400:0:18874:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788574543.184405:0:18874:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000072596c7e/0x10531a153b5373ac lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574543.184424:0:18874:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a6824f9400 already unused, calling callback (ffffffffc159f4f0) 00010000:00010000:1.0:1788574543.184428:0:18874:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000072596c7e/0x10531a153b5373ac lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574543.184436:0:18874:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000072596c7e/0x10531a153b5373ac lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574543.184447:0:18874:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000072596c7e/0x10531a153b5373ac lrc: 2/0,0 mode: --/PW res: [0x280000400:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574543.184455:0:18874:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788574543.184457:0:18874:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788574543.184460:0:18874:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788574543.185617:0:19577:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1788574543.185635:0:19577:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000072596c7e/0x10531a153b5373ac lrc: 0/0,0 mode: --/PW res: [0x280000400:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574543.186191:0:18875:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788574543.187843:0:19577:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x23:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788574543.187859:0:19577:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000033d388a8/0x10531a153b5373b3 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x23:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574543.187896:0:19577:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x23:0x0].0x0 since=669s v=(0 0) 00010000:00010000:3.0:1788574543.187908:0:19577:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x23:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788574543.187921:0:19577:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000033d388a8/0x10531a153b5373b3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574543.187950:0:19577:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000033d388a8/0x10531a153b5373b3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574543.187963:0:19577:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000033d388a8/0x10531a153b5373b3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574543.187971:0:19577:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000033d388a8/0x10531a153b5373b3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574543.188116:0:19577:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00080000:3.0:1788574543.188484:0:19577:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0001: after destroy: set last_id to 0x280000400:34 00000100:00100000:3.0:1788574543.188608:0:19577:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7bb28b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:18911:x1875455747692928:12345-0@lo:5:osp-pre-1-0.0 Request processed in 186983us (188284us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574543.188619:0:19577:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788574543.188761:0:18911:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a7bb288380 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:18911:1875455747692928:0@lo:5:osp-pre-1-0.0 00000004:00080000:2.0:1788574543.188780:0:18911:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x280000400:0x41:0x0] from OST, last_created [0x280000400:0x41:0x0]last_used is [0x280000400:0x22:0x0] 00000100:00100000:2.0:1788574543.188843:0:18911:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a7bb288380 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:18911:1875455747693056:0@lo:5:osp-pre-1-0.0 00000100:00100000:2.0:1788574543.188900:0:18911:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788574543.188962:0:18911:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a7932213c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788574543.189041:0:19575:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747693056 00000100:00100000:1.0:1788574543.189051:0:19575:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747693056 00000100:00100000:1.0:1788574543.189123:0:19575:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788574543.189136:0:19575:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7bb288000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:18911:x1875455747693056:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:1.0:1788574543.189198:0:19575:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x280000400 at 66 00010000:00010000:0.0:1788574543.193611:0:20565:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788574543.193628:0:20565:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000033d388a8/0x10531a153b5373b3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574543.193644:0:20565:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a6824f8400 already unused, calling callback (ffffffffc159f4f0) 00010000:00010000:0.0:1788574543.193650:0:20565:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000033d388a8/0x10531a153b5373b3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574543.193662:0:20565:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000033d388a8/0x10531a153b5373b3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574543.193687:0:20565:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000033d388a8/0x10531a153b5373b3 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574543.194110:0:20565:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000033d388a8/0x10531a153b5373b3 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574543.194140:0:20565:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788574543.194143:0:20565:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788574543.194145:0:20565:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788574543.209624:0:19575:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7bb288000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:18911:x1875455747693056:12345-0@lo:5:osp-pre-1-0.0 Request processed in 20478us (20710us total) trans 12884901889 rc 0/0 00000100:00100000:1.0:1788574543.209643:0:19575:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788574543.211645:0:18911:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a7bb288380 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:18911:1875455747693056:0@lo:5:osp-pre-1-0.0 00000004:00080000:2.0:1788574543.211685:0:18911:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x280000400:0x41:0x0]-[0x280000400:0x61:0x0] 00000100:00100000:1.0:1788574543.492493:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a7a72baa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1875455747693184:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788574543.492588:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788574543.492768:0:19580:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747693184 00000100:00100000:0.0:1788574543.492781:0:19580:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747693184 00000100:00100000:0.0:1788574543.492867:0:19580:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788574543.492889:0:19580:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7a72bbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1875455747693184:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788574543.492936:0:19580:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788574543.492991:0:19580:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7a72bbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1875455747693184:12345-0@lo:13:osp-pre-0-0.0 Request processed in 104us (402us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574543.493011:0:19580:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788574543.493065:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a7a72baa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1875455747693184:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1788574543.751645:0:18874:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788574544.774913:0:18875:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1788574544.940819:0:20659:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg157-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:0.0:1788574545.795331:0:20565:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788574546.816707:0:18874:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788574547.856115:0:18875:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788574548.082547:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:1.0:1788574548.082596:0:18881:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727768064 00000100:00100000:1.0:1788574548.082612:0:18881:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727768064 00000100:00100000:1.0:1788574548.082729:0:18881:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 78 00000100:00100000:1.0:1788574548.082738:0:18881:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a79f2d3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0+-99:2352:x1875455727768064:12345-192.168.201.57@tcp:250:mount.lustre.0 00010000:00080000:1.0:1788574548.082770:0:18881:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from 757865b4-e3c9-47dd-8b09-5caeeb506113@192.168.201.57@tcp t0 exp 0000000000000000 cur 674 last 0 00000020:00000080:1.0:1788574548.082820:0:18881:0:(genops.c:1385:class_connect()) connect: client 757865b4-e3c9-47dd-8b09-5caeeb506113, cookie 0x10531a153b5373ba 00000100:00080000:1.0:1788574548.082990:0:18881:0:(import.c:65:import_set_state_nolock()) ffff90a7a6d50800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788574548.083074:0:18881:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a79f2d3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:757865b4-e3c9-47dd-8b09-5caeeb506113+5:2352:x1875455727768064:12345-192.168.201.57@tcp:250:mount.lustre.0 Request processed in 334us (537us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574548.083083:0:18881:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 78 00000100:00100000:0.0:1788574548.093938:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:1.0:1788574548.094461:0:18879:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727768192 00000100:00100000:1.0:1788574548.094474:0:18879:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727768192 00000100:00100000:1.0:1788574548.094534:0:18879:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 79 00000100:00100000:1.0:1788574548.094546:0:18879:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a79f2d1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:757865b4-e3c9-47dd-8b09-5caeeb506113+5:16726:x1875455727768192:12345-192.168.201.57@tcp:101:mount.lustre.0 00010000:00010000:1.0:1788574548.094567:0:18879:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788574548.094587:0:18879:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90a790a21a00/0x10531a153b5373c1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x1d2563b34cce3cf3 expref: -99 pid: 18879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574548.094624:0:18879:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90a790a21a00/0x10531a153b5373c1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce3cf3 expref: 6 pid: 18879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574548.094636:0:18879:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90a790a21a00/0x10531a153b5373c1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce3cf3 expref: 6 pid: 18879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574548.094647:0:18879:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a790a21a00, rc 0) 00000100:00100000:1.0:1788574548.094717:0:18879:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a79f2d1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:757865b4-e3c9-47dd-8b09-5caeeb506113+6:16726:x1875455727768192:12345-192.168.201.57@tcp:101:mount.lustre.0 Request processed in 172us (797us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574548.094751:0:18879:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 79 00000100:00100000:3.0:1788574548.096765:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a7bbebca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1875455747693312:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788574548.097068:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a7a72ba680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:64047b6f-0fa6-4004-9f51-bd636ae04daf:3312:1875455747693440:0@lo:400:kworker.0 00000100:00100000:1.0:1788574548.097158:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788574548.097216:0:18880:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747693440 00000100:00100000:0.0:1788574548.097229:0:18880:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747693440 00000100:00100000:1.0:1788574548.097234:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a7a7844e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3312:1875455747693952:0@lo:400:kworker.0 00000100:00100000:1.0:1788574548.097270:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788574548.097292:0:18880:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:1.0:1788574548.097305:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1788574548.097308:0:18880:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a79f2d2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:64047b6f-0fa6-4004-9f51-bd636ae04daf+19:3312:x1875455747693440:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788574548.097314:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a7a72b9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1875455747693568:0@lo:400:kworker.0 00000100:00100000:1.0:1788574548.097344:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788574548.097388:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a7a7846a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3312:1875455747694080:0@lo:400:kworker.0 00000100:00100000:1.0:1788574548.097415:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788574548.097460:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a7a72ba680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:64047b6f-0fa6-4004-9f51-bd636ae04daf:3312:1875455747693440:0@lo:400:kworker.0 00000100:00100000:3.0:1788574548.097467:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788574548.097513:0:18888:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747693952 00000100:00100000:1.0:1788574548.097517:0:18888:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747693952 00000100:00100000:3.0:1788574548.097527:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a7a7844a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3315:1875455747693824:0@lo:400:kworker.0 00000100:00100000:3.0:1788574548.097557:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788574548.097562:0:18888:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747694080 00000100:00100000:1.0:1788574548.097566:0:18888:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747694080 00000100:00100000:3.0:1788574548.097571:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788574548.097578:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a7a72baa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1875455747693696:0@lo:400:kworker.0 00000100:00100000:1.0:1788574548.097588:0:18888:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747693824 00000100:00100000:1.0:1788574548.097591:0:18888:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747693824 00000100:00100000:1.0:1788574548.097605:0:18888:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1788574548.097613:0:18888:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7a7847b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1875455747693952:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788574548.097744:0:18880:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a79f2d2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:64047b6f-0fa6-4004-9f51-bd636ae04daf+19:3312:x1875455747693440:12345-0@lo:400:kworker.0 Request processed in 439us (586us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574548.097753:0:18880:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:3.0:1788574548.097980:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788574548.098104:0:19577:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747693568 00000100:00100000:3.0:1788574548.098110:0:19577:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747693568 00000100:00100000:3.0:1788574548.098141:0:19577:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747693696 00000100:00100000:3.0:1788574548.098144:0:19577:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747693696 00000100:00100000:3.0:1788574548.098161:0:19577:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788574548.098169:0:19577:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7a7845880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3312:x1875455747693568:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788574548.098204:0:19577:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7a7845880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3312:x1875455747693568:12345-0@lo:400:kworker.0 Request processed in 36us (859us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574548.098211:0:19577:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788574548.098225:0:19577:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788574548.098232:0:19577:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7bbebe680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3315:x1875455747693696:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788574548.098268:0:19577:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7bbebe680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3315:x1875455747693696:12345-0@lo:400:kworker.0 Request processed in 37us (289us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574548.098274:0:19577:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788574548.099082:0:18886:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:1.0:1788574548.099100:0:18886:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00080000:1.0:1788574548.099138:0:18882:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788574548.099143:0:18882:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788574548.099147:0:18882:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788574548.099162:0:18887:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:1.0:1788574548.099178:0:18887:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1788574548.099191:0:18887:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7a7845c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1875455747694080:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788574548.099280:0:18887:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7a7845c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1875455747694080:12345-0@lo:400:kworker.0 Request processed in 92us (1863us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574548.099288:0:18887:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1788574548.099311:0:18887:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:1.0:1788574548.099319:0:18887:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1788574548.099327:0:18887:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7bbebdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1875455747693824:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788574548.099395:0:18887:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7bbebdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1875455747693824:12345-0@lo:400:kworker.0 Request processed in 41us (1808us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574548.099443:0:18887:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1788574548.100701:0:18888:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7a7847b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1875455747693952:12345-0@lo:400:kworker.0 Request processed in 3082us (3423us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574548.100714:0:18888:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00010000:00080000:1.0:1788574548.100849:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90a7a7844e00 x1875455747693952/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788574564 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788574548.100911:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a7a7844e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3312:1875455747693952:0@lo:400:kworker.0 00000100:00100000:1.0:1788574548.100965:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a7a72b9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1875455747693568:0@lo:400:kworker.0 00010000:00080000:1.0:1788574548.100985:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90a7a7846a00 x1875455747694080/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788574564 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788574548.101017:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a7a7846a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3312:1875455747694080:0@lo:400:kworker.0 00000100:00100000:3.0:1788574548.101663:0:19580:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747693312 00000100:00100000:3.0:1788574548.101675:0:19580:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747693312 00000100:00100000:3.0:1788574548.101737:0:19580:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788574548.101750:0:19580:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7bbebf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3315:x1875455747693312:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788574548.101789:0:19580:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3851419648 avail 3849322496 00000100:00100000:3.0:1788574548.102465:0:19580:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7bbebf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3315:x1875455747693312:12345-0@lo:13:osp-pre-1-0.0 Request processed in 564us (4846us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574548.102474:0:19580:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788574548.102555:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a7a72baa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1875455747693696:0@lo:400:kworker.0 00010000:00080000:3.0:1788574548.102574:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90a7a7844a80 x1875455747693824/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788574564 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788574548.102996:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a7a7844a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3315:1875455747693824:0@lo:400:kworker.0 00000100:00100000:3.0:1788574548.103023:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a7bbebca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1875455747693312:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788574548.107238:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:1.0:1788574548.110978:0:18879:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727768320 00000100:00100000:1.0:1788574548.111000:0:18879:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727768320 00000100:00100000:1.0:1788574548.111066:0:18879:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 81 00000100:00100000:1.0:1788574548.111079:0:18879:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7bbc70450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:757865b4-e3c9-47dd-8b09-5caeeb506113+6:16726:x1875455727768320:12345-192.168.201.57@tcp:501:mount.lustre.0 00000100:00100000:1.0:1788574548.111508:0:18879:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7bbc70450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:757865b4-e3c9-47dd-8b09-5caeeb506113+6:16726:x1875455727768320:12345-192.168.201.57@tcp:501:mount.lustre.0 Request processed in 430us (4286us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788574548.111525:0:18879:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 81 00000100:00100000:0.0:1788574548.125496:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:3.0:1788574548.126006:0:18881:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727768448 00000100:00100000:3.0:1788574548.126020:0:18881:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727768448 00000100:00100000:3.0:1788574548.126085:0:18881:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 82 00000100:00100000:3.0:1788574548.126111:0:18881:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7bbc72450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:757865b4-e3c9-47dd-8b09-5caeeb506113+6:16726:x1875455727768448:12345-192.168.201.57@tcp:101:mount.lustre.0 00010000:00010000:3.0:1788574548.126133:0:18881:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788574548.126154:0:18881:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90a6824f9400/0x10531a153b5373c8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x1d2563b34cce3cfa expref: -99 pid: 18881 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574548.126191:0:18881:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90a6824f9400/0x10531a153b5373c8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce3cfa expref: 7 pid: 18881 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574548.126205:0:18881:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90a6824f9400/0x10531a153b5373c8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce3cfa expref: 7 pid: 18881 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574548.126218:0:18881:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a6824f9400, rc 0) 00000100:00100000:3.0:1788574548.126293:0:18881:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7bbc72450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:757865b4-e3c9-47dd-8b09-5caeeb506113+7:16726:x1875455727768448:12345-192.168.201.57@tcp:101:mount.lustre.0 Request processed in 198us (807us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574548.126302:0:18881:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 82 00000100:00100000:3.0:1788574548.135187:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:1.0:1788574548.145172:0:18879:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727768576 00000100:00100000:1.0:1788574548.145191:0:18879:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727768576 00000100:00100000:0.0:1788574548.145291:0:18879:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 83 00000100:00100000:0.0:1788574548.145306:0:18879:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7a74f5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:757865b4-e3c9-47dd-8b09-5caeeb506113+7:16726:x1875455727768576:12345-192.168.201.57@tcp:501:mount.lustre.0 00000100:00100000:0.0:1788574548.145603:0:18879:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7a74f5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:757865b4-e3c9-47dd-8b09-5caeeb506113+8:16726:x1875455727768576:12345-192.168.201.57@tcp:501:mount.lustre.0 Request processed in 299us (10426us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574548.145610:0:18879:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 83 00000100:00100000:1.0:1788574548.150045:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:1.0:1788574548.150118:0:18881:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727768704 00000100:00100000:1.0:1788574548.150131:0:18881:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727768704 00000100:00100000:1.0:1788574548.150204:0:18881:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 84 00000100:00100000:1.0:1788574548.150216:0:18881:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7a74f7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:757865b4-e3c9-47dd-8b09-5caeeb506113+8:16726:x1875455727768704:12345-192.168.201.57@tcp:503:mount.lustre.0 00000100:00100000:1.0:1788574548.151442:0:18881:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7a74f7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:757865b4-e3c9-47dd-8b09-5caeeb506113+8:16726:x1875455727768704:12345-192.168.201.57@tcp:503:mount.lustre.0 Request processed in 1221us (1412us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574548.151454:0:18881:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 84 00000001:00080000:3.0:1788574548.162237:0:7676:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 12884901889 is committed 00000001:00100000:3.0:1788574548.162286:0:7676:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:0.0:1788574548.163652:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:1.0:1788574548.165136:0:18880:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727768832 00000100:00100000:1.0:1788574548.165156:0:18880:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727768832 00000100:00100000:1.0:1788574548.165244:0:18880:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 85 00000100:00100000:1.0:1788574548.165257:0:18880:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7a74f6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:757865b4-e3c9-47dd-8b09-5caeeb506113+8:16745:x1875455727768832:12345-192.168.201.57@tcp:502:llog_process_th.0 00000100:00100000:1.0:1788574548.166023:0:18880:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7a74f6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:757865b4-e3c9-47dd-8b09-5caeeb506113+8:16745:x1875455727768832:12345-192.168.201.57@tcp:502:llog_process_th.0 Request processed in 765us (2376us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574548.166056:0:18880:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 85 00000100:00100000:1.0:1788574548.216764:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:0.0:1788574548.217581:0:18879:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727768960 00000100:00100000:0.0:1788574548.217624:0:18879:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727768960 00000100:00100000:0.0:1788574548.217750:0:18879:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 86 00000100:00100000:0.0:1788574548.217763:0:18879:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7a74f7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:757865b4-e3c9-47dd-8b09-5caeeb506113+8:16745:x1875455727768960:12345-192.168.201.57@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788574548.222358:0:18879:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7a74f7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:757865b4-e3c9-47dd-8b09-5caeeb506113+8:16745:x1875455727768960:12345-192.168.201.57@tcp:502:llog_process_th.0 Request processed in 4567us (5573us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574548.222495:0:18879:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 86 00000100:00100000:0.0:1788574548.226635:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:3.0:1788574548.231258:0:18881:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727769088 00000100:00100000:3.0:1788574548.231279:0:18881:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727769088 00000100:00100000:2.0:1788574548.231964:0:18881:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 87 00000100:00100000:2.0:1788574548.231977:0:18881:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7a74f7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:757865b4-e3c9-47dd-8b09-5caeeb506113+8:16726:x1875455727769088:12345-192.168.201.57@tcp:101:mount.lustre.0 00010000:00010000:2.0:1788574548.231998:0:18881:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788574548.232039:0:18881:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90a7a7ac8c00/0x10531a153b5373cf lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x1d2563b34cce3d24 expref: -99 pid: 18881 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574548.232076:0:18881:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90a7a7ac8c00/0x10531a153b5373cf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce3d24 expref: 9 pid: 18881 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574548.232090:0:18881:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90a7a7ac8c00/0x10531a153b5373cf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce3d24 expref: 9 pid: 18881 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574548.232111:0:18881:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a7a7ac8c00, rc 0) 00000100:00100000:2.0:1788574548.232209:0:18881:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7a74f7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:757865b4-e3c9-47dd-8b09-5caeeb506113+9:16726:x1875455727769088:12345-192.168.201.57@tcp:101:mount.lustre.0 Request processed in 234us (5584us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574548.232217:0:18881:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 87 00000100:00100000:3.0:1788574548.247958:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:0.0:1788574548.248165:0:18879:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727769216 00000100:00100000:0.0:1788574548.248183:0:18879:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727769216 00000100:00100000:0.0:1788574548.248421:0:18879:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 88 00000100:00100000:0.0:1788574548.248435:0:18879:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7a74f4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:757865b4-e3c9-47dd-8b09-5caeeb506113+9:16726:x1875455727769216:12345-192.168.201.57@tcp:256:mount.lustre.0 20000000:01000000:0.0:1788574548.248479:0:18879:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:0.0:1788574548.248520:0:18879:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:0.0:1788574548.248525:0:18879:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:0.0:1788574548.248528:0:18879:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:0.0:1788574548.248547:0:18879:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 11 00000100:00100000:1.0:1788574548.265481:0:18879:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7a74f4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:757865b4-e3c9-47dd-8b09-5caeeb506113+9:16726:x1875455727769216:12345-192.168.201.57@tcp:256:mount.lustre.0 Request processed in 17023us (17517us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574548.265504:0:18879:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 88 00000100:00100000:2.0:1788574548.278955:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:1.0:1788574548.279194:0:18881:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727769344 00000100:00100000:1.0:1788574548.279209:0:18881:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727769344 00000100:00100000:1.0:1788574548.279294:0:18881:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 89 00000100:00100000:1.0:1788574548.279308:0:18881:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7a74f4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:757865b4-e3c9-47dd-8b09-5caeeb506113+9:16726:x1875455727769344:12345-192.168.201.57@tcp:101:mount.lustre.0 00010000:00010000:1.0:1788574548.279755:0:18881:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788574548.279782:0:18881:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90a790a21c00/0x10531a153b5373d6 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x1d2563b34cce3d2b expref: -99 pid: 18881 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574548.279831:0:18881:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90a790a21c00/0x10531a153b5373d6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce3d2b expref: 10 pid: 18881 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574548.279846:0:18881:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90a790a21c00/0x10531a153b5373d6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce3d2b expref: 10 pid: 18881 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574548.279858:0:18881:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a790a21c00, rc 0) 00000100:00100000:1.0:1788574548.280050:0:18881:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7a74f4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:757865b4-e3c9-47dd-8b09-5caeeb506113+10:16726:x1875455727769344:12345-192.168.201.57@tcp:101:mount.lustre.0 Request processed in 744us (1106us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574548.280059:0:18881:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 89 00000100:00100000:2.0:1788574548.291569:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:1.0:1788574548.291894:0:18879:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727769472 00000100:00100000:1.0:1788574548.291910:0:18879:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727769472 00000100:00100000:1.0:1788574548.292114:0:18879:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 90 00000100:00100000:1.0:1788574548.292129:0:18879:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7a74f4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:757865b4-e3c9-47dd-8b09-5caeeb506113+10:16726:x1875455727769472:12345-192.168.201.57@tcp:501:mount.lustre.0 00000100:00100000:1.0:1788574548.292608:0:18879:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7a74f4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:757865b4-e3c9-47dd-8b09-5caeeb506113+10:16726:x1875455727769472:12345-192.168.201.57@tcp:501:mount.lustre.0 Request processed in 483us (1054us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574548.292617:0:18879:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 90 00000100:00100000:2.0:1788574548.298574:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:1.0:1788574548.299098:0:18881:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727769600 00000100:00100000:1.0:1788574548.299119:0:18881:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727769600 00000100:00100000:1.0:1788574548.299283:0:18881:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 91 00000100:00100000:1.0:1788574548.299299:0:18881:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7a74f7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:757865b4-e3c9-47dd-8b09-5caeeb506113+10:16726:x1875455727769600:12345-192.168.201.57@tcp:503:mount.lustre.0 00000100:00100000:1.0:1788574548.300321:0:18881:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7a74f7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:757865b4-e3c9-47dd-8b09-5caeeb506113+10:16726:x1875455727769600:12345-192.168.201.57@tcp:503:mount.lustre.0 Request processed in 1016us (1759us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574548.300358:0:18881:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 91 00000100:00100000:2.0:1788574548.305481:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:0.0:1788574548.307454:0:18880:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727769728 00000100:00100000:0.0:1788574548.307474:0:18880:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727769728 00000100:00100000:0.0:1788574548.307552:0:18880:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 92 00000100:00100000:0.0:1788574548.307564:0:18880:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7a74f4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:757865b4-e3c9-47dd-8b09-5caeeb506113+10:16749:x1875455727769728:12345-192.168.201.57@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788574548.309074:0:18880:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7a74f4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:757865b4-e3c9-47dd-8b09-5caeeb506113+10:16749:x1875455727769728:12345-192.168.201.57@tcp:502:llog_process_th.0 Request processed in 399us (2499us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574548.309176:0:18880:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 92 00000100:00100000:2.0:1788574548.311831:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:0.0:1788574548.312078:0:18880:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727769856 00000100:00100000:0.0:1788574548.312218:0:18880:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727769856 00000100:00100000:0.0:1788574548.314755:0:18880:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 93 00000100:00100000:0.0:1788574548.314827:0:18880:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7a74f6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:757865b4-e3c9-47dd-8b09-5caeeb506113+10:16749:x1875455727769856:12345-192.168.201.57@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788574548.315251:0:18880:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7a74f6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:757865b4-e3c9-47dd-8b09-5caeeb506113+10:16749:x1875455727769856:12345-192.168.201.57@tcp:502:llog_process_th.0 Request processed in 466us (3435us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574548.317048:0:18880:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 93 00000100:00100000:2.0:1788574548.324652:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:1.0:1788574548.324819:0:18887:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727769984 00000100:00100000:1.0:1788574548.324834:0:18887:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727769984 00000100:00100000:1.0:1788574548.324894:0:18887:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 4 00000100:00100000:1.0:1788574548.324905:0:18887:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7bb28bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2352:x1875455727769984:12345-192.168.201.57@tcp:38:mount.lustre.0 00010000:00080000:1.0:1788574548.324950:0:18887:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from 0ef7cddc-b831-4237-948c-b4fc5b50b382@192.168.201.57@tcp t0 exp 0000000000000000 cur 674 last 0 00000020:00000080:1.0:1788574548.325014:0:18887:0:(genops.c:1385:class_connect()) connect: client 0ef7cddc-b831-4237-948c-b4fc5b50b382, cookie 0x10531a153b5373dd 00000004:00100000:1.0:1788574548.325056:0:18887:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000001:00000004:1.0:1788574548.325063:0:18887:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 3, last_transno is 12884901888 00000100:00080000:1.0:1788574548.382814:0:18887:0:(import.c:65:import_set_state_nolock()) ffff90a7a6d50000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788574548.383001:0:18887:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7bb28bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0ef7cddc-b831-4237-948c-b4fc5b50b382+6:2352:x1875455727769984:12345-192.168.201.57@tcp:38:mount.lustre.0 Request processed in 58095us (58366us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574548.383015:0:18887:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 4 00000100:00100000:2.0:1788574548.392906:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:1.0:1788574548.393219:0:18888:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727770240 00000100:00100000:1.0:1788574548.393236:0:18888:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727770240 00000100:00100000:1.0:1788574548.393410:0:18888:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 5 00000100:00100000:1.0:1788574548.393426:0:18888:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7bb28a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0ef7cddc-b831-4237-948c-b4fc5b50b382+6:16726:x1875455727770240:12345-192.168.201.57@tcp:41:mount.lustre.0 00000004:00000024:1.0:1788574548.393500:0:18888:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:1.0:1788574548.393639:0:18888:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7bb28a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0ef7cddc-b831-4237-948c-b4fc5b50b382+6:16726:x1875455727770240:12345-192.168.201.57@tcp:41:mount.lustre.0 Request processed in 216us (759us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574548.393648:0:18888:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 5 00000100:00080000:2.0:1788574548.394607:0:18882:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788574548.395314:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:3.0:1788574548.398000:0:18886:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727770112 00000100:00100000:3.0:1788574548.398020:0:18886:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727770112 00000100:00100000:3.0:1788574548.398102:0:18886:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 6 00000100:00100000:3.0:1788574548.398116:0:18886:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7bb288e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0ef7cddc-b831-4237-948c-b4fc5b50b382+6:0:x1875455727770112:12345-192.168.201.57@tcp:41:mount.lustre.0 00000004:00000024:3.0:1788574548.398160:0:18886:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:3.0:1788574548.398291:0:18886:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7bb288e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0ef7cddc-b831-4237-948c-b4fc5b50b382+6:0:x1875455727770112:12345-192.168.201.57@tcp:41:mount.lustre.0 Request processed in 178us (2984us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574548.398300:0:18886:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 6 00000100:00100000:1.0:1788574548.399577:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:1.0:1788574548.399713:0:18887:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727770368 00000100:00100000:1.0:1788574548.399725:0:18887:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727770368 00000100:00100000:1.0:1788574548.399801:0:18887:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 7 00000100:00100000:1.0:1788574548.400303:0:18887:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7a7846a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0ef7cddc-b831-4237-948c-b4fc5b50b382+6:16726:x1875455727770368:12345-192.168.201.57@tcp:40:mount.lustre.0 00000100:00100000:1.0:1788574548.400635:0:18887:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7a7846a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0ef7cddc-b831-4237-948c-b4fc5b50b382+6:16726:x1875455727770368:12345-192.168.201.57@tcp:40:mount.lustre.0 Request processed in 340us (1065us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574548.400645:0:18887:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 7 00000100:00100000:1.0:1788574548.408635:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:3.0:1788574548.409311:0:19577:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727770496 00000100:00100000:3.0:1788574548.409344:0:19577:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727770496 00000100:00100000:3.0:1788574548.409467:0:19577:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 10 00000100:00100000:3.0:1788574548.409485:0:19577:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7a7844e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2352:x1875455727770496:12345-192.168.201.57@tcp:8:mount.lustre.0 00010000:00080000:3.0:1788574548.409542:0:19577:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from 0ef7cddc-b831-4237-948c-b4fc5b50b382@192.168.201.57@tcp t0 exp 0000000000000000 cur 674 last 0 00000020:00000080:3.0:1788574548.409592:0:19577:0:(genops.c:1385:class_connect()) connect: client 0ef7cddc-b831-4237-948c-b4fc5b50b382, cookie 0x10531a153b5373e4 00002000:00100000:3.0:1788574548.409613:0:19577:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 0ef7cddc-b831-4237-948c-b4fc5b50b382/ffff90a6812f1800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a03 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1788574548.409669:0:19577:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:3.0:1788574548.410154:0:19577:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1788574548.410220:0:19577:0:(import.c:65:import_set_state_nolock()) ffff90a6812f4000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788574548.410928:0:19577:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7a7844e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0ef7cddc-b831-4237-948c-b4fc5b50b382+6:2352:x1875455727770496:12345-192.168.201.57@tcp:8:mount.lustre.0 Request processed in 1439us (2308us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574548.410943:0:19577:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 10 00000100:00100000:2.0:1788574548.420923:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:2.0:1788574548.421053:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:3.0:1788574548.421194:0:19576:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727770624 00000100:00100000:3.0:1788574548.421295:0:19576:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727770624 00000100:00100000:0.0:1788574548.421296:0:18889:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727770752 00000100:00100000:0.0:1788574548.421301:0:18889:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727770752 00000100:00100000:0.0:1788574548.421363:0:18889:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 0 00000100:00100000:3.0:1788574548.421391:0:19576:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 11 00000100:00100000:0.0:1788574548.421402:0:18889:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7bb28a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0ef7cddc-b831-4237-948c-b4fc5b50b382+6:16726:x1875455727770752:12345-192.168.201.57@tcp:33:mount.lustre.0 00000100:00100000:3.0:1788574548.421403:0:19576:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7bb289180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2352:x1875455727770624:12345-192.168.201.57@tcp:8:mount.lustre.0 00010000:00080000:3.0:1788574548.421458:0:19576:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from 0ef7cddc-b831-4237-948c-b4fc5b50b382@192.168.201.57@tcp t0 exp 0000000000000000 cur 674 last 0 00000020:00000080:3.0:1788574548.421510:0:19576:0:(genops.c:1385:class_connect()) connect: client 0ef7cddc-b831-4237-948c-b4fc5b50b382, cookie 0x10531a153b5373eb 00002000:00100000:3.0:1788574548.421526:0:19576:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 0ef7cddc-b831-4237-948c-b4fc5b50b382/ffff90a6812f7000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a03 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1788574548.421542:0:19576:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:3.0:1788574548.421958:0:19576:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1788574548.422003:0:19576:0:(import.c:65:import_set_state_nolock()) ffff90a6812f0800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788574548.422093:0:19576:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7bb289180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0ef7cddc-b831-4237-948c-b4fc5b50b382+6:2352:x1875455727770624:12345-192.168.201.57@tcp:8:mount.lustre.0 Request processed in 691us (1184us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574548.422104:0:19576:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 11 00000004:00080000:2.0:1788574548.425493:0:18889:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 3988us 00000004:00200000:2.0:1788574548.436665:0:18889:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000100:00100000:2.0:1788574548.436861:0:18889:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7bb28a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0ef7cddc-b831-4237-948c-b4fc5b50b382+6:16726:x1875455727770752:12345-192.168.201.57@tcp:33:mount.lustre.0 Request processed in 15451us (15794us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574548.436895:0:18889:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 0 00000100:00100000:3.0:1788574548.609746:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a7a7844000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1875455747694208:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788574548.609885:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788574548.610121:0:19580:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747694208 00000100:00100000:0.0:1788574548.610133:0:19580:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747694208 00000100:00100000:0.0:1788574548.610200:0:19580:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788574548.610211:0:19580:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7bbebca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1875455747694208:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788574548.610241:0:19580:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788574548.610297:0:19580:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7bbebca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1875455747694208:12345-0@lo:13:osp-pre-0-0.0 Request processed in 87us (411us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574548.610305:0:19580:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788574548.610472:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a7a7844000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1875455747694208:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788574548.699043:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:3.0:1788574548.699183:0:18886:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727770880 00000100:00100000:3.0:1788574548.699196:0:18886:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727770880 00000100:00100000:3.0:1788574548.699274:0:18886:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 8 00000100:00100000:3.0:1788574548.699285:0:18886:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a79b051180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0ef7cddc-b831-4237-948c-b4fc5b50b382+6:16770:x1875455727770880:12345-192.168.201.57@tcp:101:mkdir.0 00010000:00010000:3.0:1788574548.699309:0:18886:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788574548.699347:0:18886:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a6824f8a00/0x10531a153b5373f2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1d2563b34cce3d55 expref: -99 pid: 18886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574548.699484:0:18886:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a6824f9800/0x10531a153b5373f9 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 18886 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574548.699512:0:18886:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a6824f9800/0x10531a153b5373f9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 18886 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574548.699548:0:18886:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a6824f9800/0x10531a153b5373f9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18886 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788574548.699775:0:18886:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:3.0:1788574548.699780:0:18886:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1788574548.699834:0:18886:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90a6824f9800/0x10531a153b5373f9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18886 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574548.699870:0:18886:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a6824f8a00/0x10531a153b5373f2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce3d55 expref: 8 pid: 18886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574548.699898:0:18886:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90a6824f9800/0x10531a153b5373f9 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce3d55 expref: 7 pid: 18886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574548.699911:0:18886:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90a79b397300) 00010000:00010000:3.0:1788574548.699913:0:18886:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788574548.699919:0:18886:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a6824f9800, rc 0) 00000100:00100000:3.0:1788574548.700982:0:18886:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a79b051180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0ef7cddc-b831-4237-948c-b4fc5b50b382+7:16770:x1875455727770880:12345-192.168.201.57@tcp:101:mkdir.0 Request processed in 1690us (1942us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574548.700994:0:18886:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 8 00010000:00010000:0.0:1788574548.865553:0:20565:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788574549.888680:0:18874:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1788574550.337461:0:18921:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000001:00100000:2.0:1788574550.727026:0:6739:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 0ef7cddc-b831-4237-948c-b4fc5b50b382 00010000:00010000:2.0:1788574550.912676:0:18875:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788574551.412627:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:1.0:1788574551.412777:0:20773:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727771008 00000100:00100000:1.0:1788574551.412789:0:20773:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727771008 00000100:00100000:1.0:1788574551.412877:0:20773:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 9 00000100:00100000:1.0:1788574551.412890:0:20773:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7bbebf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0ef7cddc-b831-4237-948c-b4fc5b50b382+7:16823:x1875455727771008:12345-192.168.201.57@tcp:41:lfs.0 00000004:00000024:1.0:1788574551.412946:0:20773:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:1.0:1788574551.413068:0:20773:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7bbebf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0ef7cddc-b831-4237-948c-b4fc5b50b382+7:16823:x1875455727771008:12345-192.168.201.57@tcp:41:lfs.0 Request processed in 172us (449us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574551.413076:0:20773:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 9 00000100:00080000:2.0:1788574551.413215:0:18882:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788574551.419781:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:0.0:1788574551.421068:0:19580:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727771136 00000100:00100000:0.0:1788574551.421090:0:19580:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727771136 00000100:00080000:2.0:1788574551.421198:0:18882:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788574551.421212:0:19580:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 8 00000100:00100000:0.0:1788574551.421228:0:19580:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7a7847800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:0ef7cddc-b831-4237-948c-b4fc5b50b382+5:16823:x1875455727771136:12345-192.168.201.57@tcp:13:lfs.0 00002000:00000024:0.0:1788574551.421279:0:19580:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788574551.421405:0:19580:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7a7847800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:0ef7cddc-b831-4237-948c-b4fc5b50b382+5:16823:x1875455727771136:12345-192.168.201.57@tcp:13:lfs.0 Request processed in 181us (1638us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574551.421415:0:19580:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 8 00000100:00100000:0.0:1788574551.424766:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:3.0:1788574551.425030:0:19579:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727771264 00000100:00100000:3.0:1788574551.425043:0:19579:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727771264 00000100:00100000:3.0:1788574551.425176:0:19579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 9 00000100:00100000:3.0:1788574551.425187:0:19579:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6839d1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:0ef7cddc-b831-4237-948c-b4fc5b50b382+6:16823:x1875455727771264:12345-192.168.201.57@tcp:13:lfs.0 00002000:00000024:3.0:1788574551.425228:0:19579:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3851419648 avail 3849322496 00000100:00100000:3.0:1788574551.425339:0:19579:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6839d1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:0ef7cddc-b831-4237-948c-b4fc5b50b382+6:16823:x1875455727771264:12345-192.168.201.57@tcp:13:lfs.0 Request processed in 153us (598us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574551.425346:0:19579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 9 00000100:00080000:2.0:1788574551.425532:0:18882:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788574551.838204:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:1.0:1788574551.838717:0:18879:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727771392 00000100:00100000:1.0:1788574551.838741:0:18879:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727771392 00000100:00100000:1.0:1788574551.838803:0:18879:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 94 00000100:00100000:1.0:1788574551.838815:0:18879:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7a74f5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:757865b4-e3c9-47dd-8b09-5caeeb506113+10:16854:x1875455727771392:12345-192.168.201.57@tcp:101:mount.lustre.0 00010000:00010000:1.0:1788574551.838838:0:18879:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788574551.838867:0:18879:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90a790a20c00/0x10531a153b537400 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x1d2563b34cce3d5c expref: -99 pid: 18879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574551.838910:0:18879:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90a790a20c00/0x10531a153b537400 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce3d5c expref: 11 pid: 18879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574551.838926:0:18879:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90a790a20c00/0x10531a153b537400 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce3d5c expref: 11 pid: 18879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574551.838959:0:18879:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a790a20c00, rc 0) 00000100:00100000:1.0:1788574551.839055:0:18879:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7a74f5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:757865b4-e3c9-47dd-8b09-5caeeb506113+11:16854:x1875455727771392:12345-192.168.201.57@tcp:101:mount.lustre.0 Request processed in 241us (867us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574551.839063:0:18879:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 94 00000100:00100000:1.0:1788574551.891411:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:0.0:1788574551.891663:0:18880:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727771520 00000100:00100000:0.0:1788574551.891697:0:18880:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727771520 00000100:00100000:0.0:1788574551.891786:0:18880:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 95 00000100:00100000:0.0:1788574551.891798:0:18880:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7a74f6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:757865b4-e3c9-47dd-8b09-5caeeb506113+11:16854:x1875455727771520:12345-192.168.201.57@tcp:501:mount.lustre.0 00000100:00100000:0.0:1788574551.892417:0:18880:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7a74f6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:757865b4-e3c9-47dd-8b09-5caeeb506113+11:16854:x1875455727771520:12345-192.168.201.57@tcp:501:mount.lustre.0 Request processed in 619us (1020us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574551.892427:0:18880:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 95 00000100:00100000:0.0:1788574551.909138:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:1.0:1788574551.909921:0:18881:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727771648 00000100:00100000:1.0:1788574551.909937:0:18881:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727771648 00000100:00100000:1.0:1788574551.910041:0:18881:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 96 00000100:00100000:1.0:1788574551.910054:0:18881:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7a74f5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:757865b4-e3c9-47dd-8b09-5caeeb506113+11:16854:x1875455727771648:12345-192.168.201.57@tcp:503:mount.lustre.0 00000100:00100000:1.0:1788574551.910929:0:18881:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7a74f5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:757865b4-e3c9-47dd-8b09-5caeeb506113+11:16854:x1875455727771648:12345-192.168.201.57@tcp:503:mount.lustre.0 Request processed in 874us (1802us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574551.910940:0:18881:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 96 00010000:00010000:0.0:1788574551.936659:0:20565:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788574551.941874:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:1.0:1788574551.952875:0:18879:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727771776 00000100:00100000:1.0:1788574551.952900:0:18879:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727771776 00000100:00100000:1.0:1788574551.952976:0:18879:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 97 00000100:00100000:1.0:1788574551.952988:0:18879:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7a74f6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:757865b4-e3c9-47dd-8b09-5caeeb506113+11:16862:x1875455727771776:12345-192.168.201.57@tcp:502:llog_process_th.0 00000100:00100000:1.0:1788574551.953634:0:18879:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7a74f6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:757865b4-e3c9-47dd-8b09-5caeeb506113+11:16862:x1875455727771776:12345-192.168.201.57@tcp:502:llog_process_th.0 Request processed in 646us (11773us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574551.953643:0:18879:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 97 00000100:00100000:0.0:1788574552.006522:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:1.0:1788574552.006699:0:18881:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727771904 00000100:00100000:1.0:1788574552.006718:0:18881:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727771904 00000100:00100000:1.0:1788574552.006897:0:18881:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 98 00000100:00100000:1.0:1788574552.006914:0:18881:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a796615850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:757865b4-e3c9-47dd-8b09-5caeeb506113+11:16862:x1875455727771904:12345-192.168.201.57@tcp:502:llog_process_th.0 00000100:00100000:1.0:1788574552.007564:0:18881:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a796615850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:757865b4-e3c9-47dd-8b09-5caeeb506113+11:16862:x1875455727771904:12345-192.168.201.57@tcp:502:llog_process_th.0 Request processed in 652us (1060us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574552.007582:0:18881:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 98 00000100:00100000:2.0:1788574552.032123:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:0.0:1788574552.032245:0:18880:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727772032 00000100:00100000:0.0:1788574552.032312:0:18880:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727772032 00000100:00100000:0.0:1788574552.032413:0:18880:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 99 00000100:00100000:0.0:1788574552.032425:0:18880:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a796616c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:757865b4-e3c9-47dd-8b09-5caeeb506113+11:16854:x1875455727772032:12345-192.168.201.57@tcp:101:mount.lustre.0 00010000:00010000:0.0:1788574552.032444:0:18880:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788574552.032475:0:18880:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90a68116ba00/0x10531a153b537407 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x1d2563b34cce3d86 expref: -99 pid: 18880 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574552.032507:0:18880:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90a68116ba00/0x10531a153b537407 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce3d86 expref: 12 pid: 18880 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574552.032519:0:18880:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90a68116ba00/0x10531a153b537407 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce3d86 expref: 12 pid: 18880 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574552.032529:0:18880:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a68116ba00, rc 0) 00000100:00100000:0.0:1788574552.032581:0:18880:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a796616c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:757865b4-e3c9-47dd-8b09-5caeeb506113+12:16854:x1875455727772032:12345-192.168.201.57@tcp:101:mount.lustre.0 Request processed in 158us (470us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574552.032588:0:18880:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 99 00000100:00100000:2.0:1788574552.042795:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:1.0:1788574552.043756:0:18881:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727772160 00000100:00100000:1.0:1788574552.043774:0:18881:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727772160 00000100:00100000:1.0:1788574552.043879:0:18881:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 100 00000100:00100000:1.0:1788574552.043892:0:18881:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a785535050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:757865b4-e3c9-47dd-8b09-5caeeb506113+12:16854:x1875455727772160:12345-192.168.201.57@tcp:256:mount.lustre.0 20000000:01000000:1.0:1788574552.043936:0:18881:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:1.0:1788574552.043979:0:18881:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:1.0:1788574552.043984:0:18881:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:1.0:1788574552.043987:0:18881:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:1.0:1788574552.043991:0:18881:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 11 00000100:00100000:2.0:1788574552.049426:0:18881:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a785535050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:757865b4-e3c9-47dd-8b09-5caeeb506113+12:16854:x1875455727772160:12345-192.168.201.57@tcp:256:mount.lustre.0 Request processed in 5524us (6629us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574552.049445:0:18881:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 100 00000100:00100000:2.0:1788574552.052560:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:3.0:1788574552.052721:0:18879:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727772288 00000100:00100000:3.0:1788574552.052742:0:18879:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727772288 00000100:00100000:3.0:1788574552.052812:0:18879:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 101 00000100:00100000:3.0:1788574552.052824:0:18879:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a785537c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:757865b4-e3c9-47dd-8b09-5caeeb506113+12:16854:x1875455727772288:12345-192.168.201.57@tcp:101:mount.lustre.0 00010000:00010000:3.0:1788574552.052844:0:18879:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788574552.052869:0:18879:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90a6824f8a00/0x10531a153b53740e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x1d2563b34cce3d8d expref: -99 pid: 18879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574552.052909:0:18879:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90a6824f8a00/0x10531a153b53740e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce3d8d expref: 13 pid: 18879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574552.052923:0:18879:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90a6824f8a00/0x10531a153b53740e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce3d8d expref: 13 pid: 18879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574552.052934:0:18879:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a6824f8a00, rc 0) 00000100:00100000:3.0:1788574552.053022:0:18879:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a785537c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:757865b4-e3c9-47dd-8b09-5caeeb506113+13:16854:x1875455727772288:12345-192.168.201.57@tcp:101:mount.lustre.0 Request processed in 199us (475us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574552.053030:0:18879:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 101 00000100:00100000:3.0:1788574552.055597:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:2.0:1788574552.055683:0:18881:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727772416 00000100:00100000:2.0:1788574552.055693:0:18881:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727772416 00000100:00100000:2.0:1788574552.055795:0:18881:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 102 00000100:00100000:2.0:1788574552.055805:0:18881:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a785535450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:757865b4-e3c9-47dd-8b09-5caeeb506113+13:16854:x1875455727772416:12345-192.168.201.57@tcp:501:mount.lustre.0 00000100:00100000:2.0:1788574552.056122:0:18881:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a785535450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:757865b4-e3c9-47dd-8b09-5caeeb506113+13:16854:x1875455727772416:12345-192.168.201.57@tcp:501:mount.lustre.0 Request processed in 317us (534us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574552.056130:0:18881:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 102 00000100:00100000:1.0:1788574552.066391:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:0.0:1788574552.076487:0:18880:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727772544 00000100:00100000:0.0:1788574552.076510:0:18880:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727772544 00000100:00100000:0.0:1788574552.076621:0:18880:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 103 00000100:00100000:0.0:1788574552.076634:0:18880:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a785536c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:757865b4-e3c9-47dd-8b09-5caeeb506113+13:16854:x1875455727772544:12345-192.168.201.57@tcp:503:mount.lustre.0 00000100:00100000:0.0:1788574552.076907:0:18880:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a785536c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:757865b4-e3c9-47dd-8b09-5caeeb506113+13:16854:x1875455727772544:12345-192.168.201.57@tcp:503:mount.lustre.0 Request processed in 275us (10555us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574552.076915:0:18880:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 103 00000100:00100000:0.0:1788574552.081209:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:2.0:1788574552.082336:0:18881:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727772672 00000100:00100000:2.0:1788574552.082354:0:18881:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727772672 00000100:00100000:2.0:1788574552.082705:0:18881:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 104 00000100:00100000:2.0:1788574552.082720:0:18881:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a785536450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:757865b4-e3c9-47dd-8b09-5caeeb506113+13:16867:x1875455727772672:12345-192.168.201.57@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788574552.083022:0:18881:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a785536450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:757865b4-e3c9-47dd-8b09-5caeeb506113+13:16867:x1875455727772672:12345-192.168.201.57@tcp:502:llog_process_th.0 Request processed in 305us (1825us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574552.083040:0:18881:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 104 00000100:00100000:2.0:1788574552.088586:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:3.0:1788574552.089093:0:18879:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727772800 00000100:00100000:3.0:1788574552.089109:0:18879:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727772800 00000100:00100000:3.0:1788574552.089174:0:18879:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 105 00000100:00100000:3.0:1788574552.089186:0:18879:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a785534050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:757865b4-e3c9-47dd-8b09-5caeeb506113+13:16867:x1875455727772800:12345-192.168.201.57@tcp:502:llog_process_th.0 00000100:00100000:3.0:1788574552.089581:0:18879:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a785534050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:757865b4-e3c9-47dd-8b09-5caeeb506113+13:16867:x1875455727772800:12345-192.168.201.57@tcp:502:llog_process_th.0 Request processed in 396us (1005us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574552.089589:0:18879:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 105 00000100:00100000:3.0:1788574552.113586:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:3.0:1788574552.113640:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:3.0:1788574552.113665:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:3.0:1788574552.113697:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:3.0:1788574552.113762:0:19576:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727773440 00000100:00100000:3.0:1788574552.113774:0:19576:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727773440 00000100:00100000:3.0:1788574552.113831:0:19576:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727773568 00000100:00100000:3.0:1788574552.113835:0:19576:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727773568 00000100:00100000:3.0:1788574552.113856:0:19576:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 6 00000100:00100000:3.0:1788574552.113866:0:19576:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7bbebdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0ef7cddc-b831-4237-948c-b4fc5b50b382+5:2353:x1875455727773440:12345-192.168.201.57@tcp:400:kworker.0 00000100:00100000:3.0:1788574552.113962:0:19576:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7bbebdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0ef7cddc-b831-4237-948c-b4fc5b50b382+5:2353:x1875455727773440:12345-192.168.201.57@tcp:400:kworker.0 Request processed in 97us (320us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574552.113970:0:19576:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 6 00000100:00100000:3.0:1788574552.113990:0:19576:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 7 00000100:00100000:3.0:1788574552.113997:0:19576:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7bbebed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0ef7cddc-b831-4237-948c-b4fc5b50b382+6:2353:x1875455727773568:12345-192.168.201.57@tcp:400:kworker.0 00000100:00100000:3.0:1788574552.114034:0:19576:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7bbebed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0ef7cddc-b831-4237-948c-b4fc5b50b382+6:2353:x1875455727773568:12345-192.168.201.57@tcp:400:kworker.0 Request processed in 37us (336us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574552.114040:0:19576:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 7 00000100:00100000:2.0:1788574552.114706:0:18886:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727772928 00000100:00100000:2.0:1788574552.114713:0:18886:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727772928 00000100:00100000:2.0:1788574552.114756:0:18886:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727773312 00000100:00100000:2.0:1788574552.114760:0:18886:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727773312 00000100:00100000:2.0:1788574552.114790:0:18886:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 22 00000100:00100000:2.0:1788574552.114798:0:18886:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7bbebc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0ef7cddc-b831-4237-948c-b4fc5b50b382+7:2353:x1875455727773312:12345-192.168.201.57@tcp:400:kworker.0 00000100:00100000:2.0:1788574552.114839:0:18886:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7bbebc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0ef7cddc-b831-4237-948c-b4fc5b50b382+7:2353:x1875455727773312:12345-192.168.201.57@tcp:400:kworker.0 Request processed in 42us (1173us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574552.114847:0:18886:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 22 00000100:00100000:2.0:1788574552.114862:0:18886:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 10 00000100:00100000:2.0:1788574552.114866:0:18886:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7bbebd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2352:x1875455727772928:12345-192.168.201.57@tcp:38:mount.lustre.0 00010000:00080000:2.0:1788574552.114890:0:18886:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from a406b67b-30f6-4346-815d-0b22929077a2@192.168.201.57@tcp t0 exp 0000000000000000 cur 678 last 0 00000020:00000080:2.0:1788574552.114927:0:18886:0:(genops.c:1385:class_connect()) connect: client a406b67b-30f6-4346-815d-0b22929077a2, cookie 0x10531a153b537415 00000004:00100000:2.0:1788574552.114962:0:18886:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:2.0:1788574552.115110:0:18886:0:(import.c:65:import_set_state_nolock()) ffff90a791d09800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788574552.115142:0:18886:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7bbebd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a406b67b-30f6-4346-815d-0b22929077a2+6:2352:x1875455727772928:12345-192.168.201.57@tcp:38:mount.lustre.0 Request processed in 273us (1571us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574552.115149:0:18886:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 10 00000100:00100000:3.0:1788574552.130749:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:2.0:1788574552.130892:0:18886:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727773184 00000100:00100000:2.0:1788574552.130904:0:18886:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727773184 00000100:00100000:2.0:1788574552.130995:0:18886:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 11 00000100:00100000:2.0:1788574552.131014:0:18886:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7bbebf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a406b67b-30f6-4346-815d-0b22929077a2+6:16854:x1875455727773184:12345-192.168.201.57@tcp:41:mount.lustre.0 00000004:00000024:2.0:1788574552.131062:0:18886:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:2.0:1788574552.131161:0:18886:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7bbebf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a406b67b-30f6-4346-815d-0b22929077a2+6:16854:x1875455727773184:12345-192.168.201.57@tcp:41:mount.lustre.0 Request processed in 148us (433us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574552.131168:0:18886:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 11 00000100:00080000:1.0:1788574552.132025:0:18882:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788574552.133540:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:1.0:1788574552.133644:0:18887:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727773056 00000100:00100000:1.0:1788574552.133658:0:18887:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727773056 00000100:00100000:1.0:1788574552.133735:0:18887:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 12 00000100:00100000:1.0:1788574552.133746:0:18887:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a6839d2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a406b67b-30f6-4346-815d-0b22929077a2+6:0:x1875455727773056:12345-192.168.201.57@tcp:41:mount.lustre.0 00000004:00000024:1.0:1788574552.133776:0:18887:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:1.0:1788574552.133863:0:18887:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a6839d2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a406b67b-30f6-4346-815d-0b22929077a2+6:0:x1875455727773056:12345-192.168.201.57@tcp:41:mount.lustre.0 Request processed in 118us (335us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574552.133871:0:18887:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 12 00000100:00100000:0.0:1788574552.146357:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:2.0:1788574552.146609:0:18886:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727773696 00000100:00100000:2.0:1788574552.146619:0:18886:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727773696 00000100:00100000:2.0:1788574552.146676:0:18886:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 13 00000100:00100000:2.0:1788574552.146686:0:18886:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a78e0e9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a406b67b-30f6-4346-815d-0b22929077a2+6:16854:x1875455727773696:12345-192.168.201.57@tcp:40:mount.lustre.0 00000100:00100000:2.0:1788574552.146781:0:18886:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a78e0e9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a406b67b-30f6-4346-815d-0b22929077a2+6:16854:x1875455727773696:12345-192.168.201.57@tcp:40:mount.lustre.0 Request processed in 96us (436us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574552.146788:0:18886:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 13 00000100:00100000:2.0:1788574552.149882:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:2.0:1788574552.149932:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:2.0:1788574552.149967:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:3.0:1788574552.150050:0:19576:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727773824 00000100:00100000:3.0:1788574552.150060:0:19576:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727773824 00000100:00100000:3.0:1788574552.150111:0:19576:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727773952 00000100:00100000:3.0:1788574552.150115:0:19576:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727773952 00000100:00100000:3.0:1788574552.150148:0:19576:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 12 00000100:00100000:3.0:1788574552.150156:0:19576:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a79b053100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2352:x1875455727773824:12345-192.168.201.57@tcp:8:mount.lustre.0 00010000:00080000:3.0:1788574552.150189:0:19576:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from a406b67b-30f6-4346-815d-0b22929077a2@192.168.201.57@tcp t0 exp 0000000000000000 cur 678 last 0 00000020:00000080:3.0:1788574552.150222:0:19576:0:(genops.c:1385:class_connect()) connect: client a406b67b-30f6-4346-815d-0b22929077a2, cookie 0x10531a153b53741c 00002000:00100000:3.0:1788574552.150234:0:19576:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli a406b67b-30f6-4346-815d-0b22929077a2/ffff90a683289800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a03 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1788574552.150244:0:19576:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:3.0:1788574552.150556:0:19576:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00100000:1.0:1788574552.150735:0:18890:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727774080 00000100:00100000:1.0:1788574552.150740:0:18890:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727774080 00000100:00100000:1.0:1788574552.150778:0:18890:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 1 00000100:00100000:1.0:1788574552.150785:0:18890:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a79b050380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a406b67b-30f6-4346-815d-0b22929077a2+6:16854:x1875455727774080:12345-192.168.201.57@tcp:33:mount.lustre.0 00000004:00200000:1.0:1788574552.150855:0:18890:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000100:00100000:1.0:1788574552.150944:0:18890:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a79b050380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a406b67b-30f6-4346-815d-0b22929077a2+6:16854:x1875455727774080:12345-192.168.201.57@tcp:33:mount.lustre.0 Request processed in 160us (1078us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574552.150958:0:18890:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 1 00000100:00080000:3.0:1788574552.151151:0:19576:0:(import.c:65:import_set_state_nolock()) ffff90a68328b000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788574552.151829:0:19576:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a79b053100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a406b67b-30f6-4346-815d-0b22929077a2+6:2352:x1875455727773824:12345-192.168.201.57@tcp:8:mount.lustre.0 Request processed in 1667us (1891us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574552.151839:0:19576:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 12 00000100:00100000:1.0:1788574552.151868:0:19576:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 13 00000100:00100000:1.0:1788574552.151874:0:19576:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a79b051500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2352:x1875455727773952:12345-192.168.201.57@tcp:8:mount.lustre.0 00010000:00080000:1.0:1788574552.151901:0:19576:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from a406b67b-30f6-4346-815d-0b22929077a2@192.168.201.57@tcp t0 exp 0000000000000000 cur 678 last 0 00000020:00000080:1.0:1788574552.151929:0:19576:0:(genops.c:1385:class_connect()) connect: client a406b67b-30f6-4346-815d-0b22929077a2, cookie 0x10531a153b537423 00002000:00100000:1.0:1788574552.151939:0:19576:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli a406b67b-30f6-4346-815d-0b22929077a2/ffff90a7927e3800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a03 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1788574552.151948:0:19576:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:1.0:1788574552.152023:0:19576:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1788574552.152043:0:19576:0:(import.c:65:import_set_state_nolock()) ffff90a7927e0800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788574552.152068:0:19576:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a79b051500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a406b67b-30f6-4346-815d-0b22929077a2+6:2352:x1875455727773952:12345-192.168.201.57@tcp:8:mount.lustre.0 Request processed in 192us (2100us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574552.152074:0:19576:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 13 00000100:00100000:2.0:1788574552.375539:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:1.0:1788574552.375689:0:18887:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727774208 00000100:00100000:1.0:1788574552.375703:0:18887:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727774208 00000100:00100000:1.0:1788574552.375816:0:18887:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 14 00000100:00100000:1.0:1788574552.375829:0:18887:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a79b051c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a406b67b-30f6-4346-815d-0b22929077a2+6:16888:x1875455727774208:12345-192.168.201.57@tcp:101:mkdir.0 00010000:00010000:1.0:1788574552.375857:0:18887:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788574552.375887:0:18887:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a790a21800/0x10531a153b53742a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1d2563b34cce3db7 expref: -99 pid: 18887 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574552.375969:0:18887:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a790a21200/0x10531a153b537431 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 18887 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574552.376001:0:18887:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a790a21200/0x10531a153b537431 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 18887 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574552.376016:0:18887:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a790a21200/0x10531a153b537431 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 18887 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788574552.376068:0:18887:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:1.0:1788574552.376072:0:18887:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1788574552.376099:0:18887:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90a790a21200/0x10531a153b537431 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 18887 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574552.376130:0:18887:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a790a21800/0x10531a153b53742a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce3db7 expref: 8 pid: 18887 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574552.376152:0:18887:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90a790a21200/0x10531a153b537431 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce3db7 expref: 7 pid: 18887 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574552.376163:0:18887:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90a79b397300) 00010000:00010000:1.0:1788574552.376166:0:18887:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788574552.376171:0:18887:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a790a21200, rc 0) 00000100:00100000:1.0:1788574552.376463:0:18887:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a79b051c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a406b67b-30f6-4346-815d-0b22929077a2+7:16888:x1875455727774208:12345-192.168.201.57@tcp:101:mkdir.0 Request processed in 635us (939us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574552.376471:0:18887:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 14 00010000:00010000:1.0:1788574552.961145:0:18874:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788574553.216817:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a792458e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3314:1875455747694720:0@lo:400:kworker.0 00000100:00100000:3.0:1788574553.216923:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788574553.216997:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1788574553.217004:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a792459880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:64047b6f-0fa6-4004-9f51-bd636ae04daf:3314:1875455747694336:0@lo:400:kworker.0 00000100:00100000:3.0:1788574553.217042:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788574553.217072:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a792459180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3314:1875455747694848:0@lo:400:kworker.0 00000100:00100000:3.0:1788574553.217100:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788574553.217139:0:18888:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747694720 00000100:00100000:3.0:1788574553.217148:0:18888:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747694720 00000100:00100000:3.0:1788574553.217207:0:18888:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747694848 00000100:00100000:3.0:1788574553.217210:0:18888:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747694848 00000100:00100000:3.0:1788574553.217240:0:18888:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1788574553.217250:0:18888:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a79245bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1875455747694720:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788574553.218474:0:18888:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a79245bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1875455747694720:12345-0@lo:400:kworker.0 Request processed in 1218us (1544us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574553.218488:0:18888:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1788574553.218522:0:18888:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1788574553.218534:0:18888:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a792459500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1875455747694848:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788574553.218596:0:18888:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a792459500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1875455747694848:12345-0@lo:400:kworker.0 Request processed in 66us (1495us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574553.218616:0:18888:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1788574553.218899:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a79245b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1875455747694464:0@lo:400:kworker.0 00000100:00100000:1.0:1788574553.218952:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788574553.218992:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a79245a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3312:1875455747694976:0@lo:400:kworker.0 00000100:00100000:1.0:1788574553.219029:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788574553.219045:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788574553.219052:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a792458380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1875455747694592:0@lo:400:kworker.0 00000100:00100000:1.0:1788574553.219074:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788574553.219100:0:18888:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747694976 00000100:00100000:3.0:1788574553.219110:0:18888:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747694976 00000100:00100000:3.0:1788574553.219158:0:18888:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1788574553.219166:0:18888:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7a7844700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1875455747694976:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788574553.219220:0:18888:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7a7844700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1875455747694976:12345-0@lo:400:kworker.0 Request processed in 55us (189us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574553.219226:0:18888:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1788574553.219570:0:19575:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747694464 00000100:00100000:2.0:1788574553.219575:0:19575:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747694464 00000100:00080000:1.0:1788574553.219628:0:18882:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788574553.219634:0:18882:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788574553.219644:0:19575:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747694592 00000100:00100000:2.0:1788574553.219649:0:19575:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747694592 00000100:00100000:1.0:1788574553.219659:0:19576:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788574553.219669:0:19576:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7a7844380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3312:x1875455747694464:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788574553.219692:0:19575:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:2.0:1788574553.219703:0:19575:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00000100:00100000:1.0:1788574553.219722:0:19576:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7a7844380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3312:x1875455747694464:12345-0@lo:400:kworker.0 Request processed in 54us (769us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574553.219729:0:19576:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788574553.219876:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a79b053800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1875455747695104:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788574553.219908:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788574553.220043:0:19576:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788574553.220051:0:19576:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7a7846d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3312:x1875455747694592:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788574553.220083:0:19576:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7a7846d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3312:x1875455747694592:12345-0@lo:400:kworker.0 Request processed in 34us (1008us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574553.220089:0:19576:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00080000:2.0:1788574553.227517:0:18882:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788574553.227743:0:19579:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747695104 00000100:00100000:2.0:1788574553.227757:0:19579:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747695104 00000100:00100000:2.0:1788574553.227813:0:19579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788574553.227825:0:19579:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a79b051f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1875455747695104:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788574553.227874:0:19579:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3851419648 avail 3849322496 00000100:00100000:2.0:1788574553.228483:0:19579:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a79b051f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1875455747695104:12345-0@lo:13:osp-pre-1-0.0 Request processed in 658us (8571us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574553.228491:0:19579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788574553.228545:0:3313:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 12884901889 gen 2 00000100:00100000:2.0:1788574553.228577:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a79b053800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1875455747695104:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788574553.228721:0:18880:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747694336 00000100:00100000:0.0:1788574553.228728:0:18880:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747694336 00000100:00100000:0.0:1788574553.228771:0:18880:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:0.0:1788574553.228779:0:18880:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a785537850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:64047b6f-0fa6-4004-9f51-bd636ae04daf+19:3314:x1875455747694336:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788574553.228820:0:18880:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a785537850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:64047b6f-0fa6-4004-9f51-bd636ae04daf+19:3314:x1875455747694336:12345-0@lo:400:kworker.0 Request processed in 42us (11778us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574553.228827:0:18880:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:0.0:1788574553.229811:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a792458380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1875455747694592:0@lo:400:kworker.0 00000100:00100000:0.0:1788574553.229830:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a79245b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1875455747694464:0@lo:400:kworker.0 00000100:00100000:0.0:1788574553.229843:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a79245a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3312:1875455747694976:0@lo:400:kworker.0 00000100:00100000:3.0:1788574553.236516:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a792459880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:64047b6f-0fa6-4004-9f51-bd636ae04daf:3314:1875455747694336:0@lo:400:kworker.0 00000100:00100000:3.0:1788574553.236539:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a792459180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3314:1875455747694848:0@lo:400:kworker.0 00000100:00100000:3.0:1788574553.236551:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a792458e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3314:1875455747694720:0@lo:400:kworker.0 00000001:00100000:3.0:1788574553.379758:0:7676:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of a406b67b-30f6-4346-815d-0b22929077a2 00000001:00100000:3.0:1788574553.379776:0:7676:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 0ef7cddc-b831-4237-948c-b4fc5b50b382 00000100:00100000:1.0:1788574553.739297:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a7a7847100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1875455747695232:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788574553.739397:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788574553.739475:0:19579:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747695232 00000100:00100000:1.0:1788574553.739485:0:19579:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747695232 00000100:00100000:1.0:1788574553.739534:0:19579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788574553.739543:0:19579:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7a7845f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1875455747695232:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788574553.739580:0:19579:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788574553.739640:0:19579:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7a7845f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1875455747695232:12345-0@lo:13:osp-pre-0-0.0 Request processed in 98us (243us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574553.739648:0:19579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788574553.739721:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a7a7847100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1875455747695232:0@lo:13:osp-pre-0-0.0 00000001:00100000:1.0:1788574553.767656:0:5879:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 0ef7cddc-b831-4237-948c-b4fc5b50b382 00000001:00100000:1.0:1788574553.767677:0:5879:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of a406b67b-30f6-4346-815d-0b22929077a2 00010000:00010000:3.0:1788574553.985690:0:18875:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788574555.010041:0:20565:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1788574555.819866:0:6739:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of a406b67b-30f6-4346-815d-0b22929077a2 00010000:00010000:1.0:1788574556.035434:0:18874:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1788574556.386301:0:20869:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00010000:00010000:3.0:1788574557.056716:0:18875:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788574557.494797:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:0.0:1788574557.494861:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:0.0:1788574557.494912:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:0.0:1788574557.494960:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:0.0:1788574557.494979:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:0.0:1788574557.494999:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:0.0:1788574557.495025:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:0.0:1788574557.495062:0:18888:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727774848 00000100:00100000:0.0:1788574557.495074:0:18888:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727774848 00000100:00100000:0.0:1788574557.495171:0:18888:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727774464 00000100:00100000:0.0:1788574557.495176:0:18888:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727774464 00000100:00100000:0.0:1788574557.495205:0:18888:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 26 00000100:00100000:0.0:1788574557.495216:0:18888:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a78e0ead80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a406b67b-30f6-4346-815d-0b22929077a2+6:2353:x1875455727774848:12345-192.168.201.57@tcp:400:kworker.0 00000100:00100000:1.0:1788574557.495360:0:18881:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727774336 00000100:00100000:1.0:1788574557.495387:0:18881:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727774336 00000100:00100000:1.0:1788574557.495426:0:18881:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 107 00000100:00100000:1.0:1788574557.495434:0:18881:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a785534850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:757865b4-e3c9-47dd-8b09-5caeeb506113+13:2353:x1875455727774336:12345-192.168.201.57@tcp:400:kworker.0 00000100:00100000:1.0:1788574557.495531:0:18881:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a785534850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:757865b4-e3c9-47dd-8b09-5caeeb506113+13:2353:x1875455727774336:12345-192.168.201.57@tcp:400:kworker.0 Request processed in 97us (749us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574557.495539:0:18881:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 107 00000100:00100000:1.0:1788574557.495576:0:19577:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727774592 00000100:00100000:1.0:1788574557.495580:0:19577:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727774592 00000100:00100000:1.0:1788574557.495624:0:19577:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727775104 00000100:00100000:1.0:1788574557.495627:0:19577:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727775104 00000100:00100000:1.0:1788574557.495652:0:19577:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727774720 00000100:00100000:1.0:1788574557.495655:0:19577:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727774720 00000100:00100000:1.0:1788574557.495666:0:19577:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727774976 00000100:00100000:1.0:1788574557.495668:0:19577:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727774976 00000100:00100000:1.0:1788574557.495680:0:19577:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 10 00000100:00100000:1.0:1788574557.495686:0:19577:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a78e0eaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0ef7cddc-b831-4237-948c-b4fc5b50b382+5:2353:x1875455727774592:12345-192.168.201.57@tcp:400:kworker.0 00000100:00100000:1.0:1788574557.495714:0:19577:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a78e0eaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0ef7cddc-b831-4237-948c-b4fc5b50b382+5:2353:x1875455727774592:12345-192.168.201.57@tcp:400:kworker.0 Request processed in 28us (854us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574557.495720:0:19577:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 10 00000100:00100000:1.0:1788574557.495733:0:19577:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 11 00000100:00100000:1.0:1788574557.495739:0:19577:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a78e0eb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a406b67b-30f6-4346-815d-0b22929077a2+5:2353:x1875455727775104:12345-192.168.201.57@tcp:400:kworker.0 00000100:00100000:1.0:1788574557.495780:0:19577:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a78e0eb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a406b67b-30f6-4346-815d-0b22929077a2+5:2353:x1875455727775104:12345-192.168.201.57@tcp:400:kworker.0 Request processed in 41us (820us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574557.495786:0:19577:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 11 00000100:00100000:1.0:1788574557.495812:0:19577:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 12 00000100:00100000:1.0:1788574557.495819:0:19577:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a78e0ebb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0ef7cddc-b831-4237-948c-b4fc5b50b382+5:2353:x1875455727774720:12345-192.168.201.57@tcp:400:kworker.0 00000100:00100000:1.0:1788574557.495842:0:19577:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a78e0ebb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0ef7cddc-b831-4237-948c-b4fc5b50b382+5:2353:x1875455727774720:12345-192.168.201.57@tcp:400:kworker.0 Request processed in 24us (842us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574557.495848:0:19577:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 12 00000100:00100000:1.0:1788574557.495858:0:19577:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 13 00000100:00100000:1.0:1788574557.495864:0:19577:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a78e0ea300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a406b67b-30f6-4346-815d-0b22929077a2+5:2353:x1875455727774976:12345-192.168.201.57@tcp:400:kworker.0 00000100:00100000:1.0:1788574557.495887:0:19577:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a78e0ea300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a406b67b-30f6-4346-815d-0b22929077a2+5:2353:x1875455727774976:12345-192.168.201.57@tcp:400:kworker.0 Request processed in 23us (862us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574557.495892:0:19577:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 13 00000100:00100000:1.0:1788574557.495912:0:18887:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 27 00000100:00100000:1.0:1788574557.495920:0:18887:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a78e0e9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0ef7cddc-b831-4237-948c-b4fc5b50b382+6:2353:x1875455727774464:12345-192.168.201.57@tcp:400:kworker.0 00000100:00100000:1.0:1788574557.495943:0:18887:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a78e0e9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0ef7cddc-b831-4237-948c-b4fc5b50b382+6:2353:x1875455727774464:12345-192.168.201.57@tcp:400:kworker.0 Request processed in 24us (963us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574557.495950:0:18887:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 27 00000100:00100000:0.0:1788574557.496593:0:18888:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a78e0ead80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a406b67b-30f6-4346-815d-0b22929077a2+6:2353:x1875455727774848:12345-192.168.201.57@tcp:400:kworker.0 Request processed in 1374us (1675us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574557.496602:0:18888:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 26 00000100:00080000:0.0:1788574557.496631:0:18882:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788574557.496646:0:18882:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788574557.496649:0:18882:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1788574558.081888:0:20565:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788574558.337455:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788574558.337487:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a78e0e9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1875455747695360:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788574558.337596:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788574558.337713:0:19579:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747695360 00000100:00100000:0.0:1788574558.337726:0:19579:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747695360 00000100:00100000:0.0:1788574558.337808:0:19579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788574558.337819:0:19579:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a78e0e8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1875455747695360:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788574558.337866:0:19579:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3851419648 avail 3849322496 00000100:00100000:0.0:1788574558.337927:0:19579:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a78e0e8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1875455747695360:12345-0@lo:13:osp-pre-1-0.0 Request processed in 108us (331us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574558.337934:0:19579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00080000:0.0:1788574558.337972:0:18882:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788574558.340806:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a79b050a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1875455747695616:0@lo:400:kworker.0 00000100:00100000:2.0:1788574558.340889:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788574558.340936:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:2.0:1788574558.340942:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a79b053800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:64047b6f-0fa6-4004-9f51-bd636ae04daf:3313:1875455747695488:0@lo:400:kworker.0 00000100:00100000:2.0:1788574558.340975:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788574558.341005:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a79b050e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3313:1875455747696000:0@lo:400:kworker.0 00000100:00100000:2.0:1788574558.341038:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788574558.341072:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a79b050000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3315:1875455747695872:0@lo:400:kworker.0 00000100:00100000:2.0:1788574558.341563:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788574558.341594:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788574558.341602:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a79b053480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3315:1875455747695744:0@lo:400:kworker.0 00000100:00100000:2.0:1788574558.341639:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788574558.342399:0:19577:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747695616 00000100:00100000:2.0:1788574558.342416:0:19577:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747695616 00000100:00100000:2.0:1788574558.342510:0:19577:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1788574558.342534:0:19577:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a79b052680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3313:x1875455747695616:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788574558.342602:0:19577:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a79b052680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3313:x1875455747695616:12345-0@lo:400:kworker.0 Request processed in 82us (1712us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574558.342610:0:19577:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1788574558.342661:0:18879:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747695488 00000100:00100000:2.0:1788574558.342684:0:18879:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747695488 00000100:00100000:2.0:1788574558.342715:0:18879:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:2.0:1788574558.342721:0:18879:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a785537450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:64047b6f-0fa6-4004-9f51-bd636ae04daf+19:3313:x1875455747695488:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788574558.342753:0:18879:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a785537450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:64047b6f-0fa6-4004-9f51-bd636ae04daf+19:3313:x1875455747695488:12345-0@lo:400:kworker.0 Request processed in 33us (1778us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574558.342759:0:18879:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:2.0:1788574558.342788:0:18887:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747696000 00000100:00100000:2.0:1788574558.342792:0:18887:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747696000 00000100:00100000:2.0:1788574558.342824:0:18887:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747695872 00000100:00100000:2.0:1788574558.342827:0:18887:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747695872 00000100:00100000:2.0:1788574558.342841:0:18887:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747695744 00000100:00100000:2.0:1788574558.342843:0:18887:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747695744 00000100:00100000:2.0:1788574558.342856:0:18887:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1788574558.342863:0:18887:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a79b052a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1875455747696000:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788574558.342894:0:18887:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a79b052a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1875455747696000:12345-0@lo:400:kworker.0 Request processed in 33us (1856us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574558.342900:0:18887:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1788574558.342912:0:18887:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1788574558.342919:0:18887:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a79b053b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1875455747695872:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788574558.342951:0:18887:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a79b053b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1875455747695872:12345-0@lo:400:kworker.0 Request processed in 33us (1388us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574558.342957:0:18887:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1788574558.342968:0:18887:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1788574558.342974:0:18887:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a79b051880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1875455747695744:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788574558.343001:0:18887:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a79b051880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1875455747695744:12345-0@lo:400:kworker.0 Request processed in 27us (1361us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574558.343007:0:18887:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1788574558.343927:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a78e0e9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1875455747695360:0@lo:13:osp-pre-1-0.0 00000100:00080000:0.0:1788574558.344048:0:18882:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788574558.344056:0:18882:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788574558.345545:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a79b053480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3315:1875455747695744:0@lo:400:kworker.0 00000100:00100000:0.0:1788574558.345571:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a79b050000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3315:1875455747695872:0@lo:400:kworker.0 00000100:00100000:2.0:1788574558.345758:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a79b053800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:64047b6f-0fa6-4004-9f51-bd636ae04daf:3313:1875455747695488:0@lo:400:kworker.0 00000100:00100000:2.0:1788574558.345972:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a79b050e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3313:1875455747696000:0@lo:400:kworker.0 00000100:00100000:2.0:1788574558.345987:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a79b050a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1875455747695616:0@lo:400:kworker.0 00000100:00100000:2.0:1788574558.849607:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a7a7847100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1875455747696128:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788574558.849717:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788574558.849832:0:19579:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747696128 00000100:00100000:2.0:1788574558.849841:0:19579:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747696128 00000100:00100000:2.0:1788574558.850581:0:19579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1788574558.850596:0:19579:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a79b050a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1875455747696128:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788574558.850651:0:19579:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788574558.850715:0:19579:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a79b050a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1875455747696128:12345-0@lo:13:osp-pre-0-0.0 Request processed in 124us (998us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574558.850724:0:19579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1788574558.852300:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a7a7847100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1875455747696128:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1788574559.104753:0:18874:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788574560.128892:0:18875:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788574560.580906:0:18921:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000020:00000080:3.0:1788574560.944789:0:21017:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffe21dd0e50 20000000:00000080:3.0:1788574560.944809:0:21017:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff90a7c1150c00 uarg=0000000000000000 20000000:01000000:3.0:1788574560.944851:0:21017:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:3.0:1788574560.944857:0:21017:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:3.0:1788574560.944861:0:21017:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:3.0:1788574560.945948:0:21018:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 10 20000000:00000400:1.0:1788574560.946100:0:21017:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:1.0:1788574560.955509:0:21017:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:1.0:1788574560.955549:0:21017:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff90a790a21800/0x10531a153b537438 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 21017 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574560.955606:0:21017:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90a68116ac00/0x10531a153b5370f7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x10531a153b5370f0 expref: 18 pid: 18880 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574560.955615:0:21017:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90a79e985200/0x10531a153b537144 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x10531a153b53713d expref: 18 pid: 18880 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574560.955622:0:21017:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90a68116ae00/0x10531a153b53729b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x10531a153b537294 expref: 18 pid: 18879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574560.955678:0:21017:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90a790a21c00/0x10531a153b5373d6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce3d2b expref: 12 pid: 18881 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574560.955686:0:21017:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90a6824f8a00/0x10531a153b53740e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce3d8d expref: 12 pid: 18879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574560.955695:0:21017:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff90a790a21800/0x10531a153b537438 lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 21017 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574560.955749:0:21017:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90a6824f8a00/0x10531a153b53740e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce3d8d expref: 12 pid: 18879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574560.955766:0:21017:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff90a6824f8a00/0x10531a153b53740e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce3d8d expref: 12 pid: 18879 timeout: 787 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788574560.955783:0:21017:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a7a7845180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:21017:1875455747696256:192.168.201.57@tcp:104: 00010000:00010000:1.0:1788574560.955901:0:21017:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90a790a21c00/0x10531a153b5373d6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce3d2b expref: 12 pid: 18881 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574560.955909:0:21017:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff90a790a21c00/0x10531a153b5373d6 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce3d2b expref: 12 pid: 18881 timeout: 787 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788574560.955926:0:21017:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a7a7846300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:21017:1875455747696384:192.168.201.57@tcp:104: 00010000:00010000:1.0:1788574560.955961:0:21017:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90a68116ae00/0x10531a153b53729b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x10531a153b537294 expref: 18 pid: 18879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574560.955968:0:21017:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff90a68116ae00/0x10531a153b53729b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x10531a153b537294 expref: 18 pid: 18879 timeout: 787 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788574560.955976:0:21017:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a7a7845500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:21017:1875455747696512:0@lo:104: 00000100:00100000:1.0:1788574560.956014:0:21017:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788574560.956057:0:21017:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90a79e985200/0x10531a153b537144 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x10531a153b53713d expref: 18 pid: 18880 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574560.956065:0:21017:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff90a79e985200/0x10531a153b537144 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x10531a153b53713d expref: 18 pid: 18880 timeout: 787 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788574560.956073:0:21017:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a7a7847480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:21017:1875455747696640:0@lo:104: 00000100:00100000:1.0:1788574560.956094:0:21017:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788574560.959676:0:18869:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747696512 00000100:00100000:3.0:1788574560.959695:0:18869:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747696512 00000100:00100000:3.0:1788574560.959772:0:18869:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747696640 00000100:00100000:3.0:1788574560.959775:0:18869:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747696640 00000100:00100000:3.0:1788574560.959792:0:18869:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788574560.959800:0:18869:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7a7846680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:64047b6f-0fa6-4004-9f51-bd636ae04daf+4:21017:x1875455747696512:12345-0@lo:104: 00010000:00010000:3.0:1788574560.959832:0:18869:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.157@tcp lock: ffff90a79e984e00/0x10531a153b537294 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x10531a153b53729b expref: -99 pid: 20301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574560.960289:0:21017:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90a68116ac00/0x10531a153b5370f7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x10531a153b5370f0 expref: 18 pid: 18880 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574560.960428:0:21017:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff90a68116ac00/0x10531a153b5370f7 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x10531a153b5370f0 expref: 18 pid: 18880 timeout: 787 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788574560.960447:0:21017:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a7a7844000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:21017:1875455747696768:0@lo:104: 00000100:00100000:1.0:1788574560.960505:0:21017:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788574560.960539:0:21017:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a7a0953240 going to sleep for 11 seconds 00000100:00100000:2.0:1788574560.962235:0:18870:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:2.0:1788574560.962258:0:18870:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 2 min 2 max 56 00000100:00100000:2.0:1788574560.962265:0:18870:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_002' 00010000:00010000:3.0:1788574560.962561:0:18869:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788574560.962582:0:18869:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7a7846680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:64047b6f-0fa6-4004-9f51-bd636ae04daf+4:21017:x1875455747696512:12345-0@lo:104: Request processed in 2770us (6555us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574560.962593:0:18869:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788574560.962626:0:18869:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747696768 00000100:00100000:3.0:1788574560.962632:0:18869:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747696768 00000100:00100000:2.0:1788574560.962634:0:21017:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a7a7845500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:21017:1875455747696512:0@lo:104: 00000100:00100000:3.0:1788574560.962665:0:18869:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788574560.962674:0:18869:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7a7847100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:64047b6f-0fa6-4004-9f51-bd636ae04daf+4:21017:x1875455747696640:12345-0@lo:104: 00010000:00010000:3.0:1788574560.962693:0:18869:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.157@tcp lock: ffff90a79e985c00/0x10531a153b53713d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x10531a153b537144 expref: -99 pid: 19574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574560.962760:0:18869:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1788574560.962765:0:18869:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7a7847100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:64047b6f-0fa6-4004-9f51-bd636ae04daf+4:21017:x1875455747696640:12345-0@lo:104: Request processed in 93us (6670us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574560.962771:0:18869:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788574560.962785:0:18869:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788574560.962791:0:18869:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a683a3c050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:64047b6f-0fa6-4004-9f51-bd636ae04daf+3:21017:x1875455747696768:12345-0@lo:104: 00010000:00010000:3.0:1788574560.962799:0:18869:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.157@tcp lock: ffff90a79e985400/0x10531a153b5370f0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x10531a153b5370f7 expref: -99 pid: 18883 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574560.962845:0:18869:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:3.0:1788574560.962926:0:18869:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a683a3c050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:64047b6f-0fa6-4004-9f51-bd636ae04daf+3:21017:x1875455747696768:12345-0@lo:104: Request processed in 135us (2421us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574560.962933:0:18869:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00010000:3.0:1788574560.962974:0:20565:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1788574560.962980:0:20565:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.157@tcp lock: ffff90a79e984e00/0x10531a153b537294 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x10531a153b53729b expref: -99 pid: 20301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574560.962987:0:20565:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a79e984e00 already unused, calling callback (ffffffffc1bbcc20) 10000000:00010000:3.0:1788574560.962992:0:20565:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.157@tcp lock: ffff90a79e984e00/0x10531a153b537294 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x10531a153b53729b expref: -99 pid: 20301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574560.963000:0:20565:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.157@tcp lock: ffff90a79e984e00/0x10531a153b537294 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x10531a153b53729b expref: -99 pid: 20301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788574560.963009:0:20565:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.157@tcp lock: ffff90a79e984e00/0x10531a153b537294 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x10531a153b53729b expref: -99 pid: 20301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788574560.963015:0:20565:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00000100:00100000:2.0:1788574560.963044:0:21017:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a7a7847480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:21017:1875455747696640:0@lo:104: 00010000:00010000:3.0:1788574560.963050:0:20565:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.157@tcp lock: ffff90a79e984e00/0x10531a153b537294 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x10531a153b53729b expref: -99 pid: 20301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788574560.963052:0:21017:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a7a7844000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:21017:1875455747696768:0@lo:104: 00010000:00010000:3.0:1788574560.963056:0:20565:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788574560.963089:0:20565:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.157@tcp lock: ffff90a79e984e00/0x10531a153b537294 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x10531a153b53729b expref: -99 pid: 20301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574560.963097:0:20565:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.157@tcp lock: ffff90a79e984e00/0x10531a153b537294 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x10531a153b53729b expref: -99 pid: 20301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574560.963111:0:20565:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788574560.963114:0:20565:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.157@tcp lock: ffff90a79e985c00/0x10531a153b53713d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x10531a153b537144 expref: -99 pid: 19574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574560.963130:0:20565:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a79e985c00 already unused, calling callback (ffffffffc1bbcc20) 10000000:00010000:3.0:1788574560.963133:0:20565:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.157@tcp lock: ffff90a79e985c00/0x10531a153b53713d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x10531a153b537144 expref: -99 pid: 19574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574560.963140:0:20565:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.157@tcp lock: ffff90a79e985c00/0x10531a153b53713d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x10531a153b537144 expref: -99 pid: 19574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788574560.963145:0:20565:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.157@tcp lock: ffff90a79e985c00/0x10531a153b53713d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x10531a153b537144 expref: -99 pid: 19574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788574560.963151:0:20565:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1788574560.963164:0:20565:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.157@tcp lock: ffff90a79e985c00/0x10531a153b53713d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x10531a153b537144 expref: -99 pid: 19574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574560.963170:0:20565:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788574560.963176:0:20565:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.157@tcp lock: ffff90a79e985c00/0x10531a153b53713d lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x10531a153b537144 expref: -99 pid: 19574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574560.963182:0:20565:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.157@tcp lock: ffff90a79e985c00/0x10531a153b53713d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x10531a153b537144 expref: -99 pid: 19574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788574560.963188:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a792458e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:64047b6f-0fa6-4004-9f51-bd636ae04daf:3314:1875455747696896:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788574560.963191:0:20565:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788574560.963194:0:20565:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.157@tcp lock: ffff90a79e985400/0x10531a153b5370f0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x10531a153b5370f7 expref: -99 pid: 18883 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574560.963198:0:20565:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a79e985400 already unused, calling callback (ffffffffc1bbcc20) 10000000:00010000:3.0:1788574560.963201:0:20565:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.157@tcp lock: ffff90a79e985400/0x10531a153b5370f0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x10531a153b5370f7 expref: -99 pid: 18883 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574560.963216:0:20565:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.157@tcp lock: ffff90a79e985400/0x10531a153b5370f0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x10531a153b5370f7 expref: -99 pid: 18883 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788574560.963222:0:20565:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.157@tcp lock: ffff90a79e985400/0x10531a153b5370f0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x10531a153b5370f7 expref: -99 pid: 18883 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788574560.963227:0:20565:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00000100:00100000:2.0:1788574560.963232:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788574560.963240:0:20565:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.157@tcp lock: ffff90a79e985400/0x10531a153b5370f0 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x10531a153b5370f7 expref: -99 pid: 18883 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574560.963245:0:20565:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788574560.963260:0:20565:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.157@tcp lock: ffff90a79e985400/0x10531a153b5370f0 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x10531a153b5370f7 expref: -99 pid: 18883 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574560.963266:0:20565:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.157@tcp lock: ffff90a79e985400/0x10531a153b5370f0 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x10531a153b5370f7 expref: -99 pid: 18883 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788574560.963272:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00010000:00010000:3.0:1788574560.963278:0:20565:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788574560.963278:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a792459180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:64047b6f-0fa6-4004-9f51-bd636ae04daf:3314:1875455747697024:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788574560.963280:0:20565:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788574560.963282:0:20565:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788574560.963287:0:18874:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788574560.963292:0:18875:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788574560.963308:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a792459880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:64047b6f-0fa6-4004-9f51-bd636ae04daf:3312:1875455747697152:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788574560.963310:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788574560.963331:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788574560.963450:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:2.0:1788574560.967047:0:18871:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747696896 00000100:00100000:2.0:1788574560.967070:0:18871:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747696896 00000100:00100000:1.0:1788574560.967198:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:3.0:1788574560.967279:0:18873:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747697024 00000100:00100000:3.0:1788574560.967284:0:18873:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747697024 00010000:00010000:3.0:1788574560.967323:0:18873:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90a79e985200/0x10531a153b537144 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x10531a153b53713d expref: 20 pid: 18880 timeout: 787 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788574560.967406:0:18873:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747697152 00000100:00100000:3.0:1788574560.967418:0:18873:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747697152 00010000:00010000:3.0:1788574560.967498:0:18873:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90a68116ac00/0x10531a153b5370f7 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x10531a153b5370f0 expref: 21 pid: 18880 timeout: 787 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788574560.967512:0:18873:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727775360 00000100:00100000:3.0:1788574560.967515:0:18873:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727775360 00010000:00010000:3.0:1788574560.967530:0:18873:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90a790a21c00/0x10531a153b5373d6 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce3d2b expref: 13 pid: 18881 timeout: 787 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788574560.967541:0:18873:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727775232 00000100:00100000:3.0:1788574560.967543:0:18873:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727775232 00010000:00010000:3.0:1788574560.967554:0:18873:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90a6824f8a00/0x10531a153b53740e lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce3d8d expref: 14 pid: 18879 timeout: 787 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788574560.967569:0:18873:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788574560.967590:0:18873:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a79b053800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:64047b6f-0fa6-4004-9f51-bd636ae04daf+21:3314:x1875455747697024:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788574560.967606:0:18873:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788574560.967611:0:18873:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90a79e985200/0x10531a153b537144 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x10531a153b53713d expref: 21 pid: 18880 timeout: 787 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574560.967621:0:18873:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90a79e985200/0x10531a153b537144 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x10531a153b53713d expref: 21 pid: 18880 timeout: 787 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574560.967641:0:18873:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90a79e985200/0x10531a153b537144 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x10531a153b53713d expref: 21 pid: 18880 timeout: 787 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574560.967663:0:18873:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788574560.967732:0:18873:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a79b053800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:64047b6f-0fa6-4004-9f51-bd636ae04daf+20:3314:x1875455747697024:12345-0@lo:103:ldlm_bl.0 Request processed in 144us (4421us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574560.967739:0:18873:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788574560.967757:0:18873:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788574560.967771:0:18873:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7927d8050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:64047b6f-0fa6-4004-9f51-bd636ae04daf+19:3312:x1875455747697152:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788574560.967778:0:18873:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788574560.967782:0:18873:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90a68116ac00/0x10531a153b5370f7 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x10531a153b5370f0 expref: 19 pid: 18880 timeout: 787 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574560.967790:0:18873:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90a68116ac00/0x10531a153b5370f7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x10531a153b5370f0 expref: 19 pid: 18880 timeout: 787 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574560.967800:0:18873:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90a68116ac00/0x10531a153b5370f7 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x10531a153b5370f0 expref: 19 pid: 18880 timeout: 787 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574560.967810:0:18873:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788574560.967845:0:18873:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7927d8050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:64047b6f-0fa6-4004-9f51-bd636ae04daf+18:3312:x1875455747697152:12345-0@lo:103:ldlm_bl.0 Request processed in 76us (4513us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574560.968090:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a792459180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:64047b6f-0fa6-4004-9f51-bd636ae04daf:3314:1875455747697024:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788574560.968207:0:18873:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788574560.968225:0:18873:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 6 00000100:00100000:3.0:1788574560.968233:0:18873:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7a7844a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:757865b4-e3c9-47dd-8b09-5caeeb506113+14:2355:x1875455727775360:12345-192.168.201.57@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788574560.968242:0:18873:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788574560.968244:0:18871:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90a68116ae00/0x10531a153b53729b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x10531a153b537294 expref: 17 pid: 18879 timeout: 787 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574560.968246:0:18873:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90a790a21c00/0x10531a153b5373d6 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce3d2b expref: 14 pid: 18881 timeout: 787 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574560.968256:0:18873:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90a790a21c00/0x10531a153b5373d6 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce3d2b expref: 14 pid: 18881 timeout: 787 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574560.968265:0:18873:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788574560.968304:0:18871:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:3.0:1788574560.968309:0:18873:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7a7844a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:757865b4-e3c9-47dd-8b09-5caeeb506113+14:2355:x1875455727775360:12345-192.168.201.57@tcp:103:ldlm_bl.0 Request processed in 78us (4861us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574560.968313:0:18871:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_003' 00000100:00100000:3.0:1788574560.968314:0:18873:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 6 00000100:00100000:2.0:1788574560.968385:0:21017:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a7a7845180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:21017:1875455747696256:192.168.201.57@tcp:104: 00010000:00010000:2.0:1788574560.968402:0:21017:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90a790a21c00/0x10531a153b5373d6 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce3d2b expref: 14 pid: 18881 timeout: 787 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788574560.968412:0:21017:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a7a7846300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:21017:1875455747696384:192.168.201.57@tcp:104: 00010000:00010000:2.0:1788574560.968452:0:21017:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff90a790a21800/0x10531a153b537438 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 21017 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788574560.968949:0:18873:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 7 00000100:00100000:3.0:1788574560.968962:0:18873:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7a7846680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:757865b4-e3c9-47dd-8b09-5caeeb506113+12:2356:x1875455727775232:12345-192.168.201.57@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788574560.968971:0:18873:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788574560.968977:0:18873:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90a6824f8a00/0x10531a153b53740e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce3d8d expref: 12 pid: 18879 timeout: 787 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574560.968988:0:18873:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90a6824f8a00/0x10531a153b53740e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce3d8d expref: 12 pid: 18879 timeout: 787 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574560.968999:0:18873:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90a6824f8a00/0x10531a153b53740e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce3d8d expref: 12 pid: 18879 timeout: 787 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574560.969007:0:18873:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788574560.969035:0:18873:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7a7846680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:757865b4-e3c9-47dd-8b09-5caeeb506113+11:2356:x1875455727775232:12345-192.168.201.57@tcp:103:ldlm_bl.0 Request processed in 77us (1843us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574560.969041:0:18873:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 7 00000100:00100000:3.0:1788574560.969056:0:18873:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788574560.969063:0:18873:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a79b050e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:64047b6f-0fa6-4004-9f51-bd636ae04daf+17:3314:x1875455747696896:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788574560.969071:0:18873:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788574560.969075:0:18873:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90a68116ae00/0x10531a153b53729b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x10531a153b537294 expref: 17 pid: 18879 timeout: 787 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574560.969084:0:18873:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90a68116ae00/0x10531a153b53729b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x10531a153b537294 expref: 17 pid: 18879 timeout: 787 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574560.969092:0:18873:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90a68116ae00/0x10531a153b53729b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x10531a153b537294 expref: 17 pid: 18879 timeout: 787 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574560.969113:0:18873:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff90a790a21800/0x10531a153b537438 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 21017 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574560.969129:0:18873:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90a790a21800/0x10531a153b537438 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 21017 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574560.969143:0:18873:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff90a790a21800/0x10531a153b537438 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 21017 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574560.969149:0:18873:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff90a790a21800/0x10531a153b537438 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 21017 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574560.969156:0:18873:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff90a790a21800/0x10531a153b537438 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 21017 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574560.969163:0:18873:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff90a790a21800/0x10531a153b537438 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 21017 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574560.969169:0:18873:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a790a21800 already unused, calling callback (ffffffffc159f4f0) 00010000:00010000:3.0:1788574560.969173:0:18873:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff90a790a21800/0x10531a153b537438 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 21017 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574560.969181:0:18873:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff90a790a21800/0x10531a153b537438 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 21017 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574560.969200:0:18873:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff90a790a21800/0x10531a153b537438 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 21017 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574560.969211:0:18873:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788574560.969251:0:18873:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a79b050e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:64047b6f-0fa6-4004-9f51-bd636ae04daf+16:3314:x1875455747696896:12345-0@lo:103:ldlm_bl.0 Request processed in 189us (6019us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574560.969258:0:18873:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788574560.969327:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a792459880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:64047b6f-0fa6-4004-9f51-bd636ae04daf:3312:1875455747697152:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788574560.969361:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a792458e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:64047b6f-0fa6-4004-9f51-bd636ae04daf:3314:1875455747696896:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788574560.970774:0:21017:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff90a790a21800/0x10531a153b537438 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 21017 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574560.970788:0:21017:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff90a790a21800/0x10531a153b537438 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 21017 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574560.970796:0:21017:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90a790a21800/0x10531a153b537438 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 21017 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574561.152554:0:20565:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788574562.176692:0:18874:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788574562.229611:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:0.0:1788574562.229795:0:18880:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727775488 00000100:00100000:0.0:1788574562.229810:0:18880:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727775488 00000100:00100000:0.0:1788574562.229893:0:18880:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 109 00000100:00100000:0.0:1788574562.229905:0:18880:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a785534c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:757865b4-e3c9-47dd-8b09-5caeeb506113+11:16740:x1875455727775488:12345-192.168.201.57@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788574562.229931:0:18880:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788574562.229958:0:18880:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90a68116aa00/0x10531a153b53743f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x1d2563b34cce3dbe expref: -99 pid: 18880 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574562.230000:0:18880:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90a68116aa00/0x10531a153b53743f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce3dbe expref: 12 pid: 18880 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574562.230016:0:18880:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90a68116aa00/0x10531a153b53743f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce3dbe expref: 12 pid: 18880 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574562.230031:0:18880:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a68116aa00, rc 0) 00000100:00100000:0.0:1788574562.230122:0:18880:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a785534c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:757865b4-e3c9-47dd-8b09-5caeeb506113+12:16740:x1875455727775488:12345-192.168.201.57@tcp:101:ll_cfg_requeue.0 Request processed in 219us (522us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574562.230130:0:18880:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 109 00000100:00100000:1.0:1788574562.257683:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:0.0:1788574562.258059:0:18881:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727775616 00000100:00100000:0.0:1788574562.258072:0:18881:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727775616 00000100:00100000:0.0:1788574562.258169:0:18881:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 110 00000100:00100000:0.0:1788574562.258322:0:18881:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a785535850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:757865b4-e3c9-47dd-8b09-5caeeb506113+12:16740:x1875455727775616:12345-192.168.201.57@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788574562.258762:0:18881:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a785535850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:757865b4-e3c9-47dd-8b09-5caeeb506113+12:16740:x1875455727775616:12345-192.168.201.57@tcp:501:ll_cfg_requeue.0 Request processed in 441us (1094us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574562.272544:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:3.0:1788574562.272735:0:18879:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727775744 00000100:00100000:3.0:1788574562.272749:0:18879:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727775744 00000100:00100000:0.0:1788574562.273813:0:18881:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 110 00000100:00100000:3.0:1788574562.277117:0:18879:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 111 00000100:00100000:3.0:1788574562.277150:0:18879:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a785536850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:757865b4-e3c9-47dd-8b09-5caeeb506113+12:16740:x1875455727775744:12345-192.168.201.57@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788574562.277499:0:18879:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a785536850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:757865b4-e3c9-47dd-8b09-5caeeb506113+12:16740:x1875455727775744:12345-192.168.201.57@tcp:503:ll_cfg_requeue.0 Request processed in 364us (4972us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574562.277517:0:18879:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 111 10000000:01000000:3.0:1788574562.304498:0:18883:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1788574562.304506:0:18883:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff90a681297000 from 10 10000000:01000000:3.0:1788574562.304513:0:18883:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788574562.304574:0:18883:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.157@tcp lock: ffff90a6824f8a00/0x10531a153b537446 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 18883 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574562.304587:0:18883:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.157@tcp lock: ffff90a6824f8a00/0x10531a153b537446 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 18883 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574562.304599:0:18883:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.157@tcp lock: ffff90a6824f8a00/0x10531a153b537446 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 18883 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788574562.304627:0:18883:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a792458e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:64047b6f-0fa6-4004-9f51-bd636ae04daf:18883:1875455747697280:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788574562.304700:0:18883:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788574562.304759:0:18883:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a7bb7e0a80 going to sleep for 11 seconds 00000100:00100000:0.0:1788574562.304795:0:18881:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747697280 00000100:00100000:0.0:1788574562.304803:0:18881:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747697280 00000100:00100000:0.0:1788574562.304863:0:18881:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:0.0:1788574562.304873:0:18881:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a785536050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:64047b6f-0fa6-4004-9f51-bd636ae04daf+16:18883:x1875455747697280:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788574562.304888:0:18881:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788574562.304904:0:18881:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90a68116a600/0x10531a153b53744d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x10531a153b537446 expref: -99 pid: 18881 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574562.304939:0:18881:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90a68116a600/0x10531a153b53744d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x10531a153b537446 expref: 17 pid: 18881 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574562.304952:0:18881:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90a68116a600/0x10531a153b53744d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x10531a153b537446 expref: 17 pid: 18881 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574562.304961:0:18881:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a68116a600, rc 0) 00000100:00100000:0.0:1788574562.305010:0:18881:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a785536050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:64047b6f-0fa6-4004-9f51-bd636ae04daf+17:18883:x1875455747697280:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 138us (310us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574562.305018:0:18881:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:1.0:1788574562.305060:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:0.0:1788574562.305089:0:18880:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727775872 00000100:00100000:0.0:1788574562.305094:0:18880:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727775872 00000100:00100000:0.0:1788574562.305132:0:18880:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 113 00000100:00100000:0.0:1788574562.305140:0:18880:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a785535c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:757865b4-e3c9-47dd-8b09-5caeeb506113+12:16740:x1875455727775872:12345-192.168.201.57@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788574562.305147:0:18880:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788574562.305169:0:18880:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90a68116a200/0x10531a153b537454 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x1d2563b34cce3dc5 expref: -99 pid: 18880 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574562.305184:0:18880:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90a68116a200/0x10531a153b537454 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce3dc5 expref: 13 pid: 18880 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574562.305192:0:18880:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90a68116a200/0x10531a153b537454 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce3dc5 expref: 13 pid: 18880 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574562.305199:0:18880:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a68116a200, rc 0) 00000100:00100000:0.0:1788574562.305247:0:18880:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a785535c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:757865b4-e3c9-47dd-8b09-5caeeb506113+13:16740:x1875455727775872:12345-192.168.201.57@tcp:101:ll_cfg_requeue.0 Request processed in 108us (191us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574562.305254:0:18880:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 113 00000100:00100000:3.0:1788574562.307807:0:18883:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a792458e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:64047b6f-0fa6-4004-9f51-bd636ae04daf:18883:1875455747697280:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788574562.307843:0:18883:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.157@tcp lock: ffff90a6824f8a00/0x10531a153b537446 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x10531a153b53744d expref: -99 pid: 18883 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574562.307885:0:18883:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.157@tcp lock: ffff90a6824f8a00/0x10531a153b537446 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x10531a153b53744d expref: -99 pid: 18883 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788574562.308013:0:18883:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a792458e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:64047b6f-0fa6-4004-9f51-bd636ae04daf:18883:1875455747697408:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788574562.308079:0:18883:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788574562.308134:0:18883:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a7bb7e0a80 going to sleep for 11 seconds 00000100:00100000:3.0:1788574562.308160:0:18879:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747697408 00000100:00100000:3.0:1788574562.308166:0:18879:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747697408 00000100:00100000:3.0:1788574562.308220:0:18879:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:3.0:1788574562.308229:0:18879:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a79e7eb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:64047b6f-0fa6-4004-9f51-bd636ae04daf+17:18883:x1875455747697408:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788574562.309015:0:18879:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a79e7eb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:64047b6f-0fa6-4004-9f51-bd636ae04daf+17:18883:x1875455747697408:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 779us (928us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574562.309027:0:18879:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:1.0:1788574562.313343:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:2.0:1788574562.313630:0:18881:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727776000 00000100:00100000:2.0:1788574562.313646:0:18881:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727776000 00000100:00100000:2.0:1788574562.313728:0:18881:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 115 00000100:00100000:2.0:1788574562.313742:0:18881:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a79e7eb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:757865b4-e3c9-47dd-8b09-5caeeb506113+13:16740:x1875455727776000:12345-192.168.201.57@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788574562.314312:0:18881:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a79e7eb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:757865b4-e3c9-47dd-8b09-5caeeb506113+13:16740:x1875455727776000:12345-192.168.201.57@tcp:501:ll_cfg_requeue.0 Request processed in 570us (999us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574562.314323:0:18881:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 115 00000100:00100000:0.0:1788574562.322635:0:18883:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a792458e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:64047b6f-0fa6-4004-9f51-bd636ae04daf:18883:1875455747697408:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788574562.322738:0:18883:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a78e0e9f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:64047b6f-0fa6-4004-9f51-bd636ae04daf:18883:1875455747697536:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788574562.322843:0:18883:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788574562.322934:0:18883:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a7bb7e0a80 going to sleep for 11 seconds 00000100:00100000:3.0:1788574562.336099:0:18879:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747697536 00000100:00100000:3.0:1788574562.336115:0:18879:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747697536 00000100:00100000:3.0:1788574562.336179:0:18879:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:3.0:1788574562.336191:0:18879:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a79e7e9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:64047b6f-0fa6-4004-9f51-bd636ae04daf+17:18883:x1875455747697536:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788574562.336202:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:3.0:1788574562.336506:0:18879:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a79e7e9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:64047b6f-0fa6-4004-9f51-bd636ae04daf+17:18883:x1875455747697536:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 317us (13662us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574562.336516:0:18879:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:3.0:1788574562.336565:0:18879:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727776128 00000100:00100000:3.0:1788574562.336571:0:18879:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727776128 00000100:00100000:3.0:1788574562.336591:0:18879:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 117 00000100:00100000:2.0:1788574562.336594:0:18883:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a78e0e9f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:64047b6f-0fa6-4004-9f51-bd636ae04daf:18883:1875455747697536:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788574562.336601:0:18879:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a79e7e9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:757865b4-e3c9-47dd-8b09-5caeeb506113+13:16740:x1875455727776128:12345-192.168.201.57@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788574562.336718:0:18879:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a79e7e9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:757865b4-e3c9-47dd-8b09-5caeeb506113+13:16740:x1875455727776128:12345-192.168.201.57@tcp:503:ll_cfg_requeue.0 Request processed in 117us (519us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574562.336734:0:18879:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 117 00000040:00080000:2.0:1788574562.337300:0:21032:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:3.0:1788574562.337431:0:18883:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:3.0:1788574562.337459:0:18883:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.157@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788574562.337470:0:18883:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.157@tcp lock: ffff90a6824f8a00/0x10531a153b537446 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x10531a153b53744d expref: -99 pid: 18883 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574562.337482:0:18883:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.157@tcp lock: ffff90a6824f8a00/0x10531a153b537446 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x10531a153b53744d expref: -99 pid: 18883 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788574562.337493:0:18883:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1788574562.337496:0:18883:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff90a7a773a000 from 10 10000000:01000000:3.0:1788574562.337499:0:18883:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788574562.337532:0:18883:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.157@tcp lock: ffff90a6824f9000/0x10531a153b53745b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 18883 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574562.337540:0:18883:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.157@tcp lock: ffff90a6824f9000/0x10531a153b53745b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 18883 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574562.337559:0:18883:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.157@tcp lock: ffff90a6824f9000/0x10531a153b53745b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 18883 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788574562.337589:0:18883:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a792459880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:64047b6f-0fa6-4004-9f51-bd636ae04daf:18883:1875455747697664:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788574562.337637:0:18883:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788574562.337685:0:18883:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a797d74c00 going to sleep for 11 seconds 00000100:00100000:0.0:1788574562.337776:0:18880:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747697664 00000100:00100000:0.0:1788574562.337783:0:18880:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747697664 00000100:00100000:0.0:1788574562.337809:0:18880:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:0.0:1788574562.337816:0:18880:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a79e7eac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:64047b6f-0fa6-4004-9f51-bd636ae04daf+17:18883:x1875455747697664:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788574562.337827:0:18880:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788574562.337841:0:18880:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90a68116a400/0x10531a153b537462 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x10531a153b53745b expref: -99 pid: 18880 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574562.337864:0:18880:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90a68116a400/0x10531a153b537462 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x10531a153b53745b expref: 18 pid: 18880 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574562.337892:0:18880:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90a68116a400/0x10531a153b537462 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x10531a153b53745b expref: 18 pid: 18880 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574562.337902:0:18880:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a68116a400, rc 0) 00000100:00100000:0.0:1788574562.337943:0:18880:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a79e7eac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:64047b6f-0fa6-4004-9f51-bd636ae04daf+18:18883:x1875455747697664:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 127us (305us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574562.337949:0:18880:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:3.0:1788574562.338038:0:18883:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a792459880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:64047b6f-0fa6-4004-9f51-bd636ae04daf:18883:1875455747697664:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788574562.338052:0:18883:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.157@tcp lock: ffff90a6824f9000/0x10531a153b53745b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x10531a153b537462 expref: -99 pid: 18883 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574562.338071:0:18883:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.157@tcp lock: ffff90a6824f9000/0x10531a153b53745b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x10531a153b537462 expref: -99 pid: 18883 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788574562.338120:0:18883:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a792459880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:64047b6f-0fa6-4004-9f51-bd636ae04daf:18883:1875455747697792:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788574562.338145:0:18883:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788574562.338167:0:18883:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a797d74c00 going to sleep for 11 seconds 00000100:00100000:1.0:1788574562.338359:0:18881:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747697792 00000100:00100000:1.0:1788574562.338363:0:18881:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747697792 00000100:00100000:1.0:1788574562.338400:0:18881:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:1.0:1788574562.338406:0:18881:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a79e7e8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:64047b6f-0fa6-4004-9f51-bd636ae04daf+18:18883:x1875455747697792:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788574562.338655:0:18881:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a79e7e8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:64047b6f-0fa6-4004-9f51-bd636ae04daf+18:18883:x1875455747697792:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 248us (508us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574562.338663:0:18881:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00100000:3.0:1788574562.340531:0:18883:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a792459880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:64047b6f-0fa6-4004-9f51-bd636ae04daf:18883:1875455747697792:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788574562.340610:0:18883:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a792459880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:64047b6f-0fa6-4004-9f51-bd636ae04daf:18883:1875455747697920:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788574562.340681:0:18883:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788574562.340795:0:18883:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a797d74c00 going to sleep for 11 seconds 00000100:00100000:1.0:1788574562.349923:0:18881:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747697920 00000100:00100000:1.0:1788574562.349938:0:18881:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747697920 00000100:00100000:1.0:1788574562.350014:0:18881:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:1.0:1788574562.350026:0:18881:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a79e7ea850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:64047b6f-0fa6-4004-9f51-bd636ae04daf+18:18883:x1875455747697920:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788574562.350277:0:18881:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a79e7ea850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:64047b6f-0fa6-4004-9f51-bd636ae04daf+18:18883:x1875455747697920:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 253us (9595us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574562.350285:0:18881:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00100000:2.0:1788574562.350430:0:18883:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a792459880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:64047b6f-0fa6-4004-9f51-bd636ae04daf:18883:1875455747697920:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1788574562.354353:0:21033:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:2.0:1788574562.356010:0:18883:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:2.0:1788574562.356051:0:18883:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.157@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788574562.356064:0:18883:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.157@tcp lock: ffff90a6824f9000/0x10531a153b53745b lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x10531a153b537462 expref: -99 pid: 18883 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574562.356086:0:18883:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.157@tcp lock: ffff90a6824f9000/0x10531a153b53745b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x10531a153b537462 expref: -99 pid: 18883 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788574562.356101:0:18883:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1788574562.356105:0:18883:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff90a79fbec800 from 10 10000000:01000000:2.0:1788574562.356107:0:18883:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788574562.356156:0:18883:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.157@tcp lock: ffff90a7a7ac9e00/0x10531a153b537469 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 18883 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574562.356164:0:18883:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.157@tcp lock: ffff90a7a7ac9e00/0x10531a153b537469 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 18883 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574562.356175:0:18883:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.157@tcp lock: ffff90a7a7ac9e00/0x10531a153b537469 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 18883 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788574562.356203:0:18883:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a79b052300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:64047b6f-0fa6-4004-9f51-bd636ae04daf:18883:1875455747698048:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788574562.356304:0:18883:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788574562.356396:0:18883:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a7bb7e0a80 going to sleep for 11 seconds 00000100:00100000:3.0:1788574562.357274:0:18879:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747698048 00000100:00100000:3.0:1788574562.357286:0:18879:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747698048 00000100:00100000:3.0:1788574562.357360:0:18879:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:3.0:1788574562.357398:0:18879:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a79e7e8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:64047b6f-0fa6-4004-9f51-bd636ae04daf+18:18883:x1875455747698048:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788574562.357417:0:18879:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788574562.357437:0:18879:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90a6824f8400/0x10531a153b537470 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x10531a153b537469 expref: -99 pid: 18879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574562.357471:0:18879:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90a6824f8400/0x10531a153b537470 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x10531a153b537469 expref: 19 pid: 18879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574562.357483:0:18879:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90a6824f8400/0x10531a153b537470 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x10531a153b537469 expref: 19 pid: 18879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574562.357492:0:18879:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a6824f8400, rc 0) 00000100:00100000:3.0:1788574562.357573:0:18879:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a79e7e8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:64047b6f-0fa6-4004-9f51-bd636ae04daf+19:18883:x1875455747698048:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 178us (1268us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574562.357592:0:18879:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00100000:2.0:1788574562.357745:0:18883:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a79b052300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:64047b6f-0fa6-4004-9f51-bd636ae04daf:18883:1875455747698048:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788574562.357770:0:18883:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.157@tcp lock: ffff90a7a7ac9e00/0x10531a153b537469 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x10531a153b537470 expref: -99 pid: 18883 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574562.357782:0:18883:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.157@tcp lock: ffff90a7a7ac9e00/0x10531a153b537469 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x10531a153b537470 expref: -99 pid: 18883 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788574562.357890:0:18883:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a79b052300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:64047b6f-0fa6-4004-9f51-bd636ae04daf:18883:1875455747698176:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788574562.357940:0:18883:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788574562.357977:0:18883:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a7bb7e0a80 going to sleep for 11 seconds 00000100:00100000:3.0:1788574562.358309:0:18880:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747698176 00000100:00100000:3.0:1788574562.358315:0:18880:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747698176 00000100:00100000:3.0:1788574562.358365:0:18880:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:3.0:1788574562.358392:0:18880:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a79e7ea050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:64047b6f-0fa6-4004-9f51-bd636ae04daf+19:18883:x1875455747698176:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788574562.358795:0:18880:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a79e7ea050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:64047b6f-0fa6-4004-9f51-bd636ae04daf+19:18883:x1875455747698176:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 404us (854us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574562.358803:0:18880:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00100000:2.0:1788574562.363238:0:18883:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a79b052300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:64047b6f-0fa6-4004-9f51-bd636ae04daf:18883:1875455747698176:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788574562.363328:0:18883:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a79b052300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:64047b6f-0fa6-4004-9f51-bd636ae04daf:18883:1875455747698304:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788574562.363463:0:18883:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788574562.363523:0:18883:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a7bb7e0a80 going to sleep for 11 seconds 00000100:00100000:3.0:1788574562.364179:0:18879:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747698304 00000100:00100000:3.0:1788574562.364189:0:18879:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747698304 00000100:00100000:3.0:1788574562.364250:0:18879:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:3.0:1788574562.364260:0:18879:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a79e7e9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:64047b6f-0fa6-4004-9f51-bd636ae04daf+19:18883:x1875455747698304:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788574562.364527:0:18879:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a79e7e9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:64047b6f-0fa6-4004-9f51-bd636ae04daf+19:18883:x1875455747698304:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 267us (1064us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574562.364534:0:18879:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00100000:2.0:1788574562.364972:0:18883:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a79b052300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:64047b6f-0fa6-4004-9f51-bd636ae04daf:18883:1875455747698304:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1788574562.368586:0:21034:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:3.0:1788574562.368946:0:18883:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:3.0:1788574562.368972:0:18883:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.157@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788574562.368984:0:18883:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.157@tcp lock: ffff90a7a7ac9e00/0x10531a153b537469 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x10531a153b537470 expref: -99 pid: 18883 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574562.368995:0:18883:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.157@tcp lock: ffff90a7a7ac9e00/0x10531a153b537469 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x10531a153b537470 expref: -99 pid: 18883 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788574562.614322:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:1.0:1788574562.614489:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:1.0:1788574562.614512:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:2.0:1788574562.614576:0:18887:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727776640 00000100:00100000:2.0:1788574562.614586:0:18887:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727776640 00000100:00100000:2.0:1788574562.614666:0:18887:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 31 00000100:00100000:2.0:1788574562.614676:0:18887:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7a7846300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a406b67b-30f6-4346-815d-0b22929077a2+6:2353:x1875455727776640:12345-192.168.201.57@tcp:400:kworker.0 00000100:00100000:2.0:1788574562.614772:0:18887:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7a7846300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a406b67b-30f6-4346-815d-0b22929077a2+6:2353:x1875455727776640:12345-192.168.201.57@tcp:400:kworker.0 Request processed in 97us (286us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574562.614779:0:18887:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 31 00000100:00080000:3.0:1788574562.618279:0:18882:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788574562.623094:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:1.0:1788574562.623128:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:2.0:1788574562.623208:0:18886:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727776256 00000100:00100000:2.0:1788574562.623221:0:18886:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727776256 00000100:00100000:2.0:1788574562.623294:0:18886:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 32 00000100:00100000:2.0:1788574562.623305:0:18886:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7a7844000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0ef7cddc-b831-4237-948c-b4fc5b50b382+6:2353:x1875455727776256:12345-192.168.201.57@tcp:400:kworker.0 00000100:00100000:2.0:1788574562.623415:0:18886:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7a7844000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0ef7cddc-b831-4237-948c-b4fc5b50b382+6:2353:x1875455727776256:12345-192.168.201.57@tcp:400:kworker.0 Request processed in 111us (350us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574562.623423:0:18886:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 32 00000100:00080000:2.0:1788574562.623473:0:18882:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788574562.624626:0:20780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727776384 00000100:00100000:0.0:1788574562.624642:0:20780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727776384 00000100:00100000:0.0:1788574562.624782:0:20780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727776896 00000100:00100000:0.0:1788574562.624787:0:20780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727776896 00000100:00100000:0.0:1788574562.624832:0:20780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 15 00000100:00100000:0.0:1788574562.624846:0:20780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7a7847100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0ef7cddc-b831-4237-948c-b4fc5b50b382+5:2353:x1875455727776384:12345-192.168.201.57@tcp:400:kworker.0 00000100:00100000:0.0:1788574562.624933:0:20780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7a7847100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0ef7cddc-b831-4237-948c-b4fc5b50b382+5:2353:x1875455727776384:12345-192.168.201.57@tcp:400:kworker.0 Request processed in 91us (10623us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574562.624941:0:20780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 15 00000100:00080000:2.0:1788574562.624947:0:18882:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788574562.624951:0:18882:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788574562.624956:0:20780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 16 00000100:00100000:0.0:1788574562.624963:0:20780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7a7845180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a406b67b-30f6-4346-815d-0b22929077a2+5:2353:x1875455727776896:12345-192.168.201.57@tcp:400:kworker.0 00000100:00100000:0.0:1788574562.624986:0:20780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7a7845180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a406b67b-30f6-4346-815d-0b22929077a2+5:2353:x1875455727776896:12345-192.168.201.57@tcp:400:kworker.0 Request processed in 24us (10472us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574562.624993:0:20780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 16 00000100:00100000:1.0:1788574562.626274:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:0.0:1788574562.626856:0:20780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727776512 00000100:00100000:0.0:1788574562.626871:0:20780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727776512 00000100:00100000:0.0:1788574562.626949:0:20780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727776768 00000100:00100000:0.0:1788574562.626953:0:20780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727776768 00000100:00100000:0.0:1788574562.626972:0:20780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 17 00000100:00100000:0.0:1788574562.626995:0:20780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7a7847480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0ef7cddc-b831-4237-948c-b4fc5b50b382+5:2353:x1875455727776512:12345-192.168.201.57@tcp:400:kworker.0 00000100:00100000:0.0:1788574562.627066:0:20780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7a7847480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0ef7cddc-b831-4237-948c-b4fc5b50b382+5:2353:x1875455727776512:12345-192.168.201.57@tcp:400:kworker.0 Request processed in 73us (3938us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574562.627084:0:20780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 17 00000100:00100000:0.0:1788574562.627101:0:20780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 18 00000100:00100000:0.0:1788574562.627107:0:20780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7a7845500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a406b67b-30f6-4346-815d-0b22929077a2+5:2353:x1875455727776768:12345-192.168.201.57@tcp:400:kworker.0 00000100:00100000:0.0:1788574562.627136:0:20780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7a7845500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a406b67b-30f6-4346-815d-0b22929077a2+5:2353:x1875455727776768:12345-192.168.201.57@tcp:400:kworker.0 Request processed in 28us (871us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574562.627143:0:20780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 18 00000100:00080000:1.0:1788574562.627750:0:18882:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788574562.627757:0:18882:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788574562.866188:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:2.0:1788574562.875053:0:18887:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727777024 00000100:00100000:2.0:1788574562.875157:0:18887:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727777024 00000100:00100000:2.0:1788574562.875612:0:18887:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 15 00000100:00100000:3.0:1788574562.875756:0:18887:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a78e0e8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0ef7cddc-b831-4237-948c-b4fc5b50b382+6:17353:x1875455727777024:12345-192.168.201.57@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788574562.875907:0:18887:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788574562.875958:0:18887:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a6824f9600/0x10531a153b537477 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1d2563b34cce3dcc expref: -99 pid: 18887 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574562.876178:0:18887:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a6824f9e00/0x10531a153b53747e lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 18887 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574562.876197:0:18887:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a6824f9e00/0x10531a153b53747e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 18887 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574562.876213:0:18887:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a6824f9e00/0x10531a153b53747e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 18887 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574562.876231:0:18887:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a6824f9a00/0x10531a153b537485 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 18887 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574562.876238:0:18887:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a6824f9a00/0x10531a153b537485 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18887 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574562.876245:0:18887:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a6824f9a00/0x10531a153b537485 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 18887 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574562.877037:0:18887:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a6824f8200/0x10531a153b53748c lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 18887 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574562.877056:0:18887:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a6824f8200/0x10531a153b53748c lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18887 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574562.877065:0:18887:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a6824f8200/0x10531a153b53748c lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 18887 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788574562.877175:0:18887:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 16384 00000004:00200000:3.0:1788574562.877180:0:18887:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1788574562.877224:0:18887:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90a6824f8200/0x10531a153b53748c lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 18887 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574562.877244:0:18887:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a6824f9e00/0x10531a153b53747e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 18887 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574562.877251:0:18887:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a6824f9e00/0x10531a153b53747e lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 18887 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574562.877258:0:18887:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a6824f9e00/0x10531a153b53747e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 18887 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574562.877264:0:18887:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a6824f9e00 already unused, calling callback (ffffffffc1fe34f0) 00010000:00010000:3.0:1788574562.877269:0:18887:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a6824f9e00/0x10531a153b53747e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 18887 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574562.877277:0:18887:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a6824f9e00/0x10531a153b53747e lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 18887 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574562.877290:0:18887:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90a79b397300) 00010000:00010000:3.0:1788574562.877292:0:18887:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788574562.877298:0:18887:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a6824f9e00/0x10531a153b53747e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 18887 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574562.877304:0:18887:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a6824f9e00/0x10531a153b53747e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 18887 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574562.877318:0:18887:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a6824f9a00/0x10531a153b537485 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18887 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574562.877325:0:18887:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a6824f9a00/0x10531a153b537485 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 18887 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574562.877660:0:18887:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a6824f9a00/0x10531a153b537485 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 18887 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574562.877673:0:18887:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a6824f9a00 already unused, calling callback (ffffffffc1fe34f0) 00010000:00010000:3.0:1788574562.877677:0:18887:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a6824f9a00/0x10531a153b537485 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 18887 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574562.877684:0:18887:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a6824f9a00/0x10531a153b537485 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 18887 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574562.877694:0:18887:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff90a79b397000) 00010000:00010000:3.0:1788574562.877697:0:18887:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788574562.877700:0:18887:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a6824f9a00/0x10531a153b537485 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 18887 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574562.877707:0:18887:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a6824f9a00/0x10531a153b537485 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 18887 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574562.877752:0:18887:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a6824f9600/0x10531a153b537477 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce3dcc expref: 8 pid: 18887 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574562.877768:0:18887:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90a6824f8200/0x10531a153b53748c lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce3dcc expref: 7 pid: 18887 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574562.877776:0:18887:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff90a79b397200) 00010000:00010000:3.0:1788574562.877778:0:18887:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788574562.877792:0:18887:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a6824f8200, rc 0) 00000100:00100000:3.0:1788574562.877893:0:18887:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a78e0e8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0ef7cddc-b831-4237-948c-b4fc5b50b382+7:17353:x1875455727777024:12345-192.168.201.57@tcp:101:lhsmtool_posix.0 Request processed in 2269us (11719us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574562.877904:0:18887:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 15 00000100:00100000:0.0:1788574562.889413:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:2.0:1788574562.889730:0:18886:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727777280 00000100:00100000:2.0:1788574562.889745:0:18886:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727777280 00000100:00100000:2.0:1788574562.889830:0:18886:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 16 00000100:00100000:2.0:1788574562.889842:0:18886:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a78e0e8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0ef7cddc-b831-4237-948c-b4fc5b50b382+7:17353:x1875455727777280:12345-192.168.201.57@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788574562.889866:0:18886:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788574562.889896:0:18886:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a7a7ac8200/0x10531a153b537493 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1d2563b34cce3dd3 expref: -99 pid: 18886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574562.889994:0:18886:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7a7ac9400/0x10531a153b53749a lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 18886 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574562.890013:0:18886:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a7a7ac9400/0x10531a153b53749a lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 18886 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574562.890029:0:18886:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a7a7ac9400/0x10531a153b53749a lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 18886 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574562.890119:0:18886:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7a7ac8400/0x10531a153b5374a1 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 18886 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574562.890129:0:18886:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a7a7ac8400/0x10531a153b5374a1 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18886 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574562.890136:0:18886:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a7a7ac8400/0x10531a153b5374a1 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 18886 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574562.891962:0:18886:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7a7ac9800/0x10531a153b5374a8 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 18886 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574562.891993:0:18886:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a7a7ac9800/0x10531a153b5374a8 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18886 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574562.892008:0:18886:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a7a7ac9800/0x10531a153b5374a8 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 18886 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788574562.892026:0:18886:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 16384 00010000:00010000:2.0:1788574562.892402:0:18886:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7a7ac9400/0x10531a153b53749a lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 18886 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574562.892411:0:18886:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a7a7ac9400/0x10531a153b53749a lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 18886 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574562.892418:0:18886:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a7a7ac9400/0x10531a153b53749a lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 18886 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574562.892424:0:18886:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a7a7ac9400 already unused, calling callback (ffffffffc1fe34f0) 00010000:00010000:2.0:1788574562.892429:0:18886:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a7a7ac9400/0x10531a153b53749a lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 18886 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574562.892448:0:18886:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a7a7ac9400/0x10531a153b53749a lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 18886 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574562.892465:0:18886:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff90a79b397200) 00010000:00010000:2.0:1788574562.892468:0:18886:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788574562.892474:0:18886:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a7a7ac9400/0x10531a153b53749a lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 18886 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574562.893422:0:18886:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a7a7ac9400/0x10531a153b53749a lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 18886 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574562.893443:0:18886:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7a7ac8400/0x10531a153b5374a1 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18886 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574562.893449:0:18886:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a7a7ac8400/0x10531a153b5374a1 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 18886 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574562.893456:0:18886:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a7a7ac8400/0x10531a153b5374a1 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 18886 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574562.893461:0:18886:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a7a7ac8400 already unused, calling callback (ffffffffc1fe34f0) 00010000:00010000:2.0:1788574562.893473:0:18886:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a7a7ac8400/0x10531a153b5374a1 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 18886 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574562.893552:0:18886:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a7a7ac8400/0x10531a153b5374a1 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 18886 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574562.893566:0:18886:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff90a791e2f700) 00010000:00010000:2.0:1788574562.893569:0:18886:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788574562.893574:0:18886:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a7a7ac8400/0x10531a153b5374a1 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 18886 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574562.893597:0:18886:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a7a7ac8400/0x10531a153b5374a1 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 18886 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574562.894326:0:18886:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a7a7ac8200/0x10531a153b537493 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce3dd3 expref: 10 pid: 18886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574562.894346:0:18886:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7a7ac9800/0x10531a153b5374a8 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce3dd3 expref: 9 pid: 18886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574562.894354:0:18886:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff90a791e2f000) 00010000:00010000:2.0:1788574562.894356:0:18886:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788574562.894359:0:18886:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a7a7ac9800, rc 0) 00000100:00100000:2.0:1788574562.894969:0:18886:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a78e0e8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0ef7cddc-b831-4237-948c-b4fc5b50b382+9:17353:x1875455727777280:12345-192.168.201.57@tcp:101:lhsmtool_posix.0 Request processed in 5125us (5561us total) trans 12884901889 rc 0/0 00000100:00100000:2.0:1788574562.894981:0:18886:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 16 00000100:00100000:1.0:1788574562.906318:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:0.0:1788574562.906778:0:18888:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727777408 00000100:00100000:0.0:1788574562.906789:0:18888:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727777408 00000100:00100000:0.0:1788574562.906912:0:18888:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 17 00000100:00100000:0.0:1788574562.906925:0:18888:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7a72b9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0ef7cddc-b831-4237-948c-b4fc5b50b382+9:17353:x1875455727777408:12345-192.168.201.57@tcp:59:lhsmtool_posix.0 00000100:00100000:0.0:1788574562.907084:0:18888:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7a72b9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0ef7cddc-b831-4237-948c-b4fc5b50b382+9:17353:x1875455727777408:12345-192.168.201.57@tcp:59:lhsmtool_posix.0 Request processed in 160us (779us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574562.907093:0:18888:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 17 00000100:00100000:1.0:1788574562.937580:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:0.0:1788574562.938109:0:20773:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727777536 00000100:00100000:0.0:1788574562.938123:0:20773:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727777536 00000100:00100000:0.0:1788574562.938189:0:20773:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 18 00000100:00100000:0.0:1788574562.938199:0:20773:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7a72bb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0ef7cddc-b831-4237-948c-b4fc5b50b382+9:17359:x1875455727777536:12345-192.168.201.57@tcp:101:lfs.0 00010000:00010000:0.0:1788574562.938220:0:20773:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788574562.938249:0:20773:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a68116be00/0x10531a153b5374b6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1d2563b34cce3dda expref: -99 pid: 20773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574562.938430:0:20773:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a68116b800/0x10531a153b5374bd lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 20773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574562.938448:0:20773:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a68116b800/0x10531a153b5374bd lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 20773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574562.938460:0:20773:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a68116b800/0x10531a153b5374bd lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 20773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574562.938498:0:20773:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a68116a000/0x10531a153b5374c4 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 20773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574562.938506:0:20773:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a68116a000/0x10531a153b5374c4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 20773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574562.938513:0:20773:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a68116a000/0x10531a153b5374c4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 20773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574562.938766:0:20773:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a68116b800/0x10531a153b5374bd lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 20773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574562.938775:0:20773:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a68116b800/0x10531a153b5374bd lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 20773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574562.938792:0:20773:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a68116b800/0x10531a153b5374bd lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 20773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574562.938799:0:20773:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a68116b800 already unused, calling callback (ffffffffc1fe34f0) 00010000:00010000:0.0:1788574562.938803:0:20773:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a68116b800/0x10531a153b5374bd lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 20773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574562.938822:0:20773:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a68116b800/0x10531a153b5374bd lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 20773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574562.938836:0:20773:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90a79b397300) 00010000:00010000:0.0:1788574562.938839:0:20773:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788574562.938855:0:20773:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a68116b800/0x10531a153b5374bd lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 20773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574562.938862:0:20773:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a68116b800/0x10531a153b5374bd lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 20773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574562.938877:0:20773:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a68116a000/0x10531a153b5374c4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 20773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574562.938884:0:20773:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a68116a000/0x10531a153b5374c4 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 20773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574562.938890:0:20773:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a68116a000/0x10531a153b5374c4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 20773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574562.938894:0:20773:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a68116a000 already unused, calling callback (ffffffffc1fe34f0) 00010000:00010000:0.0:1788574562.938896:0:20773:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a68116a000/0x10531a153b5374c4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 20773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574562.938902:0:20773:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a68116a000/0x10531a153b5374c4 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 20773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574562.938910:0:20773:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa6028a67 (ffff90a797af6200) 00010000:00010000:0.0:1788574562.938913:0:20773:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788574562.938915:0:20773:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a68116a000/0x10531a153b5374c4 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 20773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574562.938933:0:20773:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a68116a000/0x10531a153b5374c4 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 20773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574562.938970:0:20773:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90a68116be00/0x10531a153b5374b6 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce3dda expref: 10 pid: 20773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574562.938981:0:20773:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90a79b397300) 00010000:00010000:0.0:1788574562.938983:0:20773:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788574562.938987:0:20773:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a68116be00/0x10531a153b5374b6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce3dda expref: 10 pid: 20773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574562.938996:0:20773:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a68116be00, rc 0) 00000100:00100000:0.0:1788574562.939060:0:20773:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7a72bb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0ef7cddc-b831-4237-948c-b4fc5b50b382+9:17359:x1875455727777536:12345-192.168.201.57@tcp:101:lfs.0 Request processed in 862us (1491us total) trans 0 rc 301/301 00000100:00100000:0.0:1788574562.939068:0:20773:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 18 00000100:00100000:2.0:1788574562.946620:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:0.0:1788574562.946842:0:18895:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727777664 00000100:00100000:0.0:1788574562.946856:0:18895:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727777664 00000100:00100000:0.0:1788574562.946954:0:18895:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 0 00000100:00100000:0.0:1788574562.946966:0:18895:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a79b052300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:0ef7cddc-b831-4237-948c-b4fc5b50b382+9:17359:x1875455727777664:12345-192.168.201.57@tcp:700:lfs.0 00000100:00100000:0.0:1788574562.947055:0:18895:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a79b052300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:0ef7cddc-b831-4237-948c-b4fc5b50b382+9:17359:x1875455727777664:12345-192.168.201.57@tcp:700:lfs.0 Request processed in 90us (441us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574562.947062:0:18895:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 0 00000100:00100000:1.0:1788574562.952351:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:0.0:1788574562.952616:0:18888:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727777920 00000100:00100000:0.0:1788574562.952626:0:18888:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727777920 00000100:00100000:0.0:1788574562.952687:0:18888:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 19 00000100:00100000:0.0:1788574562.952699:0:18888:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7a72b8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0ef7cddc-b831-4237-948c-b4fc5b50b382+9:17359:x1875455727777920:12345-192.168.201.57@tcp:36:lfs.0 00010000:00010000:0.0:1788574562.952779:0:18888:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788574562.952813:0:18888:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a6824f9800/0x10531a153b5373f9 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce3d55 expref: 9 pid: 18886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574562.952847:0:18888:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90a79b397300) 00010000:00010000:0.0:1788574562.952855:0:18888:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788574562.953134:0:18888:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90a68116be00/0x10531a153b5374cb lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 18888 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574562.953152:0:18888:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90a790a21200/0x10531a153b537431 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce3db7 expref: 5 pid: 18887 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574562.953162:0:18888:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a68116be00/0x10531a153b5374cb lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 18888 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574562.953212:0:18888:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90a790a21200/0x10531a153b537431 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce3db7 expref: 5 pid: 18887 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574562.953230:0:18888:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90a790a21200/0x10531a153b537431 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce3db7 expref: 5 pid: 18887 timeout: 789 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788574562.953250:0:18888:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a78e0ea680 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:18888:1875455747698432:192.168.201.57@tcp:104: 00000100:00100000:0.0:1788574562.953965:0:18888:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a7933f89c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788574562.956294:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:3.0:1788574562.956404:0:18873:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727778048 00000100:00100000:3.0:1788574562.956441:0:18873:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727778048 00010000:00010000:3.0:1788574562.956646:0:18873:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a790a21200/0x10531a153b537431 lrc: 5/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce3db7 expref: 6 pid: 18887 timeout: 789 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788574562.956695:0:18873:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 9 00000100:00100000:3.0:1788574562.956705:0:18873:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7a72baa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a406b67b-30f6-4346-815d-0b22929077a2+6:2355:x1875455727778048:12345-192.168.201.57@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788574562.956725:0:18873:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788574562.956733:0:18873:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90a790a21200/0x10531a153b537431 lrc: 5/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce3db7 expref: 6 pid: 18887 timeout: 789 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574562.956749:0:18873:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90a790a21200/0x10531a153b537431 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce3db7 expref: 6 pid: 18887 timeout: 789 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574562.956777:0:18873:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90a79b397300) 00010000:00010000:3.0:1788574562.956784:0:18873:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff90a68116be00/0x10531a153b5374cb lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 18888 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574562.956795:0:18873:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90a68116be00/0x10531a153b5374cb lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 18888 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574562.956805:0:18873:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a68116be00/0x10531a153b5374cb lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 18888 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574562.956830:0:18873:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788574562.956890:0:18873:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7a72baa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a406b67b-30f6-4346-815d-0b22929077a2+6:2355:x1875455727778048:12345-192.168.201.57@tcp:103:ldlm_bl.0 Request processed in 186us (607us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574562.956896:0:18873:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 9 00010000:00010000:0.0:1788574562.957436:0:18888:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a790a21200/0x10531a153b537431 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce3db7 expref: 5 pid: 18887 timeout: 789 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788574562.957461:0:18888:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a78e0ea680 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:18888:1875455747698432:192.168.201.57@tcp:104: 00010000:00010000:0.0:1788574562.957499:0:18888:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90a68116be00/0x10531a153b5374cb lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 18888 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574562.957520:0:18888:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90a68116be00/0x10531a153b5374cb lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 18888 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574562.957527:0:18888:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a68116be00/0x10531a153b5374cb lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 18888 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574562.957566:0:18888:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90a68116a000/0x10531a153b5374d2 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 18888 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574562.957577:0:18888:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a68116a000/0x10531a153b5374d2 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18888 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574562.957586:0:18888:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a68116a000/0x10531a153b5374d2 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 18888 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788574562.959122:0:18888:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 16384 00010000:00010000:0.0:1788574562.959139:0:18888:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90a68116be00/0x10531a153b5374cb lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18888 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574562.959149:0:18888:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a68116be00/0x10531a153b5374cb lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 18888 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574562.959156:0:18888:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a68116be00/0x10531a153b5374cb lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 18888 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574562.959162:0:18888:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a68116be00 already unused, calling callback (ffffffffc1fe34f0) 00010000:00010000:0.0:1788574562.959166:0:18888:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a68116be00/0x10531a153b5374cb lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 18888 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574562.959174:0:18888:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a68116be00/0x10531a153b5374cb lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 18888 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574562.959200:0:18888:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90a79b397300) 00010000:00010000:0.0:1788574562.959203:0:18888:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788574562.959208:0:18888:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a68116be00/0x10531a153b5374cb lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 18888 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574562.959215:0:18888:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a68116be00/0x10531a153b5374cb lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 18888 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788574562.959239:0:18888:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000049e8980d reply state 00000000bbd32769 transno 12884901890 ns: mdt-lustre-MDT0000_UUID lock: ffff90a68116a000/0x10531a153b5374d2 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 18888 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788574562.959248:0:18888:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788574562.959403:0:18888:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7a72b8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0ef7cddc-b831-4237-948c-b4fc5b50b382+10:17359:x1875455727777920:12345-192.168.201.57@tcp:36:lfs.0 Request processed in 6703us (7060us total) trans 12884901890 rc 0/0 00000100:00100000:0.0:1788574562.959412:0:18888:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 19 00010000:00010000:3.0:1788574562.961625:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90a68116a000/0x10531a153b5374d2 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18888 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574562.961662:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a68116a000/0x10531a153b5374d2 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 18888 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574562.961670:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a68116a000/0x10531a153b5374d2 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 18888 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574562.961676:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a68116a000 already unused, calling callback (ffffffffc1fe34f0) 00010000:00010000:3.0:1788574562.961682:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a68116a000/0x10531a153b5374d2 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 18888 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574562.961690:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a68116a000/0x10531a153b5374d2 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 18888 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574562.961710:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa6028a67 (ffff90a797af6200) 00010000:00010000:3.0:1788574562.961713:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788574562.961718:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a68116a000/0x10531a153b5374d2 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 18888 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574562.961725:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a68116a000/0x10531a153b5374d2 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 18888 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788574563.059895:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:0.0:1788574563.060081:0:20773:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727778176 00000100:00100000:0.0:1788574563.060093:0:20773:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727778176 00000100:00100000:0.0:1788574563.060151:0:20773:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 20 00000100:00100000:0.0:1788574563.060162:0:20773:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7a72b9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0ef7cddc-b831-4237-948c-b4fc5b50b382+9:17367:x1875455727778176:12345-192.168.201.57@tcp:101:lctl.0 00010000:00010000:0.0:1788574563.060189:0:20773:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788574563.060215:0:20773:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a68116be00/0x10531a153b5374d9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1d2563b34cce3de1 expref: -99 pid: 20773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574563.060289:0:20773:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a68116b800/0x10531a153b5374e0 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 20773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574563.060306:0:20773:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a68116b800/0x10531a153b5374e0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 20773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574563.060341:0:20773:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a68116b800/0x10531a153b5374e0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 20773 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788574563.060403:0:20773:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:0.0:1788574563.060407:0:20773:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1788574563.060444:0:20773:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90a68116b800/0x10531a153b5374e0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 20773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574563.060551:0:20773:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a68116be00/0x10531a153b5374d9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce3de1 expref: 11 pid: 20773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574563.060573:0:20773:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90a68116b800/0x10531a153b5374e0 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce3de1 expref: 10 pid: 20773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574563.060584:0:20773:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90a797af6f00) 00010000:00010000:0.0:1788574563.060587:0:20773:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788574563.060591:0:20773:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a68116b800, rc 0) 00000100:00100000:0.0:1788574563.060672:0:20773:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7a72b9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0ef7cddc-b831-4237-948c-b4fc5b50b382+10:17367:x1875455727778176:12345-192.168.201.57@tcp:101:lctl.0 Request processed in 510us (790us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574563.060679:0:20773:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 20 00000100:00100000:1.0:1788574563.111139:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:3.0:1788574563.111303:0:18887:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727778304 00000100:00100000:3.0:1788574563.111320:0:18887:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727778304 00000100:00100000:3.0:1788574563.111444:0:18887:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 21 00000100:00100000:3.0:1788574563.111457:0:18887:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7a72ba680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a406b67b-30f6-4346-815d-0b22929077a2+5:17368:x1875455727778304:12345-192.168.201.57@tcp:101:lfs.0 00010000:00010000:3.0:1788574563.111485:0:18887:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788574563.111511:0:18887:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a6824f9600/0x10531a153b5374e7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1d2563b34cce3de8 expref: -99 pid: 18887 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574563.111615:0:18887:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a6824f9a00/0x10531a153b5374ee lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 18887 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574563.111631:0:18887:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a6824f9a00/0x10531a153b5374ee lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 18887 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574563.111643:0:18887:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a6824f9a00/0x10531a153b5374ee lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 18887 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788574563.111682:0:18887:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:3.0:1788574563.111686:0:18887:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1788574563.111715:0:18887:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90a6824f9a00/0x10531a153b5374ee lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 18887 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574563.111742:0:18887:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a6824f9600/0x10531a153b5374e7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce3de8 expref: 7 pid: 18887 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574563.111765:0:18887:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90a6824f9a00/0x10531a153b5374ee lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce3de8 expref: 6 pid: 18887 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574563.111774:0:18887:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90a797af6f00) 00010000:00010000:3.0:1788574563.111777:0:18887:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788574563.111782:0:18887:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a6824f9a00, rc 0) 00000100:00100000:3.0:1788574563.111858:0:18887:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7a72ba680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a406b67b-30f6-4346-815d-0b22929077a2+6:17368:x1875455727778304:12345-192.168.201.57@tcp:101:lfs.0 Request processed in 404us (732us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574563.111865:0:18887:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 21 00000100:00100000:1.0:1788574563.116981:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:0.0:1788574563.117077:0:20773:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727778432 00000100:00100000:0.0:1788574563.117089:0:20773:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727778432 00000100:00100000:0.0:1788574563.117157:0:20773:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 22 00000100:00100000:0.0:1788574563.117170:0:20773:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7933b8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a406b67b-30f6-4346-815d-0b22929077a2+6:17368:x1875455727778432:12345-192.168.201.57@tcp:101:lfs.0 00010000:00010000:0.0:1788574563.117196:0:20773:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788574563.117223:0:20773:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a68116be00/0x10531a153b5374f5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1d2563b34cce3def expref: -99 pid: 20773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574563.117352:0:20773:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a68116b200/0x10531a153b5374fc lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 20773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574563.117431:0:20773:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a68116b200/0x10531a153b5374fc lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 20773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574563.117446:0:20773:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a68116b200/0x10531a153b5374fc lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 20773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574563.117465:0:20773:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a68116a800/0x10531a153b537503 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 20773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574563.117471:0:20773:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a68116a800/0x10531a153b537503 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 20773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574563.117478:0:20773:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a68116a800/0x10531a153b537503 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 20773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574563.117620:0:20773:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a68116ae00/0x10531a153b53750a lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 20773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574563.117628:0:20773:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a68116ae00/0x10531a153b53750a lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 20773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574563.117636:0:20773:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a68116ae00/0x10531a153b53750a lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 20773 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788574563.117685:0:20773:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 16384 00000004:00200000:0.0:1788574563.117690:0:20773:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1788574563.117714:0:20773:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90a68116ae00/0x10531a153b53750a lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 20773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574563.117741:0:20773:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a68116b200/0x10531a153b5374fc lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 20773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574563.117747:0:20773:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a68116b200/0x10531a153b5374fc lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 20773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574563.117755:0:20773:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a68116b200/0x10531a153b5374fc lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 20773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574563.117762:0:20773:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a68116b200 already unused, calling callback (ffffffffc1fe34f0) 00010000:00010000:0.0:1788574563.117768:0:20773:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a68116b200/0x10531a153b5374fc lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 20773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574563.117776:0:20773:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a68116b200/0x10531a153b5374fc lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 20773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574563.117791:0:20773:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90a797af6f00) 00010000:00010000:0.0:1788574563.117794:0:20773:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788574563.117800:0:20773:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a68116b200/0x10531a153b5374fc lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 20773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574563.117806:0:20773:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a68116b200/0x10531a153b5374fc lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 20773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574563.117820:0:20773:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a68116a800/0x10531a153b537503 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 20773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574563.117826:0:20773:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a68116a800/0x10531a153b537503 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 20773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574563.117831:0:20773:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a68116a800/0x10531a153b537503 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 20773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574563.117844:0:20773:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a68116a800 already unused, calling callback (ffffffffc1fe34f0) 00010000:00010000:0.0:1788574563.117847:0:20773:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a68116a800/0x10531a153b537503 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 20773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574563.117853:0:20773:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a68116a800/0x10531a153b537503 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 20773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574563.117861:0:20773:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa6028a67 (ffff90a797af6600) 00010000:00010000:0.0:1788574563.117863:0:20773:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788574563.117866:0:20773:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a68116a800/0x10531a153b537503 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 20773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574563.117872:0:20773:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a68116a800/0x10531a153b537503 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 20773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574563.117919:0:20773:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a68116be00/0x10531a153b5374f5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce3def expref: 8 pid: 20773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574563.117934:0:20773:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90a68116ae00/0x10531a153b53750a lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce3def expref: 7 pid: 20773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574563.117943:0:20773:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff90a797af6b00) 00010000:00010000:0.0:1788574563.117946:0:20773:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788574563.117948:0:20773:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a68116ae00, rc 0) 00000100:00100000:0.0:1788574563.118041:0:20773:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7933b8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a406b67b-30f6-4346-815d-0b22929077a2+7:17368:x1875455727778432:12345-192.168.201.57@tcp:101:lfs.0 Request processed in 874us (1071us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574563.118049:0:20773:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 22 00000100:00100000:1.0:1788574563.130017:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:3.0:1788574563.130343:0:18887:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727778688 00000100:00100000:3.0:1788574563.130425:0:18887:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727778688 00000100:00100000:3.0:1788574563.130528:0:18887:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 23 00000100:00100000:3.0:1788574563.130551:0:18887:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7933ba680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a406b67b-30f6-4346-815d-0b22929077a2+7:17368:x1875455727778688:12345-192.168.201.57@tcp:101:lfs.0 00010000:00010000:3.0:1788574563.130581:0:18887:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788574563.130619:0:18887:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a6824f9600/0x10531a153b537511 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1d2563b34cce3df6 expref: -99 pid: 18887 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788574563.130764:0:18887:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 16384 00010000:00010000:3.0:1788574563.130933:0:18887:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90a6824f9600/0x10531a153b537511 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce3df6 expref: 9 pid: 18887 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574563.130951:0:18887:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90a797af6f00) 00010000:00010000:3.0:1788574563.130954:0:18887:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788574563.130962:0:18887:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a6824f9600/0x10531a153b537511 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce3df6 expref: 9 pid: 18887 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574563.130979:0:18887:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a6824f9600, rc 0) 00000100:00100000:3.0:1788574563.131062:0:18887:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7933ba680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a406b67b-30f6-4346-815d-0b22929077a2+8:17368:x1875455727778688:12345-192.168.201.57@tcp:101:lfs.0 Request processed in 523us (1061us total) trans 12884901891 rc 301/301 00000100:00100000:3.0:1788574563.131885:0:18887:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 23 00000100:00100000:1.0:1788574563.136594:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:2.0:1788574563.136920:0:18886:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727778944 00000100:00100000:2.0:1788574563.136935:0:18886:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727778944 00000100:00100000:2.0:1788574563.137025:0:18886:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 24 00000100:00100000:2.0:1788574563.137047:0:18886:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7933b9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a406b67b-30f6-4346-815d-0b22929077a2+8:17368:x1875455727778944:12345-192.168.201.57@tcp:36:lfs.0 00010000:00010000:2.0:1788574563.137124:0:18886:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788574563.137165:0:18886:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a68116ae00/0x10531a153b53750a lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce3def expref: 8 pid: 20773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574563.137192:0:18886:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff90a797af6b00) 00010000:00010000:2.0:1788574563.137206:0:18886:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788574563.137261:0:18886:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7a7ac9000/0x10531a153b53751f lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 18886 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574563.137278:0:18886:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a7a7ac9000/0x10531a153b53751f lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18886 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574563.137291:0:18886:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a7a7ac9000/0x10531a153b53751f lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 18886 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788574563.141363:0:18886:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000005573cd4 reply state 000000004ae27d62 transno 12884901892 ns: mdt-lustre-MDT0000_UUID lock: ffff90a7a7ac9000/0x10531a153b53751f lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 18886 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788574563.141410:0:18886:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:2.0:1788574563.141423:0:18886:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 16384 00000100:00100000:2.0:1788574563.141565:0:18886:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7933b9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a406b67b-30f6-4346-815d-0b22929077a2+9:17368:x1875455727778944:12345-192.168.201.57@tcp:36:lfs.0 Request processed in 4524us (4976us total) trans 12884901892 rc 0/0 00000100:00100000:2.0:1788574563.141938:0:18886:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 24 00010000:00010000:0.0:1788574563.144262:0:3299:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7a7ac9000/0x10531a153b53751f lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18886 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574563.144298:0:3299:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a7a7ac9000/0x10531a153b53751f lrc: 2/0,0 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 18886 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574563.144306:0:3299:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a7a7ac9000/0x10531a153b53751f lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 18886 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574563.144312:0:3299:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a7a7ac9000 already unused, calling callback (ffffffffc1fe34f0) 00010000:00010000:0.0:1788574563.144316:0:3299:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a7a7ac9000/0x10531a153b53751f lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 18886 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574563.144325:0:3299:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a7a7ac9000/0x10531a153b53751f lrc: 4/0,0 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 18886 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574563.144343:0:3299:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff90a791e2f700) 00010000:00010000:0.0:1788574563.144346:0:3299:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00010000:00010000:0.0:1788574563.144351:0:3299:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a7a7ac9000/0x10531a153b53751f lrc: 2/0,0 mode: --/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 18886 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574563.144357:0:3299:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a7a7ac9000/0x10531a153b53751f lrc: 0/0,0 mode: --/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 18886 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788574563.150079:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:2.0:1788574563.150293:0:18889:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727779200 00000100:00100000:2.0:1788574563.150309:0:18889:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727779200 00000100:00100000:2.0:1788574563.150434:0:18889:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 2 00000100:00100000:2.0:1788574563.150448:0:18889:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7933bad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a406b67b-30f6-4346-815d-0b22929077a2+8:17368:x1875455727779200:12345-192.168.201.57@tcp:35:lfs.0 00000100:00100000:2.0:1788574563.150920:0:18889:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7933bad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a406b67b-30f6-4346-815d-0b22929077a2+9:17368:x1875455727779200:12345-192.168.201.57@tcp:35:lfs.0 Request processed in 473us (861us total) trans 12884901893 rc 0/0 00000100:00100000:2.0:1788574563.150928:0:18889:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 2 00000100:00100000:1.0:1788574563.154803:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:0.0:1788574563.162147:0:18888:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727779456 00000100:00100000:0.0:1788574563.162171:0:18888:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727779456 00000100:00100000:0.0:1788574563.162256:0:18888:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 25 00000100:00100000:0.0:1788574563.162268:0:18888:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7933b8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a406b67b-30f6-4346-815d-0b22929077a2+9:17368:x1875455727779456:12345-192.168.201.57@tcp:101:lfs.0 00010000:00010000:0.0:1788574563.162292:0:18888:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788574563.162315:0:18888:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a68116be00/0x10531a153b537526 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1d2563b34cce3dfd expref: -99 pid: 18888 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574563.162418:0:18888:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a68116a800/0x10531a153b53752d lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 18888 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574563.162451:0:18888:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a68116a800/0x10531a153b53752d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 18888 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574563.162475:0:18888:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a68116a800/0x10531a153b53752d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 18888 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574563.162493:0:18888:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a68116b200/0x10531a153b537534 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 18888 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574563.162500:0:18888:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a68116b200/0x10531a153b537534 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18888 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574563.162506:0:18888:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a68116b200/0x10531a153b537534 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 18888 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788574563.162629:0:18888:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 16384 00010000:00010000:0.0:1788574563.162722:0:18888:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a68116a800/0x10531a153b53752d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 18888 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574563.162731:0:18888:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a68116a800/0x10531a153b53752d lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 18888 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574563.162739:0:18888:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a68116a800/0x10531a153b53752d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 18888 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574563.162747:0:18888:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a68116a800 already unused, calling callback (ffffffffc1fe34f0) 00010000:00010000:0.0:1788574563.162751:0:18888:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a68116a800/0x10531a153b53752d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 18888 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574563.162760:0:18888:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a68116a800/0x10531a153b53752d lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 18888 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574563.162956:0:18888:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90a797af6f00) 00010000:00010000:0.0:1788574563.162960:0:18888:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788574563.162970:0:18888:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a68116a800/0x10531a153b53752d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 18888 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574563.162978:0:18888:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a68116a800/0x10531a153b53752d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 18888 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574563.162992:0:18888:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a68116b200/0x10531a153b537534 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18888 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574563.163000:0:18888:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a68116b200/0x10531a153b537534 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 18888 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574563.163006:0:18888:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a68116b200/0x10531a153b537534 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 18888 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574563.163011:0:18888:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a68116b200 already unused, calling callback (ffffffffc1fe34f0) 00010000:00010000:0.0:1788574563.163014:0:18888:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a68116b200/0x10531a153b537534 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 18888 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574563.163021:0:18888:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a68116b200/0x10531a153b537534 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 18888 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574563.163028:0:18888:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa6028a67 (ffff90a797af6600) 00010000:00010000:0.0:1788574563.163031:0:18888:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788574563.163033:0:18888:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a68116b200/0x10531a153b537534 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 18888 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574563.163040:0:18888:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a68116b200/0x10531a153b537534 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 18888 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574563.163931:0:18888:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90a68116be00/0x10531a153b537526 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce3dfd expref: 11 pid: 18888 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574563.163953:0:18888:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90a797af6f00) 00010000:00010000:0.0:1788574563.163956:0:18888:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788574563.163961:0:18888:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a68116be00/0x10531a153b537526 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce3dfd expref: 11 pid: 18888 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574563.163976:0:18888:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a68116be00, rc 0) 00000100:00100000:0.0:1788574563.164073:0:18888:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7933b8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a406b67b-30f6-4346-815d-0b22929077a2+10:17368:x1875455727779456:12345-192.168.201.57@tcp:101:lfs.0 Request processed in 1806us (9296us total) trans 12884901894 rc 301/301 00000100:00100000:0.0:1788574563.164082:0:18888:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 25 00000100:00100000:3.0:1788574563.169285:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:0.0:1788574563.169570:0:20773:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727779584 00000100:00100000:0.0:1788574563.169582:0:20773:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727779584 00000100:00100000:0.0:1788574563.169660:0:20773:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 26 00000100:00100000:0.0:1788574563.169673:0:20773:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a79245b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a406b67b-30f6-4346-815d-0b22929077a2+10:17368:x1875455727779584:12345-192.168.201.57@tcp:101:lfs.0 00010000:00010000:0.0:1788574563.169712:0:20773:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788574563.169740:0:20773:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a68116b200/0x10531a153b537542 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1d2563b34cce3e04 expref: -99 pid: 20773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574563.169876:0:20773:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a68116a800/0x10531a153b537549 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 20773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574563.169893:0:20773:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a68116a800/0x10531a153b537549 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 20773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574563.169907:0:20773:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a68116a800/0x10531a153b537549 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 20773 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788574563.169961:0:20773:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 16384 00000004:00200000:0.0:1788574563.169965:0:20773:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1788574563.169988:0:20773:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90a68116a800/0x10531a153b537549 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 20773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574563.170020:0:20773:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a68116b200/0x10531a153b537542 lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce3e04 expref: 12 pid: 20773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574563.170040:0:20773:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90a68116a800/0x10531a153b537549 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce3e04 expref: 11 pid: 20773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574563.170049:0:20773:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff90a797af6600) 00010000:00010000:0.0:1788574563.170053:0:20773:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788574563.170059:0:20773:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a68116a800, rc 0) 00000100:00100000:0.0:1788574563.170138:0:20773:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a79245b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a406b67b-30f6-4346-815d-0b22929077a2+11:17368:x1875455727779584:12345-192.168.201.57@tcp:101:lfs.0 Request processed in 468us (865us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574563.170146:0:20773:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 26 00000100:00100000:1.0:1788574563.184491:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:3.0:1788574563.184892:0:18889:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727779712 00000100:00100000:3.0:1788574563.184904:0:18889:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727779712 00000100:00100000:3.0:1788574563.184964:0:18889:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 3 00000100:00100000:3.0:1788574563.184975:0:18889:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7933b8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a406b67b-30f6-4346-815d-0b22929077a2+11:17368:x1875455727779712:12345-192.168.201.57@tcp:37:lfs.0 00000100:00100000:3.0:1788574563.196801:0:18889:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7933b8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a406b67b-30f6-4346-815d-0b22929077a2+11:17368:x1875455727779712:12345-192.168.201.57@tcp:37:lfs.0 Request processed in 11809us (12303us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574563.196817:0:18889:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 3 00010000:00010000:3.0:1788574563.202713:0:18875:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788574563.207026:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:2.0:1788574563.207482:0:18890:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727779968 00000100:00100000:2.0:1788574563.207502:0:18890:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727779968 00000100:00100000:2.0:1788574563.207602:0:18890:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 4 00000100:00100000:2.0:1788574563.207618:0:18890:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7a02ff850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a406b67b-30f6-4346-815d-0b22929077a2+11:17368:x1875455727779968:12345-192.168.201.57@tcp:35:lfs.0 00000100:00100000:2.0:1788574563.209476:0:18890:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7a02ff850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a406b67b-30f6-4346-815d-0b22929077a2+12:17368:x1875455727779968:12345-192.168.201.57@tcp:35:lfs.0 Request processed in 1845us (2454us total) trans 12884901895 rc 0/0 00000100:00100000:2.0:1788574563.209522:0:18890:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 4 00000100:00100000:0.0:1788574563.275024:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:2.0:1788574563.275187:0:18888:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727780096 00000100:00100000:2.0:1788574563.275198:0:18888:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727780096 00000100:00100000:2.0:1788574563.275268:0:18888:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 27 00000100:00100000:2.0:1788574563.275280:0:18888:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a78e0ea680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0ef7cddc-b831-4237-948c-b4fc5b50b382+10:17374:x1875455727780096:12345-192.168.201.57@tcp:101:bash.0 00010000:00010000:2.0:1788574563.275298:0:18888:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788574563.275320:0:18888:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a7a7ac9200/0x10531a153b537550 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1d2563b34cce3e0b expref: -99 pid: 18888 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574563.275469:0:18888:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7a7ac9c00/0x10531a153b537557 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 18888 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574563.275484:0:18888:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a7a7ac9c00/0x10531a153b537557 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 18888 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574563.275497:0:18888:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a7a7ac9c00/0x10531a153b537557 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 18888 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574563.275516:0:18888:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7a7ac9000/0x10531a153b53755e lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 18888 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574563.275524:0:18888:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a7a7ac9000/0x10531a153b53755e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18888 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574563.275531:0:18888:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a7a7ac9000/0x10531a153b53755e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 18888 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574563.275643:0:18888:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7a7ac9400/0x10531a153b537565 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 18888 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574563.275661:0:18888:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a7a7ac9400/0x10531a153b537565 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 18888 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574563.275669:0:18888:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a7a7ac9400/0x10531a153b537565 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18888 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788574563.275701:0:18888:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 16384 00000004:00200000:2.0:1788574563.275705:0:18888:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1788574563.275747:0:18888:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90a7a7ac9400/0x10531a153b537565 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18888 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574563.275759:0:18888:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7a7ac9c00/0x10531a153b537557 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 18888 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574563.275766:0:18888:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a7a7ac9c00/0x10531a153b537557 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 18888 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574563.275772:0:18888:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a7a7ac9c00/0x10531a153b537557 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 18888 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574563.275778:0:18888:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a7a7ac9c00 already unused, calling callback (ffffffffc1fe34f0) 00010000:00010000:2.0:1788574563.275783:0:18888:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a7a7ac9c00/0x10531a153b537557 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 18888 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574563.275792:0:18888:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a7a7ac9c00/0x10531a153b537557 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 18888 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574563.275807:0:18888:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90a797af6f00) 00010000:00010000:2.0:1788574563.275810:0:18888:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788574563.275817:0:18888:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a7a7ac9c00/0x10531a153b537557 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 18888 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574563.275833:0:18888:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a7a7ac9c00/0x10531a153b537557 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 18888 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574563.275849:0:18888:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7a7ac9000/0x10531a153b53755e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18888 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574563.275855:0:18888:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a7a7ac9000/0x10531a153b53755e lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 18888 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574563.275860:0:18888:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a7a7ac9000/0x10531a153b53755e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 18888 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574563.275866:0:18888:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a7a7ac9000 already unused, calling callback (ffffffffc1fe34f0) 00010000:00010000:2.0:1788574563.275869:0:18888:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a7a7ac9000/0x10531a153b53755e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 18888 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574563.275875:0:18888:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a7a7ac9000/0x10531a153b53755e lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 18888 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574563.275882:0:18888:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa6028a67 (ffff90a791e2fc00) 00010000:00010000:2.0:1788574563.275885:0:18888:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788574563.275887:0:18888:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a7a7ac9000/0x10531a153b53755e lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 18888 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574563.275894:0:18888:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a7a7ac9000/0x10531a153b53755e lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 18888 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574563.275930:0:18888:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a7a7ac9200/0x10531a153b537550 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce3e0b expref: 12 pid: 18888 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574563.275955:0:18888:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7a7ac9400/0x10531a153b537565 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce3e0b expref: 11 pid: 18888 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574563.275962:0:18888:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff90a797af6600) 00010000:00010000:2.0:1788574563.275965:0:18888:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1788574563.275968:0:18888:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a7a7ac9400, rc 0) 00000100:00100000:2.0:1788574563.276052:0:18888:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a78e0ea680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0ef7cddc-b831-4237-948c-b4fc5b50b382+11:17374:x1875455727780096:12345-192.168.201.57@tcp:101:bash.0 Request processed in 773us (1039us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574563.276059:0:18888:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 27 00000100:00100000:1.0:1788574563.281481:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:0.0:1788574563.281596:0:20773:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727780352 00000100:00100000:0.0:1788574563.281610:0:20773:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727780352 00000100:00100000:0.0:1788574563.281689:0:20773:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 28 00000100:00100000:0.0:1788574563.281699:0:20773:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7933b8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0ef7cddc-b831-4237-948c-b4fc5b50b382+11:17374:x1875455727780352:12345-192.168.201.57@tcp:101:bash.0 00010000:00010000:0.0:1788574563.281724:0:20773:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788574563.281746:0:20773:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a68116b200/0x10531a153b53756c lrc: 2/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1d2563b34cce3e12 expref: -99 pid: 20773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574563.281934:0:20773:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90a68116ac00/0x10531a153b537573 lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 20773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574563.281964:0:20773:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90a68116a800/0x10531a153b537549 lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce3e04 expref: 11 pid: 20773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574563.281972:0:20773:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a68116ac00/0x10531a153b537573 lrc: 4/0,1 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 20773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574563.282016:0:20773:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90a68116a800/0x10531a153b537549 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce3e04 expref: 11 pid: 20773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574563.282029:0:20773:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90a68116a800/0x10531a153b537549 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce3e04 expref: 11 pid: 20773 timeout: 789 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788574563.282044:0:20773:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a78e0e8a80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:20773:1875455747698560:192.168.201.57@tcp:104: 00000100:00100000:0.0:1788574563.282180:0:20773:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a7a7870900 going to sleep for 11 seconds 00000100:00100000:1.0:1788574563.287220:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:2.0:1788574563.287287:0:21020:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727780480 00000100:00100000:2.0:1788574563.287297:0:21020:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727780480 00000100:00100000:0.0:1788574563.287772:0:20773:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a78e0e8a80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:20773:1875455747698560:192.168.201.57@tcp:104: 00010000:00010000:0.0:1788574563.287816:0:20773:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90a68116ac00/0x10531a153b537573 lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 20773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574563.287904:0:21020:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a68116a800/0x10531a153b537549 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce3e04 expref: 12 pid: 20773 timeout: 789 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788574563.287994:0:21020:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 10 00000100:00100000:2.0:1788574563.288006:0:21020:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7933b9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a406b67b-30f6-4346-815d-0b22929077a2+12:2355:x1875455727780480:12345-192.168.201.57@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788574563.288026:0:21020:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788574563.288034:0:21020:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90a68116a800/0x10531a153b537549 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce3e04 expref: 12 pid: 20773 timeout: 789 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574563.288048:0:21020:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90a68116a800/0x10531a153b537549 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce3e04 expref: 12 pid: 20773 timeout: 789 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574563.288076:0:21020:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a68116a800/0x10531a153b537549 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce3e04 expref: 12 pid: 20773 timeout: 789 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574563.288124:0:21020:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff90a797af6600) 00010000:00010000:2.0:1788574563.288130:0:21020:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff90a68116ac00/0x10531a153b537573 lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 20773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574563.288140:0:21020:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90a68116ac00/0x10531a153b537573 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 20773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574563.288149:0:21020:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a68116ac00/0x10531a153b537573 lrc: 4/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 20773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574563.288182:0:21020:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788574563.288245:0:21020:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7933b9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a406b67b-30f6-4346-815d-0b22929077a2+11:2355:x1875455727780480:12345-192.168.201.57@tcp:103:ldlm_bl.0 Request processed in 241us (1033us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574563.288253:0:21020:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 10 00010000:00010000:1.0:1788574563.288298:0:20773:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90a68116ac00/0x10531a153b537573 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 20773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574563.288306:0:20773:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a68116ac00/0x10531a153b537573 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 20773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574563.288408:0:20773:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90a78165b800/0x10531a153b53757a lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 20773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574563.288420:0:20773:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a78165b800/0x10531a153b53757a lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 20773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574563.288428:0:20773:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a78165b800/0x10531a153b53757a lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 20773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574563.289495:0:20773:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a78165a000/0x10531a153b537581 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 20773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574563.289510:0:20773:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a78165a000/0x10531a153b537581 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 20773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574563.289519:0:20773:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a78165a000/0x10531a153b537581 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 20773 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788574563.289531:0:20773:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00010000:00010000:1.0:1788574563.289576:0:20773:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90a68116ac00/0x10531a153b537573 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 20773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574563.289583:0:20773:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a68116ac00/0x10531a153b537573 lrc: 2/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 20773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574563.289591:0:20773:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a68116ac00/0x10531a153b537573 lrc: 3/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 20773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574563.289597:0:20773:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a68116ac00 already unused, calling callback (ffffffffc1fe34f0) 00010000:00010000:1.0:1788574563.289603:0:20773:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a68116ac00/0x10531a153b537573 lrc: 3/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 20773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574563.289611:0:20773:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a68116ac00/0x10531a153b537573 lrc: 4/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 20773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574563.289623:0:20773:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff90a797af6600) 00010000:00010000:1.0:1788574563.289627:0:20773:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788574563.289632:0:20773:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a68116ac00/0x10531a153b537573 lrc: 2/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 20773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574563.289650:0:20773:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a68116ac00/0x10531a153b537573 lrc: 0/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 20773 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788574563.289665:0:20773:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000078fc5c3 reply state 00000000ca776299 transno 12884901896 ns: mdt-lustre-MDT0000_UUID lock: ffff90a78165b800/0x10531a153b53757a lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 20773 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788574563.289676:0:20773:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1788574563.289719:0:20773:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a68116b200/0x10531a153b53756c lrc: 0/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce3e12 expref: 14 pid: 20773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574563.289733:0:20773:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90a78165a000/0x10531a153b537581 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce3e12 expref: 13 pid: 20773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574563.289740:0:20773:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff90a7829d0300) 00010000:00010000:1.0:1788574563.289742:0:20773:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 9 00010000:00010000:1.0:1788574563.289744:0:20773:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a78165a000, rc 0) 00000100:00100000:1.0:1788574563.289849:0:20773:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7933b8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0ef7cddc-b831-4237-948c-b4fc5b50b382+14:17374:x1875455727780352:12345-192.168.201.57@tcp:101:bash.0 Request processed in 8150us (8380us total) trans 12884901896 rc 0/0 00000100:00100000:1.0:1788574563.289859:0:20773:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 28 00010000:00010000:3.0:1788574563.292548:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90a78165b800/0x10531a153b53757a lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 20773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574563.292571:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a78165b800/0x10531a153b53757a lrc: 2/0,0 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 20773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574563.292580:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a78165b800/0x10531a153b53757a lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 20773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574563.292586:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a78165b800 already unused, calling callback (ffffffffc1fe34f0) 00010000:00010000:3.0:1788574563.292592:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a78165b800/0x10531a153b53757a lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 20773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574563.292600:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a78165b800/0x10531a153b53757a lrc: 4/0,0 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 20773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574563.292619:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0xb42112bc (ffff90a7829d0800) 00010000:00010000:3.0:1788574563.292622:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788574563.292628:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a78165b800/0x10531a153b53757a lrc: 2/0,0 mode: --/PW res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 20773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574563.292633:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a78165b800/0x10531a153b53757a lrc: 0/0,0 mode: --/PW res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 20773 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788574563.315453:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:1.0:1788574563.316174:0:18887:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727780608 00000100:00100000:1.0:1788574563.316197:0:18887:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727780608 00000100:00100000:1.0:1788574563.316277:0:18887:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 29 00000100:00100000:1.0:1788574563.316288:0:18887:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a792458a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0ef7cddc-b831-4237-948c-b4fc5b50b382+13:17374:x1875455727780608:12345-192.168.201.57@tcp:101:bash.0 00010000:00010000:1.0:1788574563.316317:0:18887:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788574563.316342:0:18887:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a78165b800/0x10531a153b53758f lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1d2563b34cce3e19 expref: -99 pid: 18887 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574563.316736:0:18887:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a78165b400/0x10531a153b537596 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 18887 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574563.316752:0:18887:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a78165b400/0x10531a153b537596 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 18887 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574563.316767:0:18887:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a78165b400/0x10531a153b537596 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18887 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788574563.316824:0:18887:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00000004:00200000:1.0:1788574563.316830:0:18887:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1788574563.316857:0:18887:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90a78165b400/0x10531a153b537596 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18887 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574563.316870:0:18887:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a78165b400/0x10531a153b537596 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 18887 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574563.316907:0:18887:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a78165b800/0x10531a153b53758f lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce3e19 expref: 15 pid: 18887 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574563.316934:0:18887:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90a78165b400/0x10531a153b537596 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce3e19 expref: 14 pid: 18887 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574563.316944:0:18887:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff90a7829d0300) 00010000:00010000:1.0:1788574563.316947:0:18887:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788574563.316951:0:18887:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a78165b400, rc 0) 00000100:00100000:1.0:1788574563.317155:0:18887:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a792458a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0ef7cddc-b831-4237-948c-b4fc5b50b382+14:17374:x1875455727780608:12345-192.168.201.57@tcp:101:bash.0 Request processed in 868us (1711us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574563.317164:0:18887:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 29 00000100:00100000:1.0:1788574563.320154:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:3.0:1788574563.320259:0:18889:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727780864 00000100:00100000:3.0:1788574563.320272:0:18889:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727780864 00000100:00100000:3.0:1788574563.320326:0:18889:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 5 00000100:00100000:3.0:1788574563.320339:0:18889:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7933b9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0ef7cddc-b831-4237-948c-b4fc5b50b382+14:17374:x1875455727780864:12345-192.168.201.57@tcp:35:bash.0 00000100:00100000:3.0:1788574563.320857:0:18889:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7933b9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0ef7cddc-b831-4237-948c-b4fc5b50b382+15:17374:x1875455727780864:12345-192.168.201.57@tcp:35:bash.0 Request processed in 519us (717us total) trans 12884901897 rc 0/0 00000100:00100000:3.0:1788574563.320882:0:18889:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 5 00000100:00100000:3.0:1788574563.415992:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:2.0:1788574563.416067:0:18886:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727781120 00000100:00100000:2.0:1788574563.416079:0:18886:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727781120 00000100:00100000:2.0:1788574563.416152:0:18886:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 30 00000100:00100000:2.0:1788574563.416166:0:18886:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a79245aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0ef7cddc-b831-4237-948c-b4fc5b50b382+15:17384:x1875455727781120:12345-192.168.201.57@tcp:101:lfs.0 00010000:00010000:2.0:1788574563.416195:0:18886:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788574563.416219:0:18886:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a7a7ac9200/0x10531a153b53759d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1d2563b34cce3e20 expref: -99 pid: 18886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788574563.416320:0:18886:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 16384 00010000:00010000:2.0:1788574563.416485:0:18886:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7a7ac9200/0x10531a153b53759d lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce3e20 expref: 17 pid: 18886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574563.416499:0:18886:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90a797af6f00) 00010000:00010000:2.0:1788574563.416515:0:18886:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788574563.416521:0:18886:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a7a7ac9200/0x10531a153b53759d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce3e20 expref: 17 pid: 18886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574563.416550:0:18886:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a7a7ac9200, rc 0) 00000100:00100000:2.0:1788574563.416858:0:18886:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a79245aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0ef7cddc-b831-4237-948c-b4fc5b50b382+16:17384:x1875455727781120:12345-192.168.201.57@tcp:101:lfs.0 Request processed in 694us (876us total) trans 12884901898 rc 301/301 00000100:00100000:2.0:1788574563.416866:0:18886:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 30 00000100:00100000:1.0:1788574563.421896:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:2.0:1788574563.422950:0:18890:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727781376 00000100:00100000:2.0:1788574563.422964:0:18890:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727781376 00000100:00100000:2.0:1788574563.423141:0:18890:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 6 00000100:00100000:2.0:1788574563.423151:0:18890:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7933bb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0ef7cddc-b831-4237-948c-b4fc5b50b382+16:17384:x1875455727781376:12345-192.168.201.57@tcp:35:lfs.0 00000100:00100000:2.0:1788574563.423527:0:18890:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7933bb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0ef7cddc-b831-4237-948c-b4fc5b50b382+17:17384:x1875455727781376:12345-192.168.201.57@tcp:35:lfs.0 Request processed in 376us (1649us total) trans 12884901899 rc 0/0 00000100:00100000:2.0:1788574563.423548:0:18890:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 6 00000100:00100000:3.0:1788574563.456815:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a792459c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1875455747698816:0@lo:400:kworker.0 00000100:00100000:3.0:1788574563.456899:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788574563.456966:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a792458700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3314:1875455747699328:0@lo:400:kworker.0 00000100:00100000:3.0:1788574563.456995:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788574563.457021:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788574563.457027:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a79245b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1875455747698944:0@lo:400:kworker.0 00000100:00100000:1.0:1788574563.457158:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a792459f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3312:1875455747699072:0@lo:400:kworker.0 00000100:00100000:2.0:1788574563.457204:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a79245ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:64047b6f-0fa6-4004-9f51-bd636ae04daf:3313:1875455747698688:0@lo:400:kworker.0 00000100:00100000:0.0:1788574563.458251:0:20780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747698816 00000100:00100000:0.0:1788574563.458261:0:20780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747698816 00000100:00100000:0.0:1788574563.458317:0:20780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1788574563.458336:0:20780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a79245a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3314:x1875455747698816:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788574563.459012:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1788574563.459060:0:18882:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788574563.460664:0:18887:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747699328 00000100:00100000:1.0:1788574563.460680:0:18887:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747699328 00000100:00080000:1.0:1788574563.460715:0:18882:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788574563.460756:0:18887:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747699072 00000100:00100000:1.0:1788574563.460759:0:18887:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747699072 00000100:00100000:1.0:1788574563.460784:0:18887:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1788574563.460793:0:18887:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a792459880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1875455747699328:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788574563.460883:0:18887:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a792459880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1875455747699328:12345-0@lo:400:kworker.0 Request processed in 91us (3885us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574563.460890:0:18887:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1788574563.460906:0:18887:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1788574563.460912:0:18887:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7933bb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1875455747699072:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788574563.460947:0:18887:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7933bb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1875455747699072:12345-0@lo:400:kworker.0 Request processed in 35us (1937us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574563.460953:0:18887:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1788574563.460993:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a792459f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3312:1875455747699072:0@lo:400:kworker.0 00000100:00100000:2.0:1788574563.463047:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788574563.463106:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a792458000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3313:1875455747699200:0@lo:400:kworker.0 00000100:00100000:2.0:1788574563.463145:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788574563.464074:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788574563.464160:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a792458700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3314:1875455747699328:0@lo:400:kworker.0 00000100:00100000:3.0:1788574563.464178:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788574563.464193:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a78e0e8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1875455747699456:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788574563.464223:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788574563.464260:0:19579:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747699456 00000100:00100000:3.0:1788574563.464266:0:19579:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747699456 00000100:00100000:0.0:1788574563.464387:0:20780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a79245a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3314:x1875455747698816:12345-0@lo:400:kworker.0 Request processed in 6059us (7486us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574563.464398:0:20780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1788574563.464423:0:20780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747698944 00000100:00100000:0.0:1788574563.464443:0:20780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747698944 00000100:00100000:0.0:1788574563.464480:0:20780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1788574563.464488:0:20780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a792458e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3314:x1875455747698944:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788574563.464548:0:20780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a792458e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3314:x1875455747698944:12345-0@lo:400:kworker.0 Request processed in 61us (479us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574563.464555:0:20780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1788574563.464607:0:18888:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747699200 00000100:00100000:0.0:1788574563.464612:0:18888:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747699200 00000100:00100000:3.0:1788574563.465890:0:19579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1788574563.465901:0:19579:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a792458700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1875455747699456:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788574563.465933:0:19579:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3851419648 avail 3849322496 00000100:00100000:3.0:1788574563.465990:0:19579:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a792458700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1875455747699456:12345-0@lo:13:osp-pre-1-0.0 Request processed in 91us (1766us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574563.465996:0:19579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1788574563.466046:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a78e0e8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1875455747699456:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788574563.466059:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a79245b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1875455747698944:0@lo:400:kworker.0 00000100:00100000:3.0:1788574563.466086:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a792459c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1875455747698816:0@lo:400:kworker.0 00000100:00100000:3.0:1788574563.466168:0:18880:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747698688 00000100:00100000:3.0:1788574563.466173:0:18880:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747698688 00000100:00100000:3.0:1788574563.466201:0:18880:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:3.0:1788574563.466207:0:18880:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a79e7eb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:64047b6f-0fa6-4004-9f51-bd636ae04daf+19:3313:x1875455747698688:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788574563.466244:0:18880:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a79e7eb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:64047b6f-0fa6-4004-9f51-bd636ae04daf+19:3313:x1875455747698688:12345-0@lo:400:kworker.0 Request processed in 37us (3204us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574563.466250:0:18880:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00000100:00100000:3.0:1788574563.466789:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:3.0:1788574563.466818:0:18887:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727781632 00000100:00100000:3.0:1788574563.466823:0:18887:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727781632 00000100:00100000:3.0:1788574563.466859:0:18887:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 31 00000100:00100000:3.0:1788574563.466867:0:18887:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a792459c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0ef7cddc-b831-4237-948c-b4fc5b50b382+17:17387:x1875455727781632:12345-192.168.201.57@tcp:101:lfs.0 00010000:00010000:3.0:1788574563.466889:0:18887:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788574563.466916:0:18887:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a6824f9e00/0x10531a153b5375ab lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1d2563b34cce3e27 expref: -99 pid: 18887 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574563.467033:0:18887:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a6824f9600/0x10531a153b5375b2 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 18887 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574563.467050:0:18887:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a6824f9600/0x10531a153b5375b2 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 18887 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788574563.467289:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a79245ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:64047b6f-0fa6-4004-9f51-bd636ae04daf:3313:1875455747698688:0@lo:400:kworker.0 00010000:00010000:3.0:1788574563.467354:0:18887:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a6824f9600/0x10531a153b5375b2 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 18887 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788574563.467619:0:18887:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00010000:00010000:3.0:1788574563.467783:0:18887:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a6824f9e00/0x10531a153b5375ab lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce3e27 expref: 20 pid: 18887 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574563.467833:0:18887:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90a6824f9600/0x10531a153b5375b2 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce3e27 expref: 19 pid: 18887 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574563.467846:0:18887:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff90a7829d0300) 00010000:00010000:3.0:1788574563.467850:0:18887:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788574563.467856:0:18887:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a6824f9600, rc 0) 00000100:00100000:3.0:1788574563.467945:0:18887:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a792459c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0ef7cddc-b831-4237-948c-b4fc5b50b382+19:17387:x1875455727781632:12345-192.168.201.57@tcp:101:lfs.0 Request processed in 1078us (1158us total) trans 12884901900 rc 0/0 00000100:00100000:3.0:1788574563.467952:0:18887:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 31 00000100:00100000:3.0:1788574563.467978:0:18887:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1788574563.467988:0:18887:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a79b050380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1875455747699200:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788574563.468054:0:18887:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a79b050380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1875455747699200:12345-0@lo:400:kworker.0 Request processed in 69us (4908us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574563.468137:0:18887:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1788574563.468363:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a792458000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3313:1875455747699200:0@lo:400:kworker.0 00000100:00080000:1.0:1788574563.468624:0:18882:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788574563.468631:0:18882:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788574563.472473:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:3.0:1788574563.472560:0:18887:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727781760 00000100:00100000:3.0:1788574563.472571:0:18887:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727781760 00000100:00100000:3.0:1788574563.472630:0:18887:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 32 00000100:00100000:3.0:1788574563.472642:0:18887:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7933b8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0ef7cddc-b831-4237-948c-b4fc5b50b382+19:17387:x1875455727781760:12345-192.168.201.57@tcp:54:lfs.0 00010000:00010000:3.0:1788574563.472739:0:18887:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a6824f8e00/0x10531a153b5375c0 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 18887 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574563.472760:0:18887:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a6824f8e00/0x10531a153b5375c0 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 18887 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574563.472774:0:18887:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a6824f8e00/0x10531a153b5375c0 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 18887 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574563.472832:0:18887:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a6824f8e00/0x10531a153b5375c0 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 18887 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574563.472839:0:18887:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a6824f8e00/0x10531a153b5375c0 lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 18887 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574563.472846:0:18887:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a6824f8e00/0x10531a153b5375c0 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 18887 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574563.472851:0:18887:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a6824f8e00 already unused, calling callback (ffffffffc1fe34f0) 00010000:00010000:3.0:1788574563.472856:0:18887:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a6824f8e00/0x10531a153b5375c0 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 18887 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574563.472863:0:18887:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a6824f8e00/0x10531a153b5375c0 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 18887 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574563.472877:0:18887:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff90a7829d0300) 00010000:00010000:3.0:1788574563.472880:0:18887:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788574563.472885:0:18887:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a6824f8e00/0x10531a153b5375c0 lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 18887 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574563.472892:0:18887:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a6824f8e00/0x10531a153b5375c0 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 18887 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788574563.472980:0:18887:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7933b8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0ef7cddc-b831-4237-948c-b4fc5b50b382+19:17387:x1875455727781760:12345-192.168.201.57@tcp:54:lfs.0 Request processed in 341us (518us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574563.472988:0:18887:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 32 00000100:00100000:2.0:1788574563.475915:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:3.0:1788574563.476016:0:18873:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727781888 00000100:00100000:3.0:1788574563.476030:0:18873:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727781888 00000100:00100000:3.0:1788574563.476137:0:18873:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 0 00000100:00100000:3.0:1788574563.476173:0:18873:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a79b052d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0ef7cddc-b831-4237-948c-b4fc5b50b382+19:2354:x1875455727781888:12345-192.168.201.57@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788574563.476196:0:18873:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788574563.476220:0:18873:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a6824f9600/0x10531a153b5375b2 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce3e27 expref: 19 pid: 18887 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574563.476242:0:18873:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff90a7829d0300) 00010000:00010000:3.0:1788574563.476248:0:18873:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788574563.476321:0:18873:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a79b052d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0ef7cddc-b831-4237-948c-b4fc5b50b382+18:2354:x1875455727781888:12345-192.168.201.57@tcp:103:ldlm_bl.0 Request processed in 152us (425us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574563.476337:0:18873:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 0 00000100:00100000:1.0:1788574563.480546:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:3.0:1788574563.480665:0:18889:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727782144 00000100:00100000:3.0:1788574563.480676:0:18889:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727782144 00000100:00100000:3.0:1788574563.480743:0:18889:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 7 00000100:00100000:3.0:1788574563.480755:0:18889:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7933ba300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0ef7cddc-b831-4237-948c-b4fc5b50b382+18:17387:x1875455727782144:12345-192.168.201.57@tcp:35:lfs.0 00000100:00100000:3.0:1788574563.481051:0:18889:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7933ba300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0ef7cddc-b831-4237-948c-b4fc5b50b382+19:17387:x1875455727782144:12345-192.168.201.57@tcp:35:lfs.0 Request processed in 298us (527us total) trans 12884901901 rc 0/0 00000100:00100000:3.0:1788574563.481068:0:18889:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 7 00000040:00080000:2.0:1788574563.650252:0:18921:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:1.0:1788574563.903026:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:2.0:1788574563.903145:0:20773:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727782400 00000100:00100000:2.0:1788574563.903155:0:20773:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727782400 00000100:00100000:2.0:1788574563.903233:0:20773:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 33 00000100:00100000:2.0:1788574563.903244:0:20773:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7933bbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0ef7cddc-b831-4237-948c-b4fc5b50b382+19:17418:x1875455727782400:12345-192.168.201.57@tcp:101:cat.0 00010000:00010000:2.0:1788574563.903269:0:20773:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788574563.903292:0:20773:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a7a7ac9000/0x10531a153b5375c7 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1d2563b34cce3e2e expref: -99 pid: 20773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574563.903445:0:20773:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7a7ac9c00/0x10531a153b5375ce lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 20773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574563.903460:0:20773:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a7a7ac9c00/0x10531a153b5375ce lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 20773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574563.903474:0:20773:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a7a7ac9c00/0x10531a153b5375ce lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 20773 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788574563.903486:0:20773:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00010000:00010000:2.0:1788574563.903640:0:20773:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a7a7ac9000/0x10531a153b5375c7 lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce3e2e expref: 22 pid: 20773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574563.903660:0:20773:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7a7ac9c00/0x10531a153b5375ce lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce3e2e expref: 21 pid: 20773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574563.903669:0:20773:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff90a7829d0300) 00010000:00010000:2.0:1788574563.903672:0:20773:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788574563.903675:0:20773:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a7a7ac9c00, rc 0) 00000100:00100000:2.0:1788574563.904507:0:20773:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7933bbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0ef7cddc-b831-4237-948c-b4fc5b50b382+21:17418:x1875455727782400:12345-192.168.201.57@tcp:101:cat.0 Request processed in 1259us (1487us total) trans 12884901902 rc 0/0 00000100:00100000:2.0:1788574563.904517:0:20773:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 33 00000100:00100000:1.0:1788574563.911934:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:1.0:1788574563.912004:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:0.0:1788574563.912176:0:18872:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727782784 00000100:00100000:0.0:1788574563.912187:0:18872:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727782784 00000100:00100000:0.0:1788574563.912252:0:18872:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 1 00000100:00100000:0.0:1788574563.912260:0:18872:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7933b9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0ef7cddc-b831-4237-948c-b4fc5b50b382+21:2353:x1875455727782784:12345-192.168.201.57@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788574563.912276:0:18872:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788574563.912300:0:18872:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a7a7ac9c00/0x10531a153b5375ce lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce3e2e expref: 21 pid: 20773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574563.912320:0:18872:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff90a7829d0300) 00010000:00010000:0.0:1788574563.912325:0:18872:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788574563.912428:0:18872:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7933b9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0ef7cddc-b831-4237-948c-b4fc5b50b382+20:2353:x1875455727782784:12345-192.168.201.57@tcp:103:ldlm_bl.0 Request processed in 168us (423us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574563.912435:0:18872:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 1 00000100:00100000:3.0:1788574563.912889:0:18889:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727782656 00000100:00100000:3.0:1788574563.912895:0:18889:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727782656 00000100:00100000:3.0:1788574563.912930:0:18889:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 8 00000100:00100000:3.0:1788574563.912937:0:18889:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7933baa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0ef7cddc-b831-4237-948c-b4fc5b50b382+20:17418:x1875455727782656:12345-192.168.201.57@tcp:35:cat.0 00000100:00100000:3.0:1788574563.913228:0:18889:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7933baa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0ef7cddc-b831-4237-948c-b4fc5b50b382+21:17418:x1875455727782656:12345-192.168.201.57@tcp:35:cat.0 Request processed in 291us (1308us total) trans 12884901903 rc 0/0 00000100:00100000:3.0:1788574563.913235:0:18889:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 8 00000100:00100000:3.0:1788574563.969031:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788574563.969070:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a7933bb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1875455747699584:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788574563.969141:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788574563.969810:0:19579:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747699584 00000100:00100000:1.0:1788574563.969820:0:19579:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747699584 00000100:00100000:1.0:1788574563.969882:0:19579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1788574563.969894:0:19579:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a79245b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1875455747699584:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788574563.969939:0:19579:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788574563.970005:0:19579:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a79245b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1875455747699584:12345-0@lo:13:osp-pre-0-0.0 Request processed in 112us (863us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574563.970013:0:19579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1788574563.970491:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a7933bb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1875455747699584:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788574563.983010:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:2.0:1788574563.983267:0:18887:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727783040 00000100:00100000:2.0:1788574563.983297:0:18887:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727783040 00000100:00100000:2.0:1788574563.983395:0:18887:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 34 00000100:00100000:2.0:1788574563.983406:0:18887:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7933b9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0ef7cddc-b831-4237-948c-b4fc5b50b382+21:17424:x1875455727783040:12345-192.168.201.57@tcp:101:dd.0 00010000:00010000:2.0:1788574563.983429:0:18887:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788574563.983449:0:18887:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a7a7ac9000/0x10531a153b5375dc lrc: 2/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1d2563b34cce3e35 expref: -99 pid: 18887 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574563.983576:0:18887:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7a7ac8400/0x10531a153b5375e3 lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 18887 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574563.983591:0:18887:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90a78165a000/0x10531a153b537581 lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce3e12 expref: 22 pid: 20773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574563.983601:0:18887:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90a78165b400/0x10531a153b537596 lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce3e19 expref: 22 pid: 18887 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574563.983609:0:18887:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a7a7ac8400/0x10531a153b5375e3 lrc: 5/0,1 mode: --/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 18887 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574563.983644:0:18887:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90a78165b400/0x10531a153b537596 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce3e19 expref: 22 pid: 18887 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574563.983658:0:18887:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90a78165b400/0x10531a153b537596 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce3e19 expref: 22 pid: 18887 timeout: 790 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788574563.983672:0:18887:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a79b050700 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:18887:1875455747699712:192.168.201.57@tcp:104: 00010000:00010000:2.0:1788574563.983775:0:18887:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90a78165a000/0x10531a153b537581 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce3e12 expref: 22 pid: 20773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574563.983801:0:18887:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90a78165a000/0x10531a153b537581 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce3e12 expref: 22 pid: 20773 timeout: 790 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788574563.983812:0:18887:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a79b053800 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:18887:1875455747699840:192.168.201.57@tcp:104: 00000100:00100000:2.0:1788574563.983835:0:18887:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a7838cf780 going to sleep for 11 seconds 00000100:00100000:1.0:1788574563.991766:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:1.0:1788574563.991801:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:0.0:1788574563.991888:0:18873:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727783168 00000100:00100000:0.0:1788574563.991900:0:18873:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727783168 00010000:00010000:0.0:1788574563.991958:0:18873:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a78165b400/0x10531a153b537596 lrc: 5/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce3e19 expref: 23 pid: 18887 timeout: 790 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788574563.992001:0:18873:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727783296 00000100:00100000:0.0:1788574563.992004:0:18873:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727783296 00010000:00010000:0.0:1788574563.992037:0:18873:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a78165a000/0x10531a153b537581 lrc: 5/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce3e12 expref: 24 pid: 20773 timeout: 790 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788574563.992080:0:18873:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 11 00000100:00100000:0.0:1788574563.992094:0:18873:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7927da450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0ef7cddc-b831-4237-948c-b4fc5b50b382+24:2356:x1875455727783168:12345-192.168.201.57@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788574563.992115:0:18873:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788574563.992125:0:18873:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90a78165b400/0x10531a153b537596 lrc: 5/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce3e19 expref: 24 pid: 18887 timeout: 790 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574563.992142:0:18873:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90a78165b400/0x10531a153b537596 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce3e19 expref: 24 pid: 18887 timeout: 790 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574563.992182:0:18873:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff90a7829d0300) 00010000:00010000:0.0:1788574563.992190:0:18873:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90a7a7ac8400/0x10531a153b5375e3 lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 18887 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574563.992202:0:18873:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff90a7a7ac8400/0x10531a153b5375e3 lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 18887 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574563.992211:0:18873:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788574563.992673:0:18873:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7927da450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0ef7cddc-b831-4237-948c-b4fc5b50b382+24:2356:x1875455727783168:12345-192.168.201.57@tcp:103:ldlm_bl.0 Request processed in 213us (553us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574563.992686:0:18873:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 11 00000100:00100000:0.0:1788574563.992749:0:18873:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 12 00000100:00100000:0.0:1788574563.992757:0:18873:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7933bb800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0ef7cddc-b831-4237-948c-b4fc5b50b382+23:2356:x1875455727783296:12345-192.168.201.57@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788574563.992768:0:18873:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788574563.992773:0:18873:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90a78165a000/0x10531a153b537581 lrc: 5/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce3e12 expref: 23 pid: 20773 timeout: 790 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574563.992792:0:18873:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90a78165a000/0x10531a153b537581 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce3e12 expref: 23 pid: 20773 timeout: 790 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574563.992805:0:18873:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff90a7829d0300) 00010000:00010000:0.0:1788574563.992810:0:18873:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90a7a7ac8400/0x10531a153b5375e3 lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 18887 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574563.992818:0:18873:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90a7a7ac8400/0x10531a153b5375e3 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 18887 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574563.992826:0:18873:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a7a7ac8400/0x10531a153b5375e3 lrc: 4/0,1 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 18887 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574563.992847:0:18873:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788574563.992869:0:18873:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7933bb800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0ef7cddc-b831-4237-948c-b4fc5b50b382+23:2356:x1875455727783296:12345-192.168.201.57@tcp:103:ldlm_bl.0 Request processed in 113us (1067us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574563.992876:0:18873:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 12 00010000:00010000:2.0:1788574563.995273:0:18887:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a78165b400/0x10531a153b537596 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce3e19 expref: 22 pid: 18887 timeout: 790 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788574563.995312:0:18887:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a79b050700 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:18887:1875455747699712:192.168.201.57@tcp:104: 00010000:00010000:2.0:1788574563.995647:0:18887:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a78165a000/0x10531a153b537581 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce3e12 expref: 21 pid: 20773 timeout: 790 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788574563.995659:0:18887:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a79b053800 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:18887:1875455747699840:192.168.201.57@tcp:104: 00010000:00010000:2.0:1788574563.995688:0:18887:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90a7a7ac8400/0x10531a153b5375e3 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 18887 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574563.995699:0:18887:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90a7a7ac8400/0x10531a153b5375e3 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 18887 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574563.995705:0:18887:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a7a7ac8400/0x10531a153b5375e3 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 18887 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788574563.995728:0:18887:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00010000:00010000:2.0:1788574563.995947:0:18887:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a7a7ac9000/0x10531a153b5375dc lrc: 0/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce3e35 expref: 22 pid: 18887 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574563.995974:0:18887:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7a7ac8400/0x10531a153b5375e3 lrc: 3/0,0 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce3e35 expref: 21 pid: 18887 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574563.995982:0:18887:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff90a7829d0300) 00010000:00010000:2.0:1788574563.995985:0:18887:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1788574563.995989:0:18887:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a7a7ac8400, rc 0) 00000100:00100000:2.0:1788574563.996798:0:18887:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7933b9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0ef7cddc-b831-4237-948c-b4fc5b50b382+21:17424:x1875455727783040:12345-192.168.201.57@tcp:101:dd.0 Request processed in 13387us (13797us total) trans 12884901904 rc 0/0 00000100:00100000:2.0:1788574563.996808:0:18887:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 34 00000100:00100000:1.0:1788574564.005152:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:0.0:1788574564.011114:0:18886:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727783552 00000100:00100000:0.0:1788574564.011133:0:18886:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727783552 00000100:00080000:2.0:1788574564.011214:0:18882:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788574564.011220:0:18886:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 35 00000100:00100000:0.0:1788574564.011232:0:18886:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7933bad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0ef7cddc-b831-4237-948c-b4fc5b50b382+21:17424:x1875455727783552:12345-192.168.201.57@tcp:36:dd.0 00010000:00010000:0.0:1788574564.011598:0:18886:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90a68116b200/0x10531a153b5375f1 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 18886 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574564.011623:0:18886:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a68116b200/0x10531a153b5375f1 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 18886 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574564.011637:0:18886:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a68116b200/0x10531a153b5375f1 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18886 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788574564.011722:0:18886:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901905 00000004:00010000:0.0:1788574564.011753:0:18886:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000a5938dad reply state 0000000063ddf07e transno 12884901906 ns: mdt-lustre-MDT0000_UUID lock: ffff90a68116b200/0x10531a153b5375f1 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18886 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788574564.011766:0:18886:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788574564.011907:0:18886:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7933bad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0ef7cddc-b831-4237-948c-b4fc5b50b382+24:17424:x1875455727783552:12345-192.168.201.57@tcp:36:dd.0 Request processed in 675us (6764us total) trans 12884901906 rc 0/0 00000100:00100000:0.0:1788574564.011915:0:18886:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 35 00000020:00080000:0.0:1788574564.011920:0:18886:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1788574564.016056:0:3299:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90a68116b200/0x10531a153b5375f1 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 18886 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574564.016075:0:3299:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a68116b200/0x10531a153b5375f1 lrc: 2/0,0 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 18886 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574564.016083:0:3299:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a68116b200/0x10531a153b5375f1 lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 18886 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574564.016090:0:3299:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a68116b200 already unused, calling callback (ffffffffc1fe34f0) 00010000:00010000:0.0:1788574564.016096:0:3299:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a68116b200/0x10531a153b5375f1 lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 18886 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574564.016104:0:3299:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a68116b200/0x10531a153b5375f1 lrc: 4/0,0 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 18886 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574564.016122:0:3299:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff90a7829d0300) 00010000:00010000:0.0:1788574564.016125:0:3299:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788574564.016130:0:3299:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a68116b200/0x10531a153b5375f1 lrc: 2/0,0 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 18886 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574564.016137:0:3299:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a68116b200/0x10531a153b5375f1 lrc: 0/0,0 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 18886 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788574564.016982:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:0.0:1788574564.017277:0:18888:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727783680 00000100:00100000:0.0:1788574564.017289:0:18888:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727783680 00000100:00100000:0.0:1788574564.017355:0:18888:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 36 00000100:00100000:0.0:1788574564.017406:0:18888:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7933b8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0ef7cddc-b831-4237-948c-b4fc5b50b382+23:17424:x1875455727783680:12345-192.168.201.57@tcp:101:dd.0 00010000:00010000:0.0:1788574564.017446:0:18888:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788574564.017470:0:18888:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a68116be00/0x10531a153b5375f8 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1d2563b34cce3e3c expref: -99 pid: 18888 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574564.017558:0:18888:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a68116be00/0x10531a153b5375f8 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce3e3c expref: 24 pid: 18888 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574564.017576:0:18888:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90a68116be00/0x10531a153b5375f8 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce3e3c expref: 24 pid: 18888 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574564.017599:0:18888:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff90a7829d0300) 00010000:00010000:0.0:1788574564.017602:0:18888:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788574564.017607:0:18888:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a68116be00, rc 0) 00000100:00100000:0.0:1788574564.017687:0:18888:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7933b8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0ef7cddc-b831-4237-948c-b4fc5b50b382+24:17424:x1875455727783680:12345-192.168.201.57@tcp:101:dd.0 Request processed in 318us (712us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574564.017695:0:18888:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 36 00000001:00080000:3.0:1788574564.018214:0:5879:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 12884901894 is committed 00000001:00080000:3.0:1788574564.018224:0:5879:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 12884901890 is committed 00000001:00080000:3.0:1788574564.018231:0:5879:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 12884901896 is committed 00000001:00080000:3.0:1788574564.018235:0:5879:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 12884901902 is committed 00000001:00080000:3.0:1788574564.018243:0:5879:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 12884901895 is committed 00000001:00080000:3.0:1788574564.018252:0:5879:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 12884901903 is committed 00000100:00100000:1.0:1788574564.035466:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:0.0:1788574564.035744:0:18873:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727783936 00000100:00100000:0.0:1788574564.035756:0:18873:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727783936 00000100:00100000:0.0:1788574564.035835:0:18873:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 2 00000100:00100000:0.0:1788574564.035846:0:18873:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7933b9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0ef7cddc-b831-4237-948c-b4fc5b50b382+14:17424:x1875455727783936:12345-192.168.201.57@tcp:103:dd.0 00010000:00010000:0.0:1788574564.035863:0:18873:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788574564.035888:0:18873:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a68116be00/0x10531a153b5375f8 lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce3e3c expref: 14 pid: 18888 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574564.035922:0:18873:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff90a7829d0300) 00010000:00010000:0.0:1788574564.035927:0:18873:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788574564.035985:0:18873:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7933b9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0ef7cddc-b831-4237-948c-b4fc5b50b382+13:17424:x1875455727783936:12345-192.168.201.57@tcp:103:dd.0 Request processed in 140us (531us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574564.035993:0:18873:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 2 00000100:00100000:1.0:1788574564.038609:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:0.0:1788574564.038817:0:18886:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727784064 00000100:00100000:0.0:1788574564.038826:0:18886:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727784064 00000100:00100000:0.0:1788574564.038927:0:18886:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 37 00000100:00100000:0.0:1788574564.038938:0:18886:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7933b9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0ef7cddc-b831-4237-948c-b4fc5b50b382+13:17424:x1875455727784064:12345-192.168.201.57@tcp:58:dd.0 00010000:00010000:0.0:1788574564.039069:0:18886:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90a68116b200/0x10531a153b5375ff lrc: 3/0,1 mode: --/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 18886 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574564.039088:0:18886:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a68116b200/0x10531a153b5375ff lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 18886 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574564.039100:0:18886:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a68116b200/0x10531a153b5375ff lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18886 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788574564.039893:0:18886:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788574564.040044:0:18886:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 64 off8384 00000040:00080000:0.0:1788574564.040105:0:18886:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x14:0x0].1, 136 off8328 00000100:00100000:0.0:1788574564.040211:0:18886:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7933b9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0ef7cddc-b831-4237-948c-b4fc5b50b382+13:17424:x1875455727784064:12345-192.168.201.57@tcp:58:dd.0 Request processed in 1272us (1608us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574564.040221:0:18886:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 37 00000100:00100000:1.0:1788574564.046466:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:0.0:1788574564.046645:0:18888:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727784192 00000100:00100000:0.0:1788574564.046655:0:18888:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727784192 00000100:00100000:0.0:1788574564.046715:0:18888:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 38 00000100:00100000:0.0:1788574564.046727:0:18888:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7926b0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0ef7cddc-b831-4237-948c-b4fc5b50b382+13:17424:x1875455727784192:12345-192.168.201.57@tcp:101:dd.0 00010000:00010000:0.0:1788574564.046761:0:18888:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788574564.046784:0:18888:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a68116be00/0x10531a153b537606 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1d2563b34cce3e43 expref: -99 pid: 18888 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574564.046840:0:18888:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90a68116b200/0x10531a153b5375ff lrc: 2/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 18886 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574564.046850:0:18888:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a68116be00/0x10531a153b537606 lrc: 4/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce3e43 expref: 14 pid: 18888 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574564.046867:0:18888:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff90a68116b200/0x10531a153b5375ff lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 18886 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574564.046879:0:18888:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90a68116be00/0x10531a153b537606 lrc: 3/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce3e43 expref: 14 pid: 18888 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574564.046890:0:18888:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff90a7829d0300) 00010000:00010000:0.0:1788574564.046893:0:18888:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788574564.046896:0:18888:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff90a68116be00/0x10531a153b537606 lrc: 3/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce3e43 expref: 14 pid: 18888 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574564.046903:0:18888:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a68116be00, rc 0) 00000100:00100000:0.0:1788574564.046962:0:18888:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7926b0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0ef7cddc-b831-4237-948c-b4fc5b50b382+14:17424:x1875455727784192:12345-192.168.201.57@tcp:101:dd.0 Request processed in 237us (505us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574564.046968:0:18888:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 38 00010000:00010000:1.0:1788574564.224724:0:20565:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788574564.672898:0:18921:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:2.0:1788574564.672909:0:18921:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x14:0x0] at index 3 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788574564.672947:0:18921:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x14:0x0] index 2 count 2 00000040:00080000:2.0:1788574564.673256:0:18921:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 4 count 2 00000100:00100000:2.0:1788574564.674256:0:18921:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a79b053800 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:18921:1875455747699968:192.168.201.57@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1788574564.674720:0:18921:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a7838cfb40 going to sleep for 11 seconds 00000100:00100000:1.0:1788574564.690673:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:3.0:1788574564.691083:0:18897:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727784320 00000100:00100000:3.0:1788574564.691094:0:18897:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727784320 00000100:00100000:3.0:1788574564.691210:0:18897:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 0 00000100:00100000:3.0:1788574564.691221:0:18897:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7926b2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:0ef7cddc-b831-4237-948c-b4fc5b50b382+15:17425:x1875455727784320:12345-192.168.201.57@tcp:900:lhsmtool_posix.0 00000100:00100000:3.0:1788574564.691307:0:18897:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7926b2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:0ef7cddc-b831-4237-948c-b4fc5b50b382+15:17425:x1875455727784320:12345-192.168.201.57@tcp:900:lhsmtool_posix.0 Request processed in 87us (644us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574564.691314:0:18897:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 0 00000100:00100000:2.0:1788574564.695179:0:18921:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a79b053800 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:18921:1875455747699968:192.168.201.57@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1788574564.703004:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:2.0:1788574564.703168:0:20773:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727784448 00000100:00100000:2.0:1788574564.703179:0:20773:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727784448 00000100:00100000:2.0:1788574564.703291:0:20773:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 39 00000100:00100000:2.0:1788574564.703314:0:20773:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7926b2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0ef7cddc-b831-4237-948c-b4fc5b50b382+14:17425:x1875455727784448:12345-192.168.201.57@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1788574564.703434:0:20773:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x2000013a1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1788574564.703570:0:20773:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7926b2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0ef7cddc-b831-4237-948c-b4fc5b50b382+14:17425:x1875455727784448:12345-192.168.201.57@tcp:53:lhsmtool_posix.0 Request processed in 258us (576us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574564.703595:0:20773:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 39 00000100:00100000:1.0:1788574564.716238:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:0.0:1788574564.716704:0:18888:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727784576 00000100:00100000:0.0:1788574564.716726:0:18888:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727784576 00000100:00100000:0.0:1788574564.716847:0:18888:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 40 00000100:00100000:0.0:1788574564.717136:0:18888:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7926b3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0ef7cddc-b831-4237-948c-b4fc5b50b382+14:17425:x1875455727784576:12345-192.168.201.57@tcp:34:lhsmtool_posix.0 00010000:00010000:0.0:1788574564.717274:0:18888:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a68116ae00/0x10531a153b53760d lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 18888 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574564.717300:0:18888:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a68116ae00/0x10531a153b53760d lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 18888 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574564.717316:0:18888:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a68116ae00/0x10531a153b53760d lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18888 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574564.717460:0:18888:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a68116a000/0x10531a153b537614 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 18888 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574564.717469:0:18888:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a68116a000/0x10531a153b537614 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18888 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574564.717476:0:18888:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a68116a000/0x10531a153b537614 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 18888 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574564.717518:0:18888:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a68116ac00/0x10531a153b53761b lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 18888 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574564.717526:0:18888:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a68116ac00/0x10531a153b53761b lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 18888 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574564.717534:0:18888:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a68116ac00/0x10531a153b53761b lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 18888 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788574564.717595:0:18888:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00000004:00200000:0.0:1788574564.717602:0:18888:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1788574564.717627:0:18888:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90a68116ac00/0x10531a153b53761b lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 18888 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574564.717656:0:18888:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a68116ae00/0x10531a153b53760d lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 18888 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574564.717663:0:18888:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a68116ae00/0x10531a153b53760d lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 18888 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574564.717671:0:18888:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a68116ae00/0x10531a153b53760d lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 18888 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574564.717678:0:18888:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a68116ae00 already unused, calling callback (ffffffffc1fe34f0) 00010000:00010000:0.0:1788574564.717684:0:18888:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a68116ae00/0x10531a153b53760d lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 18888 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574564.717692:0:18888:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a68116ae00/0x10531a153b53760d lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 18888 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574564.717706:0:18888:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff90a791e2f000) 00010000:00010000:0.0:1788574564.717709:0:18888:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788574564.717714:0:18888:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a68116ae00/0x10531a153b53760d lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 18888 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574564.717722:0:18888:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a68116ae00/0x10531a153b53760d lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 18888 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574564.717739:0:18888:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a68116a000/0x10531a153b537614 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18888 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574564.717745:0:18888:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a68116a000/0x10531a153b537614 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 18888 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574564.717751:0:18888:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a68116a000/0x10531a153b537614 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 18888 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574564.717763:0:18888:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a68116a000 already unused, calling callback (ffffffffc1fe34f0) 00010000:00010000:0.0:1788574564.717767:0:18888:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a68116a000/0x10531a153b537614 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 18888 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574564.717772:0:18888:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a68116a000/0x10531a153b537614 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 18888 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574564.717779:0:18888:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x925dcd63 (ffff90a797af6d00) 00010000:00010000:0.0:1788574564.717794:0:18888:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788574564.717798:0:18888:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a68116a000/0x10531a153b537614 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 18888 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574564.717804:0:18888:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a68116a000/0x10531a153b537614 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 18888 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574564.717821:0:18888:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a68116ac00/0x10531a153b53761b lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 18888 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574564.717827:0:18888:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a68116ac00/0x10531a153b53761b lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 18888 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574564.717832:0:18888:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a68116ac00/0x10531a153b53761b lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 18888 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574564.717838:0:18888:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a68116ac00 already unused, calling callback (ffffffffc1fe34f0) 00010000:00010000:0.0:1788574564.717841:0:18888:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a68116ac00/0x10531a153b53761b lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 18888 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574564.717849:0:18888:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a68116ac00/0x10531a153b53761b lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 18888 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574564.717867:0:18888:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff90a7829d0300) 00010000:00010000:0.0:1788574564.717869:0:18888:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788574564.717873:0:18888:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a68116ac00/0x10531a153b53761b lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 18888 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574564.717878:0:18888:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a68116ac00/0x10531a153b53761b lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 18888 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788574564.718029:0:18888:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7926b3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0ef7cddc-b831-4237-948c-b4fc5b50b382+14:17425:x1875455727784576:12345-192.168.201.57@tcp:34:lhsmtool_posix.0 Request processed in 900us (1803us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574564.720832:0:18888:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 40 00000100:00100000:1.0:1788574564.726710:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:0.0:1788574564.726828:0:18886:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727784832 00000100:00100000:0.0:1788574564.726849:0:18886:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727784832 00000100:00100000:0.0:1788574564.726925:0:18886:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 41 00000100:00100000:0.0:1788574564.726938:0:18886:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7926b3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0ef7cddc-b831-4237-948c-b4fc5b50b382+14:17425:x1875455727784832:12345-192.168.201.57@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788574564.726966:0:18886:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788574564.726991:0:18886:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a68116ac00/0x10531a153b537622 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1d2563b34cce3e4a expref: -99 pid: 18886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574564.727429:0:18886:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a68116a000/0x10531a153b537629 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 18886 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574564.727448:0:18886:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a68116a000/0x10531a153b537629 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 18886 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574564.727462:0:18886:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a68116a000/0x10531a153b537629 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 18886 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788574564.727475:0:18886:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00010000:00010000:0.0:1788574564.727628:0:18886:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a68116a000/0x10531a153b537629 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 18886 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574564.727637:0:18886:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a68116a000/0x10531a153b537629 lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 18886 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574564.727645:0:18886:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a68116a000/0x10531a153b537629 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 18886 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574564.727651:0:18886:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a68116a000 already unused, calling callback (ffffffffc1fe34f0) 00010000:00010000:0.0:1788574564.727656:0:18886:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a68116a000/0x10531a153b537629 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 18886 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574564.727664:0:18886:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a68116a000/0x10531a153b537629 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 18886 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574564.727679:0:18886:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff90a7829d0300) 00010000:00010000:0.0:1788574564.727683:0:18886:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1788574564.727690:0:18886:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a68116a000/0x10531a153b537629 lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 18886 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574564.727697:0:18886:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a68116a000/0x10531a153b537629 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 18886 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574564.727751:0:18886:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90a68116ac00/0x10531a153b537622 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce3e4a expref: 16 pid: 18886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574564.727763:0:18886:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff90a791e2f000) 00010000:00010000:0.0:1788574564.727765:0:18886:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788574564.727769:0:18886:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a68116ac00/0x10531a153b537622 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce3e4a expref: 16 pid: 18886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574564.727790:0:18886:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a68116ac00, rc 0) 00000100:00100000:0.0:1788574564.727882:0:18886:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7926b3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0ef7cddc-b831-4237-948c-b4fc5b50b382+15:17425:x1875455727784832:12345-192.168.201.57@tcp:101:lhsmtool_posix.0 Request processed in 946us (1183us total) trans 12884901907 rc 301/301 00000100:00100000:0.0:1788574564.727891:0:18886:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 41 00000100:00100000:1.0:1788574564.740226:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:2.0:1788574564.740663:0:18887:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727784960 00000100:00100000:2.0:1788574564.740676:0:18887:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727784960 00000100:00100000:2.0:1788574564.740797:0:18887:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 42 00000100:00100000:2.0:1788574564.740810:0:18887:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7926b2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0ef7cddc-b831-4237-948c-b4fc5b50b382+15:17425:x1875455727784960:12345-192.168.201.57@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1788574564.740875:0:18887:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x2000013a1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1788574564.741017:0:18887:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7926b2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0ef7cddc-b831-4237-948c-b4fc5b50b382+15:17425:x1875455727784960:12345-192.168.201.57@tcp:53:lhsmtool_posix.0 Request processed in 210us (805us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574564.741026:0:18887:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 42 00000100:00100000:1.0:1788574564.744970:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:2.0:1788574564.745410:0:20773:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727785216 00000100:00100000:2.0:1788574564.745421:0:20773:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727785216 00000100:00100000:2.0:1788574564.745476:0:20773:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 43 00000100:00100000:2.0:1788574564.745487:0:20773:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7926b0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0ef7cddc-b831-4237-948c-b4fc5b50b382+15:17425:x1875455727785216:12345-192.168.201.57@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788574564.745515:0:20773:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788574564.745540:0:20773:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a7a7ac9000/0x10531a153b537637 lrc: 2/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1d2563b34cce3e51 expref: -99 pid: 20773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788574564.748565:0:20773:0:(osp_internal.h:553:osp_update_last_fid()) Gap in objids: start=[0x240000400:0x7:0x0], count =59 00000004:00080000:2.0:1788574564.748582:0:20773:0:(osp_object.c:1645:osp_create()) Writing gap [0x240000400:0x7:0x0]+59 in llog 00000004:00080000:2.0:1788574564.748641:0:20773:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x42:0x0], index 0: 0 00010000:00010000:2.0:1788574564.749345:0:20773:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7a7ac8200/0x10531a153b53763e lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 20773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574564.749364:0:20773:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a7a7ac8200/0x10531a153b53763e lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 20773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574564.749954:0:20773:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a7a7ac8200/0x10531a153b53763e lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 20773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574564.750794:0:20773:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a7a7ac9000/0x10531a153b537637 lrc: 0/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce3e51 expref: 18 pid: 20773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574564.750820:0:20773:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7a7ac8200/0x10531a153b53763e lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce3e51 expref: 17 pid: 20773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574564.750829:0:20773:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff90a791e2fc00) 00010000:00010000:2.0:1788574564.750832:0:20773:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788574564.750836:0:20773:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a7a7ac8200, rc 0) 00000100:00100000:2.0:1788574564.751020:0:20773:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7926b0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0ef7cddc-b831-4237-948c-b4fc5b50b382+17:17425:x1875455727785216:12345-192.168.201.57@tcp:101:lhsmtool_posix.0 Request processed in 5533us (6062us total) trans 12884901908 rc 0/0 00000100:00100000:2.0:1788574564.751029:0:20773:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 43 00000100:00100000:1.0:1788574564.759316:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:0.0:1788574564.759426:0:18888:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727785472 00000100:00100000:0.0:1788574564.759437:0:18888:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727785472 00000100:00100000:0.0:1788574564.759496:0:18888:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 44 00000100:00100000:0.0:1788574564.759516:0:18888:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7926b2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0ef7cddc-b831-4237-948c-b4fc5b50b382+17:17425:x1875455727785472:12345-192.168.201.57@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1788574564.759591:0:18888:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788574564.759619:0:18888:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a7a7ac8200/0x10531a153b53763e lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce3e51 expref: 17 pid: 20773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574564.759639:0:18888:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff90a791e2fc00) 00010000:00010000:0.0:1788574564.759652:0:18888:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788574564.759675:0:18888:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90a68116ac00/0x10531a153b53764c lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 18888 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574564.759687:0:18888:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a68116ac00/0x10531a153b53764c lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 18888 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574564.759697:0:18888:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a68116ac00/0x10531a153b53764c lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18888 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574564.759754:0:18888:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90a68116a000/0x10531a153b537653 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x1:0x0].0x6825dab4 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 18888 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574564.759762:0:18888:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a68116a000/0x10531a153b537653 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x6825dab4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18888 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574564.759793:0:18888:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a68116a000/0x10531a153b537653 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x6825dab4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 18888 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574564.760348:0:18888:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90a68116ac00/0x10531a153b53764c lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 18888 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574564.760359:0:18888:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a68116ac00/0x10531a153b53764c lrc: 2/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 18888 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574564.760710:0:18888:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a68116ac00/0x10531a153b53764c lrc: 3/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 18888 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574564.760719:0:18888:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a68116ac00 already unused, calling callback (ffffffffc1fe34f0) 00010000:00010000:0.0:1788574564.760724:0:18888:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a68116ac00/0x10531a153b53764c lrc: 3/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 18888 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574564.760734:0:18888:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a68116ac00/0x10531a153b53764c lrc: 4/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 18888 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574564.760745:0:18888:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff90a797af6600) 00010000:00010000:0.0:1788574564.760748:0:18888:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788574564.760752:0:18888:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a68116ac00/0x10531a153b53764c lrc: 2/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 18888 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574564.760759:0:18888:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a68116ac00/0x10531a153b53764c lrc: 0/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 18888 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574564.760772:0:18888:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90a68116a000/0x10531a153b537653 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x6825dab4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18888 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574564.760779:0:18888:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a68116a000/0x10531a153b537653 lrc: 2/0,0 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x6825dab4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 18888 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574564.761027:0:18888:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a68116a000/0x10531a153b537653 lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x6825dab4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 18888 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574564.761107:0:18888:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a68116a000 already unused, calling callback (ffffffffc1fe34f0) 00010000:00010000:0.0:1788574564.761111:0:18888:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a68116a000/0x10531a153b537653 lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x6825dab4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 18888 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574564.761117:0:18888:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a68116a000/0x10531a153b537653 lrc: 4/0,0 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x6825dab4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 18888 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574564.761125:0:18888:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x6825dab4 (ffff90a797af6d00) 00010000:00010000:0.0:1788574564.761127:0:18888:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788574564.761131:0:18888:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a68116a000/0x10531a153b537653 lrc: 2/0,0 mode: --/PW res: [0x2000013a1:0x1:0x0].0x6825dab4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 18888 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574564.761137:0:18888:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a68116a000/0x10531a153b537653 lrc: 0/0,0 mode: --/PW res: [0x2000013a1:0x1:0x0].0x6825dab4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 18888 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788574564.761249:0:18888:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7926b2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0ef7cddc-b831-4237-948c-b4fc5b50b382+16:17425:x1875455727785472:12345-192.168.201.57@tcp:36:lhsmtool_posix.0 Request processed in 1739us (1949us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788574564.761258:0:18888:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 44 00000100:00100000:1.0:1788574564.765925:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:0.0:1788574564.766069:0:18886:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727785600 00000100:00100000:0.0:1788574564.766080:0:18886:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727785600 00000100:00100000:0.0:1788574564.766145:0:18886:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 45 00000100:00100000:0.0:1788574564.766157:0:18886:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7926b0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0ef7cddc-b831-4237-948c-b4fc5b50b382+16:17425:x1875455727785600:12345-192.168.201.57@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788574564.766177:0:18886:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788574564.766202:0:18886:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a68116ae00/0x10531a153b53765a lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1d2563b34cce3e58 expref: -99 pid: 18886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574564.766266:0:18886:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a68116a800/0x10531a153b537661 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 18886 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574564.766281:0:18886:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a68116a800/0x10531a153b537661 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 18886 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574564.766295:0:18886:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a68116a800/0x10531a153b537661 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18886 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574564.766696:0:18886:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a68116ae00/0x10531a153b53765a lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce3e58 expref: 18 pid: 18886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574564.766716:0:18886:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90a68116a800/0x10531a153b537661 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce3e58 expref: 17 pid: 18886 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574564.766725:0:18886:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff90a797af6b00) 00010000:00010000:0.0:1788574564.766728:0:18886:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1788574564.766731:0:18886:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a68116a800, rc 0) 00000100:00100000:0.0:1788574564.766787:0:18886:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7926b0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0ef7cddc-b831-4237-948c-b4fc5b50b382+17:17425:x1875455727785600:12345-192.168.201.57@tcp:101:lhsmtool_posix.0 Request processed in 633us (871us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574564.766794:0:18886:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 45 00000100:00100000:1.0:1788574564.776073:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:2.0:1788574564.776832:0:18887:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727785856 00000100:00100000:2.0:1788574564.776847:0:18887:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727785856 00000100:00100000:2.0:1788574564.776921:0:18887:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 46 00000100:00100000:2.0:1788574564.776933:0:18887:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7926b1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0ef7cddc-b831-4237-948c-b4fc5b50b382+17:17425:x1875455727785856:12345-192.168.201.57@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1788574564.777048:0:18887:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7a7ac9000/0x10531a153b537668 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 18887 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574564.777075:0:18887:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a7a7ac9000/0x10531a153b537668 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 18887 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574564.777088:0:18887:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a7a7ac9000/0x10531a153b537668 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18887 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788574564.777904:0:18887:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x10:0x0].2, 88 off8344 00000004:00080000:2.0:1788574564.777919:0:18887:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 690952550705ns, next at 691952547482ns, rc = 0 00000004:00010000:2.0:1788574564.778050:0:18887:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000a8e7e1df reply state 000000006eb1507b transno 12884901909 ns: mdt-lustre-MDT0000_UUID lock: ffff90a7a7ac9000/0x10531a153b537668 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18887 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788574564.778061:0:18887:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788574564.778168:0:18887:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7926b1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0ef7cddc-b831-4237-948c-b4fc5b50b382+19:17425:x1875455727785856:12345-192.168.201.57@tcp:36:lhsmtool_posix.0 Request processed in 1235us (2108us total) trans 12884901909 rc 0/0 00000100:00100000:2.0:1788574564.778176:0:18887:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 46 00010000:00010000:3.0:1788574564.784886:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7a7ac9000/0x10531a153b537668 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 18887 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574564.784907:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a7a7ac9000/0x10531a153b537668 lrc: 2/0,0 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 18887 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574564.784915:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a7a7ac9000/0x10531a153b537668 lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 18887 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574564.784920:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a7a7ac9000 already unused, calling callback (ffffffffc1fe34f0) 00010000:00010000:3.0:1788574564.784926:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a7a7ac9000/0x10531a153b537668 lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 18887 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574564.784956:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a7a7ac9000/0x10531a153b537668 lrc: 4/0,0 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 18887 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574564.784974:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff90a797af6b00) 00010000:00010000:3.0:1788574564.784977:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1788574564.784983:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a7a7ac9000/0x10531a153b537668 lrc: 2/0,0 mode: --/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 18887 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574564.784990:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a7a7ac9000/0x10531a153b537668 lrc: 0/0,0 mode: --/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 18887 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788574564.792434:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:2.0:1788574564.792744:0:20773:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727785984 00000100:00100000:2.0:1788574564.792759:0:20773:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727785984 00000100:00100000:2.0:1788574564.792839:0:20773:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 47 00000100:00100000:2.0:1788574564.792852:0:20773:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7926b0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0ef7cddc-b831-4237-948c-b4fc5b50b382+18:17425:x1875455727785984:12345-192.168.201.57@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788574564.792885:0:20773:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788574564.792914:0:20773:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a7a7ac9600/0x10531a153b53766f lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1d2563b34cce3e5f expref: -99 pid: 20773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574564.792993:0:20773:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a7a7ac9600/0x10531a153b53766f lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce3e5f expref: 19 pid: 20773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574564.793012:0:20773:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7a7ac9600/0x10531a153b53766f lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce3e5f expref: 19 pid: 20773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574564.793037:0:20773:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff90a797af6b00) 00010000:00010000:2.0:1788574564.793041:0:20773:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788574564.793047:0:20773:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a7a7ac9600, rc 0) 00000100:00100000:2.0:1788574564.793141:0:20773:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7926b0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0ef7cddc-b831-4237-948c-b4fc5b50b382+19:17425:x1875455727785984:12345-192.168.201.57@tcp:101:lhsmtool_posix.0 Request processed in 291us (789us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574564.793149:0:20773:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 47 00000100:00100000:1.0:1788574564.799804:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:0.0:1788574564.799926:0:20780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727786112 00000100:00100000:0.0:1788574564.799939:0:20780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727786112 00000100:00100000:0.0:1788574564.800047:0:20780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 14 00000100:00100000:0.0:1788574564.800060:0:20780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7926b0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0ef7cddc-b831-4237-948c-b4fc5b50b382+5:2356:x1875455727786112:12345-192.168.201.57@tcp:2:lhsmtool_posix.0 00000100:00100000:0.0:1788574564.800658:0:20780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7926b0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0ef7cddc-b831-4237-948c-b4fc5b50b382+6:2356:x1875455727786112:12345-192.168.201.57@tcp:2:lhsmtool_posix.0 Request processed in 598us (871us total) trans 12884901890 rc 0/0 00000100:00100000:0.0:1788574564.800693:0:20780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 14 00000100:00080000:2.0:1788574564.801765:0:18882:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788574564.813674:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:3.0:1788574564.816161:0:18889:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727786368 00000100:00100000:3.0:1788574564.816179:0:18889:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727786368 00000100:00100000:3.0:1788574564.816314:0:18889:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 9 00000100:00100000:3.0:1788574564.816326:0:18889:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7926b1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0ef7cddc-b831-4237-948c-b4fc5b50b382+19:17425:x1875455727786368:12345-192.168.201.57@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1788574564.816793:0:18889:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7926b1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0ef7cddc-b831-4237-948c-b4fc5b50b382+20:17425:x1875455727786368:12345-192.168.201.57@tcp:35:lhsmtool_posix.0 Request processed in 467us (3127us total) trans 12884901910 rc 0/0 00000100:00100000:3.0:1788574564.816803:0:18889:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 9 00000100:00100000:1.0:1788574564.820971:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:2.0:1788574564.821139:0:18887:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727786624 00000100:00100000:2.0:1788574564.821149:0:18887:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727786624 00000100:00100000:2.0:1788574564.821201:0:18887:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 48 00000100:00100000:2.0:1788574564.821211:0:18887:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7926b1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0ef7cddc-b831-4237-948c-b4fc5b50b382+20:17425:x1875455727786624:12345-192.168.201.57@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1788574564.821320:0:18887:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7926b1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0ef7cddc-b831-4237-948c-b4fc5b50b382+20:17425:x1875455727786624:12345-192.168.201.57@tcp:57:lhsmtool_posix.0 Request processed in 110us (367us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574564.821336:0:18887:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 48 00000100:00100000:1.0:1788574564.824720:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:2.0:1788574564.824868:0:20773:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727786752 00000100:00100000:2.0:1788574564.824879:0:20773:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727786752 00000100:00100000:2.0:1788574564.824938:0:20773:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 49 00000100:00100000:2.0:1788574564.824948:0:20773:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7926b1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0ef7cddc-b831-4237-948c-b4fc5b50b382+20:17425:x1875455727786752:12345-192.168.201.57@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788574564.825105:0:20773:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788574564.825126:0:20773:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a7a7ac9a00/0x10531a153b537676 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1d2563b34cce3e66 expref: -99 pid: 20773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574564.825215:0:20773:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7a7ac8800/0x10531a153b53767d lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 20773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574564.825231:0:20773:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a7a7ac8800/0x10531a153b53767d lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 20773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574564.825242:0:20773:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a7a7ac8800/0x10531a153b53767d lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 20773 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788574564.825274:0:20773:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1788574564.825290:0:20773:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90a7a7ac8800/0x10531a153b53767d lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 20773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574564.825312:0:20773:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a7a7ac9a00/0x10531a153b537676 lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce3e66 expref: 22 pid: 20773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574564.825334:0:20773:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7a7ac8800/0x10531a153b53767d lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce3e66 expref: 21 pid: 20773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574564.825343:0:20773:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff90a797af6b00) 00010000:00010000:2.0:1788574564.825346:0:20773:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1788574564.825349:0:20773:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a7a7ac8800, rc 0) 00000100:00100000:2.0:1788574564.825637:0:20773:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7926b1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0ef7cddc-b831-4237-948c-b4fc5b50b382+21:17425:x1875455727786752:12345-192.168.201.57@tcp:101:lhsmtool_posix.0 Request processed in 561us (798us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574564.825645:0:20773:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 49 00000100:00100000:1.0:1788574564.830227:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:0.0:1788574564.830400:0:19577:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727786880 00000100:00100000:0.0:1788574564.830410:0:19577:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727786880 00000100:00100000:0.0:1788574564.830472:0:19577:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 15 00000100:00100000:0.0:1788574564.830482:0:19577:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7926b3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0ef7cddc-b831-4237-948c-b4fc5b50b382+6:2355:x1875455727786880:12345-192.168.201.57@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788574564.830505:0:19577:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788574564.830753:0:19577:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a6d5f548/0x10531a153b537684 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x42:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1d2563b34cce3e6d expref: -99 pid: 19577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788574564.830788:0:19577:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x42:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a9b7b65, blocks: 0x1 00010000:00010000:0.0:1788574564.830811:0:19577:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x42:0x0].0x0 since=691s v=(0 0) 00010000:00010000:0.0:1788574564.830816:0:19577:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788574564.830828:0:19577:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a6d5f548/0x10531a153b537684 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce3e6d expref: 7 pid: 19577 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574564.830850:0:19577:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000a6d5f548/0x10531a153b537684 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce3e6d expref: 7 pid: 19577 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574564.830866:0:19577:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a68116ae00, rc 0) 00000100:00100000:0.0:1788574564.830954:0:19577:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7926b3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0ef7cddc-b831-4237-948c-b4fc5b50b382+7:2355:x1875455727786880:12345-192.168.201.57@tcp:101:lhsmtool_posix.0 Request processed in 472us (736us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574564.831108:0:19577:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 15 00000100:00100000:1.0:1788574564.835101:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:2.0:1788574564.836126:0:18887:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727787136 00000100:00100000:2.0:1788574564.836144:0:18887:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727787136 00000100:00100000:2.0:1788574564.836259:0:18887:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 50 00000100:00100000:2.0:1788574564.836270:0:18887:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7926b3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0ef7cddc-b831-4237-948c-b4fc5b50b382+21:17425:x1875455727787136:12345-192.168.201.57@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1788574564.836687:0:18887:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7926b3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0ef7cddc-b831-4237-948c-b4fc5b50b382+21:17425:x1875455727787136:12345-192.168.201.57@tcp:57:lhsmtool_posix.0 Request processed in 417us (1595us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574564.836695:0:18887:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 50 00000100:00100000:0.0:1788574564.840951:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:1.0:1788574564.841227:0:18886:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727787264 00000100:00100000:1.0:1788574564.841243:0:18886:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727787264 00000100:00100000:1.0:1788574564.841746:0:18886:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 51 00000100:00100000:1.0:1788574564.841761:0:18886:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a78e0eb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0ef7cddc-b831-4237-948c-b4fc5b50b382+21:17425:x1875455727787264:12345-192.168.201.57@tcp:44:lhsmtool_posix.0 00000001:00080000:3.0:1788574564.915770:0:5879:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 12884901907 is committed 00000001:00080000:3.0:1788574564.915798:0:5879:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 12884901909 is committed 00000004:00080000:3.0:1788574564.915804:0:5879:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2 committed 00000001:00080000:3.0:1788574564.915833:0:5879:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 12884901910 is committed 00000100:00100000:1.0:1788574564.916053:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788574564.916082:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a7926b1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1875455747700096:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1788574564.916188:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788574564.916291:0:20780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747700096 00000100:00100000:1.0:1788574564.916301:0:20780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747700096 00000100:00100000:1.0:1788574564.916359:0:20780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1788574564.916858:0:20780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7a788ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3312:x1875455747700096:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1788574564.917298:0:20780:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x42:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1788574564.917304:0:20780:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x42:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:1.0:1788574564.917307:0:20780:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x42:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1788574564.917309:0:20780:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x42:0x0] updating lvb ctime from disk: 1788574565 -> 1788574565 00002000:00010000:1.0:1788574564.917313:0:20780:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x42:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:0.0:1788574564.917918:0:18886:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a78e0eb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0ef7cddc-b831-4237-948c-b4fc5b50b382+14:17425:x1875455727787264:12345-192.168.201.57@tcp:44:lhsmtool_posix.0 Request processed in 76148us (76966us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574564.917970:0:18886:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 51 00000100:00100000:1.0:1788574564.918205:0:20780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7a788ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3312:x1875455747700096:12345-0@lo:2:osp-syn-0-0.0 Request processed in 1836us (2016us total) trans 12884901891 rc 0/0 00000100:00100000:1.0:1788574564.918217:0:20780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000004:00080000:3.0:1788574564.924790:0:3312:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff90a7926b1c00/2, rc 0, transno 12884901891 00000100:00100000:3.0:1788574564.924815:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a7926b1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1875455747700096:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1788574564.925160:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:3.0:1788574564.925797:0:19576:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727787392 00000100:00100000:3.0:1788574564.925811:0:19576:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727787392 00000100:00100000:3.0:1788574564.925887:0:19576:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 17 00000100:00100000:3.0:1788574564.925900:0:19576:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7a788f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0ef7cddc-b831-4237-948c-b4fc5b50b382+7:2356:x1875455727787392:12345-192.168.201.57@tcp:16:lhsmtool_posix.0 00000100:00100000:3.0:1788574564.926187:0:19576:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7a788f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0ef7cddc-b831-4237-948c-b4fc5b50b382+7:2356:x1875455727787392:12345-192.168.201.57@tcp:16:lhsmtool_posix.0 Request processed in 290us (1031us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574564.926196:0:19576:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 17 00000100:00100000:1.0:1788574564.936625:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:0.0:1788574564.936838:0:18888:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727787648 00000100:00100000:0.0:1788574564.936849:0:18888:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727787648 00000100:00100000:0.0:1788574564.936981:0:18888:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 52 00000100:00100000:0.0:1788574564.936996:0:18888:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7a788d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0ef7cddc-b831-4237-948c-b4fc5b50b382+14:17425:x1875455727787648:12345-192.168.201.57@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1788574564.937089:0:18888:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788574564.937130:0:18888:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a7a7ac8800/0x10531a153b53767d lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce3e66 expref: 14 pid: 20773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574564.937159:0:18888:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff90a797af6b00) 00010000:00010000:0.0:1788574564.937166:0:18888:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788574564.937203:0:18888:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90a68116a000/0x10531a153b53768b lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 18888 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574564.937218:0:18888:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a68116a000/0x10531a153b53768b lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 18888 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574564.937229:0:18888:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a68116a000/0x10531a153b53768b lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 18888 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788574564.940097:0:18888:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000007a27ed52 reply state 000000005dc13ff9 transno 12884901911 ns: mdt-lustre-MDT0000_UUID lock: ffff90a68116a000/0x10531a153b53768b lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 18888 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788574564.940122:0:18888:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788574564.940323:0:18888:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7a788d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0ef7cddc-b831-4237-948c-b4fc5b50b382+15:17425:x1875455727787648:12345-192.168.201.57@tcp:36:lhsmtool_posix.0 Request processed in 3324us (3711us total) trans 12884901911 rc 0/0 00000100:00100000:1.0:1788574564.940334:0:18888:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 52 00010000:00010000:3.0:1788574564.944670:0:3299:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90a68116a000/0x10531a153b53768b lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 18888 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574564.944705:0:3299:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a68116a000/0x10531a153b53768b lrc: 2/0,0 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 18888 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574564.944715:0:3299:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a68116a000/0x10531a153b53768b lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 18888 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574564.944723:0:3299:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a68116a000 already unused, calling callback (ffffffffc1fe34f0) 00010000:00010000:3.0:1788574564.944732:0:3299:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a68116a000/0x10531a153b53768b lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 18888 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574564.944743:0:3299:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a68116a000/0x10531a153b53768b lrc: 4/0,0 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 18888 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574564.944772:0:3299:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff90a797af6b00) 00010000:00010000:3.0:1788574564.944776:0:3299:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788574564.944784:0:3299:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a68116a000/0x10531a153b53768b lrc: 2/0,0 mode: --/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 18888 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574564.944792:0:3299:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a68116a000/0x10531a153b53768b lrc: 0/0,0 mode: --/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 18888 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788574564.947292:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:0.0:1788574564.948638:0:20780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727787776 00000100:00100000:0.0:1788574564.948651:0:20780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727787776 00000100:00100000:0.0:1788574564.948716:0:20780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 18 00000100:00100000:0.0:1788574564.948727:0:20780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a79b053800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0ef7cddc-b831-4237-948c-b4fc5b50b382+7:17425:x1875455727787776:12345-192.168.201.57@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788574564.948746:0:20780:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788574564.948769:0:20780:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000007114780/0x10531a153b537692 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x42:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1d2563b34cce3e74 expref: -99 pid: 20780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574564.948822:0:20780:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000a6d5f548/0x10531a153b537684 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce3e6d expref: 8 pid: 19577 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574564.948832:0:20780:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788574564.948837:0:20780:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788574564.948842:0:20780:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000007114780/0x10531a153b537692 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce3e74 expref: 8 pid: 20780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574564.948882:0:20780:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000a6d5f548/0x10531a153b537684 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce3e6d expref: 8 pid: 19577 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574564.948896:0:20780:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000a6d5f548/0x10531a153b537684 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce3e6d expref: 8 pid: 19577 timeout: 791 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788574564.948912:0:20780:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a78e0eb800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:20780:1875455747700224:192.168.201.57@tcp:104: 00000100:00100000:0.0:1788574564.950174:0:20780:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a78c8cf3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788574564.964062:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:2.0:1788574564.964205:0:18871:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727787904 00000100:00100000:2.0:1788574564.964216:0:18871:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727787904 00010000:00010000:2.0:1788574564.964268:0:18871:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000a6d5f548/0x10531a153b537684 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce3e6d expref: 9 pid: 19577 timeout: 791 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788574564.964321:0:18871:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 13 00000100:00100000:2.0:1788574564.964332:0:18871:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a78e0e8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0ef7cddc-b831-4237-948c-b4fc5b50b382+9:2356:x1875455727787904:12345-192.168.201.57@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1788574564.965152:0:20780:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a78e0eb800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:20780:1875455747700224:192.168.201.57@tcp:104: 00010000:00010000:1.0:1788574564.965200:0:20780:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000007114780/0x10531a153b537692 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce3e74 expref: 9 pid: 20780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574564.965223:0:20780:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a68116bc00, rc 0) 00000100:00100000:1.0:1788574564.965302:0:20780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a79b053800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0ef7cddc-b831-4237-948c-b4fc5b50b382+9:17425:x1875455727787776:12345-192.168.201.57@tcp:101:lhsmtool_posix.0 Request processed in 16577us (18022us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574564.965311:0:20780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 18 00010000:00010000:2.0:1788574564.965465:0:18871:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788574564.965499:0:18871:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000a6d5f548/0x10531a153b537684 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x42:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce3e6d expref: 8 pid: 19577 timeout: 791 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574564.965525:0:18871:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000a6d5f548/0x10531a153b537684 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x42:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce3e6d expref: 8 pid: 19577 timeout: 791 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574564.966323:0:18871:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a6d5f548/0x10531a153b537684 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x42:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce3e6d expref: 8 pid: 19577 timeout: 791 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574564.966349:0:18871:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788574564.966354:0:18871:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788574564.966362:0:18871:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000007114780/0x10531a153b537692 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce3e74 expref: 7 pid: 20780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574564.966448:0:18871:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000007114780/0x10531a153b537692 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce3e74 expref: 7 pid: 20780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574564.966518:0:18871:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 0000000007114780/0x10531a153b537692 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce3e74 expref: 7 pid: 20780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788574564.968287:0:18871:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a79b050700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:18871:1875455747700352:192.168.201.57@tcp:105: 00000100:00100000:2.0:1788574564.968499:0:18871:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a7a74facc0 going to sleep for 11 seconds 00000100:00100000:2.0:1788574564.976362:0:18871:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a79b050700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:18871:1875455747700352:192.168.201.57@tcp:105: 00010000:00010000:2.0:1788574564.976435:0:18871:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788574564.976500:0:18871:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a78e0e8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0ef7cddc-b831-4237-948c-b4fc5b50b382+7:2356:x1875455727787904:12345-192.168.201.57@tcp:103:ldlm_bl.0 Request processed in 12169us (12449us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574564.976521:0:18871:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 13 00000100:00100000:1.0:1788574564.982682:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:3.0:1788574564.982822:0:19576:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727788032 00000100:00100000:3.0:1788574564.982832:0:19576:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727788032 00000100:00100000:3.0:1788574564.982887:0:19576:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 19 00000100:00100000:3.0:1788574564.982895:0:19576:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7a788df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0ef7cddc-b831-4237-948c-b4fc5b50b382+7:2355:x1875455727788032:12345-192.168.201.57@tcp:2:lhsmtool_posix.0 00002000:00010000:3.0:1788574564.983087:0:19576:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x42:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1788574564.983090:0:19576:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x42:0x0] updating lvb mtime from disk: 0 -> 1788574564 00002000:00010000:3.0:1788574564.983092:0:19576:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x42:0x0] updating lvb atime from disk: 0 -> 1788574563 00002000:00010000:3.0:1788574564.983093:0:19576:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x42:0x0] updating lvb ctime from disk: 1788574565 -> 1788574564 00002000:00010000:3.0:1788574564.983095:0:19576:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x42:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:3.0:1788574564.983147:0:19576:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7a788df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0ef7cddc-b831-4237-948c-b4fc5b50b382+8:2355:x1875455727788032:12345-192.168.201.57@tcp:2:lhsmtool_posix.0 Request processed in 252us (476us total) trans 12884901892 rc 0/0 00000100:00100000:3.0:1788574564.983152:0:19576:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 19 00000100:00100000:0.0:1788574564.987095:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:2.0:1788574564.987415:0:19575:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727788160 00000100:00100000:2.0:1788574564.987426:0:19575:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727788160 00000100:00100000:2.0:1788574564.987494:0:19575:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 20 00000100:00100000:2.0:1788574564.987514:0:19575:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a78e0e9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0ef7cddc-b831-4237-948c-b4fc5b50b382+8:2356:x1875455727788160:12345-192.168.201.57@tcp:1:lhsmtool_posix.0 00010000:00010000:2.0:1788574564.987750:0:19575:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000000673f7eb/0x10531a153b537699 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x42:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19575 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574564.987776:0:19575:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000007114780/0x10531a153b537692 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce3e74 expref: 8 pid: 20780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574564.987786:0:19575:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788574564.987791:0:19575:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x42:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788574564.987797:0:19575:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000673f7eb/0x10531a153b537699 lrc: 4/1,0 mode: --/PR res: [0x240000400:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 19575 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574564.987844:0:19575:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000007114780/0x10531a153b537692 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000020020 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce3e74 expref: 8 pid: 20780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574564.987863:0:19575:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000007114780/0x10531a153b537692 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400020020 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce3e74 expref: 8 pid: 20780 timeout: 791 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788574564.987882:0:19575:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a79b050700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:19575:1875455747700480:192.168.201.57@tcp:104: 00000100:00100000:2.0:1788574564.988006:0:19575:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a7a74facc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788574564.995327:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:2.0:1788574564.995687:0:19575:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a79b050700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:19575:1875455747700480:192.168.201.57@tcp:104: 00010000:00010000:2.0:1788574564.995716:0:19575:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000000673f7eb/0x10531a153b537699 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 19575 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788574564.995788:0:18873:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727788288 00000100:00100000:3.0:1788574564.995796:0:18873:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727788288 00010000:00010000:3.0:1788574564.995833:0:18873:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000007114780/0x10531a153b537692 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce3e74 expref: 9 pid: 20780 timeout: 791 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788574564.995873:0:18873:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 14 00000100:00100000:3.0:1788574564.995883:0:18873:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a78e0e9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0ef7cddc-b831-4237-948c-b4fc5b50b382+9:2355:x1875455727788288:12345-192.168.201.57@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788574564.995898:0:18873:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788574564.995919:0:18873:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000007114780/0x10531a153b537692 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x42:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce3e74 expref: 9 pid: 20780 timeout: 791 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574564.995932:0:18873:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000007114780/0x10531a153b537692 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x42:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400020020 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce3e74 expref: 9 pid: 20780 timeout: 791 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574564.995974:0:18873:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000007114780/0x10531a153b537692 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x42:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400020020 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce3e74 expref: 9 pid: 20780 timeout: 791 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574564.996012:0:18873:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x42:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788574564.996018:0:18873:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x42:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788574564.996024:0:18873:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000000673f7eb/0x10531a153b537699 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 19575 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574564.996752:0:18873:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000673f7eb/0x10531a153b537699 lrc: 4/1,0 mode: PR/PR res: [0x240000400:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 19575 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574564.996936:0:18873:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788574564.997023:0:18873:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a78e0e9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0ef7cddc-b831-4237-948c-b4fc5b50b382+8:2355:x1875455727788288:12345-192.168.201.57@tcp:103:ldlm_bl.0 Request processed in 1137us (1705us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574564.997044:0:18873:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 14 00010000:00010000:1.0:1788574564.999655:0:19575:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000000673f7eb/0x10531a153b537699 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 19575 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574564.999858:0:19575:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000673f7eb/0x10531a153b537699 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 19575 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574565.000127:0:19575:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000000673f7eb/0x10531a153b537699 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 19575 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574565.000139:0:19575:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000673f7eb/0x10531a153b537699 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 19575 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574565.000149:0:19575:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000673f7eb/0x10531a153b537699 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 19575 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574565.000158:0:19575:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a7a7ac9a00 already unused, calling callback (ffffffffc159f4f0) 00010000:00010000:2.0:1788574565.000163:0:19575:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000673f7eb/0x10531a153b537699 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 19575 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574565.000173:0:19575:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000673f7eb/0x10531a153b537699 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 19575 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574565.000199:0:19575:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000673f7eb/0x10531a153b537699 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 19575 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574565.000209:0:19575:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000673f7eb/0x10531a153b537699 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 19575 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788574565.001177:0:19575:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a78e0e9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0ef7cddc-b831-4237-948c-b4fc5b50b382+7:2356:x1875455727788160:12345-192.168.201.57@tcp:1:lhsmtool_posix.0 Request processed in 13663us (14091us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574565.001190:0:19575:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 20 00000100:00100000:0.0:1788574565.005698:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:2.0:1788574565.005987:0:20773:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727788544 00000100:00100000:2.0:1788574565.005998:0:20773:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727788544 00000100:00100000:2.0:1788574565.006070:0:20773:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 53 00000100:00100000:2.0:1788574565.006081:0:20773:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a78e0eb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0ef7cddc-b831-4237-948c-b4fc5b50b382+14:17425:x1875455727788544:12345-192.168.201.57@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1788574565.006185:0:20773:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7a7ac8000/0x10531a153b5376a0 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 20773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574565.006209:0:20773:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a7a7ac8000/0x10531a153b5376a0 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 20773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574565.006225:0:20773:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a7a7ac8000/0x10531a153b5376a0 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 20773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574565.008140:0:20773:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7a7ac8a00/0x10531a153b5376a7 lrc: 3/0,1 mode: --/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 20773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574565.008174:0:20773:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90a7a7ac9600/0x10531a153b53766f lrc: 2/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce3e5f expref: 15 pid: 20773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574565.008185:0:20773:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a7a7ac8a00/0x10531a153b5376a7 lrc: 4/0,1 mode: --/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 20773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574565.008243:0:20773:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90a7a7ac9600/0x10531a153b53766f lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce3e5f expref: 15 pid: 20773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574565.008285:0:20773:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7a7ac9600/0x10531a153b53766f lrc: 4/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce3e5f expref: 15 pid: 20773 timeout: 791 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788574565.008304:0:20773:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a79b050700 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:20773:1875455747700608:192.168.201.57@tcp:104: 00000100:00100000:2.0:1788574565.009046:0:20773:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a7a74facc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788574565.017165:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:2.0:1788574565.017446:0:20773:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a79b050700 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:20773:1875455747700608:192.168.201.57@tcp:104: 00010000:00010000:2.0:1788574565.017487:0:20773:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90a7a7ac8a00/0x10531a153b5376a7 lrc: 3/0,1 mode: --/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 20773 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788574565.018001:0:21020:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727788672 00000100:00100000:3.0:1788574565.018014:0:21020:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727788672 00010000:00010000:3.0:1788574565.018093:0:21020:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a7a7ac9600/0x10531a153b53766f lrc: 4/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce3e5f expref: 16 pid: 20773 timeout: 791 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788574565.018155:0:21020:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 15 00000100:00100000:3.0:1788574565.018169:0:21020:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a78e0e8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0ef7cddc-b831-4237-948c-b4fc5b50b382+16:2356:x1875455727788672:12345-192.168.201.57@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788574565.018192:0:21020:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788574565.018201:0:21020:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90a7a7ac9600/0x10531a153b53766f lrc: 4/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce3e5f expref: 16 pid: 20773 timeout: 791 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574565.018218:0:21020:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90a7a7ac9600/0x10531a153b53766f lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce3e5f expref: 16 pid: 20773 timeout: 791 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574565.018280:0:21020:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a7a7ac9600/0x10531a153b53766f lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce3e5f expref: 16 pid: 20773 timeout: 791 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574565.018307:0:21020:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff90a797af6b00) 00010000:00010000:3.0:1788574565.018313:0:21020:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff90a7a7ac8a00/0x10531a153b5376a7 lrc: 3/0,1 mode: --/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 20773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574565.018327:0:21020:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90a7a7ac8a00/0x10531a153b5376a7 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 20773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574565.018337:0:21020:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a7a7ac8a00/0x10531a153b5376a7 lrc: 4/0,1 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 20773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574565.018688:0:20773:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90a7a7ac8a00/0x10531a153b5376a7 lrc: 4/0,1 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 20773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574565.018697:0:20773:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a7a7ac8a00/0x10531a153b5376a7 lrc: 4/0,1 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 20773 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788574565.019025:0:20773:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901912 00000001:00080000:0.0:1788574565.019223:0:20773:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901913 00000001:00080000:0.0:1788574565.019273:0:20773:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901914 00000100:00100000:0.0:1788574565.019608:0:20773:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a78e0e9f80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:20773:1875455747700736:0@lo:1000:mdt00_003.0 00000100:00100000:0.0:1788574565.019751:0:20773:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788574565.019789:0:20773:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a7838cfcc0 going to sleep for 11 seconds 00000100:00100000:2.0:1788574565.019911:0:18891:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747700736 00000100:00100000:2.0:1788574565.019918:0:18891:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747700736 00000100:00100000:2.0:1788574565.019979:0:18891:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788574565.019989:0:18891:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7a7844a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:20773:x1875455747700736:12345-0@lo:1000:mdt00_003.0 00000100:00100000:2.0:1788574565.020083:0:18891:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7a7844a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:20773:x1875455747700736:12345-0@lo:1000:mdt00_003.0 Request processed in 96us (333us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574565.020090:0:18891:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:3.0:1788574565.020285:0:21020:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788574565.020397:0:21020:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a78e0e8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0ef7cddc-b831-4237-948c-b4fc5b50b382+18:2356:x1875455727788672:12345-192.168.201.57@tcp:103:ldlm_bl.0 Request processed in 2222us (3237us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574565.020407:0:21020:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 15 00000100:00080000:0.0:1788574565.020470:0:18882:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788574565.020514:0:20773:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a78e0e9f80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:20773:1875455747700736:0@lo:1000:mdt00_003.0 00000001:00080000:0.0:1788574565.021314:0:20773:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901915 00000100:00100000:0.0:1788574565.021448:0:20773:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a7a7846680 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:20773:1875455747700864:0@lo:1000:mdt00_003.0 00000100:00100000:0.0:1788574565.021498:0:20773:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788574565.022338:0:18891:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747700864 00000100:00100000:3.0:1788574565.022351:0:18891:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747700864 00000100:00100000:3.0:1788574565.022449:0:18891:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788574565.022462:0:18891:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a78e0e9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:20773:x1875455747700864:12345-0@lo:1000:mdt00_003.0 00000100:00100000:0.0:1788574565.023117:0:20773:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a7838cf540 going to sleep for 11 seconds 00000100:00100000:2.0:1788574565.028692:0:18891:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a78e0e9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:20773:x1875455747700864:12345-0@lo:1000:mdt00_003.0 Request processed in 6222us (7183us total) trans 12884901893 rc 0/0 00000100:00100000:2.0:1788574565.028708:0:18891:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788574565.028896:0:20773:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a7a7846680 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:20773:1875455747700864:0@lo:1000:mdt00_003.0 00010000:00010000:1.0:1788574565.028945:0:20773:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7a7ac8a00/0x10531a153b5376a7 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 20773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574565.028970:0:20773:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a7a7ac8a00/0x10531a153b5376a7 lrc: 2/0,0 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 20773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574565.028998:0:20773:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a7a7ac8a00/0x10531a153b5376a7 lrc: 3/0,0 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 20773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574565.029003:0:20773:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a7a7ac8a00 already unused, calling callback (ffffffffc1fe34f0) 00010000:00010000:1.0:1788574565.029009:0:20773:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a7a7ac8a00/0x10531a153b5376a7 lrc: 3/0,0 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 20773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574565.029017:0:20773:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a7a7ac8a00/0x10531a153b5376a7 lrc: 4/0,0 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 20773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574565.029047:0:20773:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff90a797af6b00) 00010000:00010000:1.0:1788574565.029051:0:20773:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788574565.029056:0:20773:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a7a7ac8a00/0x10531a153b5376a7 lrc: 2/0,0 mode: --/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 20773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574565.029064:0:20773:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a7a7ac8a00/0x10531a153b5376a7 lrc: 0/0,0 mode: --/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 20773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574565.029109:0:20773:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90a68116b200/0x10531a153b5375ff lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 18886 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574565.029116:0:20773:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a68116b200/0x10531a153b5375ff lrc: 2/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 18886 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574565.029121:0:20773:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a68116b200/0x10531a153b5375ff lrc: 3/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 18886 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574565.029125:0:20773:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a68116b200 already unused, calling callback (ffffffffc1fe34f0) 00010000:00010000:1.0:1788574565.029128:0:20773:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a68116b200/0x10531a153b5375ff lrc: 3/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 18886 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574565.029143:0:20773:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a68116b200/0x10531a153b5375ff lrc: 4/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 18886 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574565.029152:0:20773:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff90a7829d0300) 00010000:00010000:1.0:1788574565.029155:0:20773:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788574565.029162:0:20773:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff90a68116be00/0x10531a153b537606 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce3e43 expref: 18 pid: 18888 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574565.029175:0:20773:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90a68116be00/0x10531a153b537606 lrc: 2/0,0 mode: CR/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce3e43 expref: 18 pid: 18888 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574565.029185:0:20773:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a68116be00/0x10531a153b537606 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce3e43 expref: 18 pid: 18888 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574565.029232:0:20773:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff90a68116be00/0x10531a153b537606 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.57@tcp remote: 0x1d2563b34cce3e43 expref: 18 pid: 18888 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788574565.029248:0:20773:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a7a788c700 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:20773:1875455747700992:192.168.201.57@tcp:105: 00000100:00100000:1.0:1788574565.029357:0:20773:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a7a0953780 going to sleep for 11 seconds 00000100:00100000:0.0:1788574565.044294:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:2.0:1788574565.046036:0:18890:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727788800 00000100:00100000:2.0:1788574565.046056:0:18890:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727788800 00000100:00100000:2.0:1788574565.046140:0:18890:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 10 00000100:00100000:2.0:1788574565.046152:0:18890:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7a02fe450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0ef7cddc-b831-4237-948c-b4fc5b50b382+19:17424:x1875455727788800:12345-192.168.201.57@tcp:49:dd.0 00000100:00100000:2.0:1788574565.046716:0:18890:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7a02fe450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0ef7cddc-b831-4237-948c-b4fc5b50b382+19:17424:x1875455727788800:12345-192.168.201.57@tcp:49:dd.0 Request processed in 217us (2089us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574565.046745:0:18890:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 10 00000100:00100000:1.0:1788574565.052166:0:20773:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a7a788c700 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:20773:1875455747700992:192.168.201.57@tcp:105: 00010000:00010000:1.0:1788574565.052216:0:20773:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a68116b200/0x10531a153b5375ff lrc: 2/0,0 mode: --/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 18886 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574565.052232:0:20773:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a68116b200/0x10531a153b5375ff lrc: 0/0,0 mode: --/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 18886 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574565.060820:0:20773:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7a7ac9a00/0x10531a153b5376ae lrc: 3/0,1 mode: --/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 20773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574565.060853:0:20773:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a7a7ac9a00/0x10531a153b5376ae lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 20773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574565.060873:0:20773:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a7a7ac9a00/0x10531a153b5376ae lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 20773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574565.060890:0:20773:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7a7ac9a00/0x10531a153b5376ae lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 20773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574565.060898:0:20773:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a7a7ac9a00/0x10531a153b5376ae lrc: 2/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 20773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574565.060906:0:20773:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a7a7ac9a00/0x10531a153b5376ae lrc: 3/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 20773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574565.060912:0:20773:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a7a7ac9a00 already unused, calling callback (ffffffffc1fe34f0) 00010000:00010000:2.0:1788574565.060916:0:20773:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a7a7ac9a00/0x10531a153b5376ae lrc: 3/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 20773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574565.060925:0:20773:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a7a7ac9a00/0x10531a153b5376ae lrc: 4/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 20773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574565.060939:0:20773:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff90a7829d0300) 00010000:00010000:2.0:1788574565.060942:0:20773:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788574565.061485:0:20773:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a7a7ac9a00/0x10531a153b5376ae lrc: 2/0,0 mode: --/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 20773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574565.061497:0:20773:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a7a7ac9a00/0x10531a153b5376ae lrc: 0/0,0 mode: --/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 20773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574565.061648:0:20773:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7a7ac8000/0x10531a153b5376a0 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 20773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574565.061654:0:20773:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a7a7ac8000/0x10531a153b5376a0 lrc: 2/0,0 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 20773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574565.061660:0:20773:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a7a7ac8000/0x10531a153b5376a0 lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 20773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574565.061665:0:20773:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a7a7ac8000 already unused, calling callback (ffffffffc1fe34f0) 00010000:00010000:2.0:1788574565.061669:0:20773:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a7a7ac8000/0x10531a153b5376a0 lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 20773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574565.061676:0:20773:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a7a7ac8000/0x10531a153b5376a0 lrc: 4/0,0 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 20773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574565.061687:0:20773:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff90a7829d0300) 00010000:00010000:2.0:1788574565.061690:0:20773:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1788574565.061694:0:20773:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a7a7ac8000/0x10531a153b5376a0 lrc: 2/0,0 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 20773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574565.061700:0:20773:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a7a7ac8000/0x10531a153b5376a0 lrc: 0/0,0 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 20773 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788574565.062839:0:18921:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:1.0:1788574565.062861:0:18921:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x14:0x0] at index 3 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788574565.062895:0:18921:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x14:0x0] index 2 count 2 00000040:00080000:1.0:1788574565.062902:0:18921:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 4 count 2 00000100:00100000:2.0:1788574565.064010:0:20773:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a78e0eb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0ef7cddc-b831-4237-948c-b4fc5b50b382+18:17425:x1875455727788544:12345-192.168.201.57@tcp:57:lhsmtool_posix.0 Request processed in 57916us (58313us total) trans 12884901916 rc 0/0 00000100:00100000:2.0:1788574565.064027:0:20773:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 53 00000020:00080000:2.0:1788574565.064045:0:20773:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000100:00100000:0.0:1788574565.088305:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:3.0:1788574565.097923:0:18889:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727789056 00000100:00100000:3.0:1788574565.097952:0:18889:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727789056 00000100:00100000:3.0:1788574565.098203:0:18889:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 11 00000100:00100000:3.0:1788574565.098218:0:18889:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7a72baa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0ef7cddc-b831-4237-948c-b4fc5b50b382+18:17425:x1875455727789056:12345-192.168.201.57@tcp:35:lhsmtool_posix.0 00000004:00080000:3.0:1788574565.102329:0:18889:0:(mdd_object.c:4014:mdd_close()) Object [0x2000013a1:0x3:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:2.0:1788574565.105206:0:18889:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901917 00010000:00010000:2.0:1788574565.105312:0:18889:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7a7ac8000/0x10531a153b5376b5 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 18889 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574565.105343:0:18889:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a7a7ac8000/0x10531a153b5376b5 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 18889 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574565.105358:0:18889:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a7a7ac8000/0x10531a153b5376b5 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 18889 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574565.105397:0:18889:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7a7ac8000/0x10531a153b5376b5 lrc: 4/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 18889 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574565.105405:0:18889:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90a7a7ac8000/0x10531a153b5376b5 lrc: 4/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 18889 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574565.105412:0:18889:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a7a7ac8000/0x10531a153b5376b5 lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 18889 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574565.105438:0:18889:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788574565.105620:0:18874:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788574565.105636:0:18874:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a7a7ac8000/0x10531a153b5376b5 lrc: 2/0,0 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 18889 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574565.105643:0:18874:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a7a7ac8000 already unused, calling callback (ffffffffc159f4f0) 00010000:00010000:3.0:1788574565.105648:0:18874:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a7a7ac8000/0x10531a153b5376b5 lrc: 2/0,0 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 18889 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574565.105657:0:18874:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a7a7ac8000/0x10531a153b5376b5 lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 18889 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574565.105672:0:18874:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff90a797af6b00) 00010000:00010000:3.0:1788574565.105676:0:18874:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1788574565.105682:0:18874:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a7a7ac8000/0x10531a153b5376b5 lrc: 1/0,0 mode: --/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 18889 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574565.105688:0:18874:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a7a7ac8000/0x10531a153b5376b5 lrc: 0/0,0 mode: --/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 18889 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574565.105703:0:18874:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788574565.105705:0:18874:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788574565.105707:0:18874:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788574565.106745:0:18889:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7a72baa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0ef7cddc-b831-4237-948c-b4fc5b50b382+20:17425:x1875455727789056:12345-192.168.201.57@tcp:35:lhsmtool_posix.0 Request processed in 8517us (18437us total) trans 12884901918 rc 0/0 00000100:00100000:2.0:1788574565.106758:0:18889:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 11 00000020:00080000:2.0:1788574565.106767:0:18889:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1788574565.116825:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:0.0:1788574565.117268:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:0.0:1788574565.117316:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:3.0:1788574565.117562:0:19584:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727789184 00000100:00100000:3.0:1788574565.117574:0:19584:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727789184 00000100:00100000:3.0:1788574565.117626:0:19584:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727789440 00000100:00100000:3.0:1788574565.117630:0:19584:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727789440 00000100:00100000:3.0:1788574565.117644:0:19584:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727789312 00000100:00100000:3.0:1788574565.117646:0:19584:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727789312 00000100:00100000:3.0:1788574565.117664:0:19584:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 0 00000100:00100000:3.0:1788574565.117674:0:19584:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7bfb0f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0ef7cddc-b831-4237-948c-b4fc5b50b382+9:2356:x1875455727789184:12345-192.168.201.57@tcp:4:dd.0 00002000:00010000:3.0:1788574565.117728:0:19584:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x42:0x0] initial LVB size: 0, mtime: 0x6a9b7b64, atime: 0x6a9b7b63, ctime: 0x6a9b7b64, blocks: 0x1 00010000:00010000:3.0:1788574565.117737:0:19584:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000db62b7b9/0x10531a153b5376bc lrc: 3/0,1 mode: --/PW res: [0x240000400:0x42:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574565.117762:0:19584:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x42:0x0].0x0 since=691s v=(0 0) 00010000:00010000:3.0:1788574565.117766:0:19584:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788574565.117773:0:19584:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000db62b7b9/0x10531a153b5376bc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x42:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 19584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574565.117789:0:19584:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000db62b7b9/0x10531a153b5376bc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x42:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 19584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788574565.244286:0:6739:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 12884901890 is committed 00000001:00080000:0.0:1788574565.244314:0:6739:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 12884901891 is committed 00000001:00080000:0.0:1788574565.244321:0:6739:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 12884901894 is committed 00000001:00080000:0.0:1788574565.244331:0:6739:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 12884901893 is committed 00002000:00010000:3.0:1788574565.244428:0:19584:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x42:0x0] updating lvb size from disk: 0 -> 1048576 00002000:00010000:3.0:1788574565.244432:0:19584:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x42:0x0] updating lvb mtime from disk: 1788574564 -> 1788574565 00002000:00010000:3.0:1788574565.244435:0:19584:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x42:0x0] updating lvb blocks from disk: 1 -> 2051 00010000:00010000:3.0:1788574565.244454:0:19584:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000db62b7b9/0x10531a153b5376bc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x42:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 19584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574565.244469:0:19584:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000db62b7b9/0x10531a153b5376bc lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x42:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 19584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574565.244479:0:19584:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000db62b7b9/0x10531a153b5376bc lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x42:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 19584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574565.244487:0:19584:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a6824f9600 already unused, calling callback (ffffffffc159f4f0) 00010000:00010000:3.0:1788574565.244493:0:19584:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000db62b7b9/0x10531a153b5376bc lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x42:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 19584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574565.244513:0:19584:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000db62b7b9/0x10531a153b5376bc lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x42:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 19584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574565.244558:0:19584:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000db62b7b9/0x10531a153b5376bc lrc: 2/0,0 mode: --/PW res: [0x240000400:0x42:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 19584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574565.244567:0:19584:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000db62b7b9/0x10531a153b5376bc lrc: 0/0,0 mode: --/PW res: [0x240000400:0x42:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 19584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788574565.244678:0:19584:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7bfb0f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0ef7cddc-b831-4237-948c-b4fc5b50b382+7:2356:x1875455727789184:12345-192.168.201.57@tcp:4:dd.0 Request processed in 126998us (127855us total) trans 12884901894 rc 0/0 00000100:00100000:3.0:1788574565.244689:0:19584:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 0 00000100:00100000:3.0:1788574565.244724:0:19584:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 1 00000100:00100000:3.0:1788574565.244736:0:19584:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7bfb0c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0ef7cddc-b831-4237-948c-b4fc5b50b382+6:2356:x1875455727789440:12345-192.168.201.57@tcp:4:dd.0 00002000:00010000:3.0:1788574565.244774:0:19584:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x42:0x0] initial LVB size: 1048576, mtime: 0x6a9b7b65, atime: 0x6a9b7b63, ctime: 0x0, blocks: 0x803 00010000:00010000:3.0:1788574565.244780:0:19584:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006e81cbbd/0x10531a153b5376c3 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x42:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574565.244791:0:19584:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x42:0x0].0x0 since=691s v=(0 0) 00010000:00010000:3.0:1788574565.244796:0:19584:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788574565.244802:0:19584:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006e81cbbd/0x10531a153b5376c3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x42:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 19584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574565.244815:0:19584:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006e81cbbd/0x10531a153b5376c3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x42:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 19584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574565.249663:0:18875:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1788574565.345234:0:6739:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 12884901895 is committed 00002000:00010000:0.0:1788574565.345496:0:19584:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x42:0x0] updating lvb size from disk: 1048576 -> 3145728 00002000:00010000:0.0:1788574565.345513:0:19584:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x42:0x0] updating lvb blocks from disk: 2051 -> 4103 00010000:00010000:0.0:1788574565.345529:0:19584:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006e81cbbd/0x10531a153b5376c3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x42:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 19584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574565.345564:0:19584:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006e81cbbd/0x10531a153b5376c3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x42:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 19584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574565.345573:0:19584:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006e81cbbd/0x10531a153b5376c3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x42:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 19584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574565.345581:0:19584:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a6824f8e00 already unused, calling callback (ffffffffc159f4f0) 00010000:00010000:0.0:1788574565.345586:0:19584:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006e81cbbd/0x10531a153b5376c3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x42:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 19584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574565.345596:0:19584:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006e81cbbd/0x10531a153b5376c3 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x42:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 19584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574565.345620:0:19584:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006e81cbbd/0x10531a153b5376c3 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x42:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 19584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574565.345629:0:19584:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006e81cbbd/0x10531a153b5376c3 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x42:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 19584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788574565.345767:0:19584:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7bfb0c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0ef7cddc-b831-4237-948c-b4fc5b50b382+6:2356:x1875455727789440:12345-192.168.201.57@tcp:4:dd.0 Request processed in 101027us (228492us total) trans 12884901895 rc 0/0 00000100:00100000:0.0:1788574565.345799:0:19584:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 1 00000100:00100000:0.0:1788574565.345840:0:19584:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 2 00000100:00100000:0.0:1788574565.345855:0:19584:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7bfb0c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0ef7cddc-b831-4237-948c-b4fc5b50b382+5:2356:x1875455727789312:12345-192.168.201.57@tcp:4:dd.0 00002000:00010000:0.0:1788574565.345900:0:19584:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x42:0x0] initial LVB size: 3145728, mtime: 0x6a9b7b65, atime: 0x6a9b7b63, ctime: 0x0, blocks: 0x1007 00010000:00010000:0.0:1788574565.345915:0:19584:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cd412172/0x10531a153b5376ca lrc: 3/0,1 mode: --/PW res: [0x240000400:0x42:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574565.345926:0:19584:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x42:0x0].0x0 since=691s v=(0 0) 00010000:00010000:0.0:1788574565.345931:0:19584:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788574565.345938:0:19584:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cd412172/0x10531a153b5376ca lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x42:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 19584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574565.345950:0:19584:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000cd412172/0x10531a153b5376ca lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x42:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 19584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788574565.355283:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:0.0:1788574565.355473:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:1.0:1788574565.355605:0:19583:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 3 min 3 max 116 00000100:00100000:1.0:1788574565.355618:0:19583:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_003' 00000100:00100000:1.0:1788574565.355759:0:19583:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727789568 00000100:00100000:1.0:1788574565.355773:0:19583:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727789568 00000100:00100000:1.0:1788574565.355839:0:19583:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 3 min 3 max 116 00000100:00100000:1.0:1788574565.355845:0:19583:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727789824 00000100:00100000:1.0:1788574565.355848:0:19583:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727789824 00000100:00100000:1.0:1788574565.356277:0:21038:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 3 00000100:00100000:1.0:1788574565.356288:0:21038:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7bfb0f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:0ef7cddc-b831-4237-948c-b4fc5b50b382+8:2355:x1875455727789568:12345-192.168.201.57@tcp:4:dd.0 00010000:00010000:1.0:1788574565.356335:0:21038:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001cf035e6/0x10531a153b5376d1 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x42:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 21038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574565.356361:0:21038:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788574565.356408:0:21038:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788574565.356416:0:21038:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001cf035e6/0x10531a153b5376d1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x42:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574565.356433:0:21038:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001cf035e6/0x10531a153b5376d1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x42:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 21038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788574565.371812:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:0.0:1788574565.371865:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:0.0:1788574565.371915:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:1.0:1788574565.372007:0:19583:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 4 min 3 max 116 00000100:00100000:1.0:1788574565.372019:0:19583:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_004' 00000100:00100000:3.0:1788574565.373467:0:19581:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 4 min 3 max 116 00000100:00100000:3.0:1788574565.373510:0:19581:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727789952 00000100:00100000:3.0:1788574565.373523:0:19581:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727789952 00000100:00100000:3.0:1788574565.373584:0:19581:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 4 min 3 max 116 00000100:00100000:3.0:1788574565.373589:0:19581:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727790080 00000100:00100000:3.0:1788574565.373593:0:19581:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727790080 00000100:00100000:3.0:1788574565.373610:0:19581:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 4 min 3 max 116 00000100:00100000:3.0:1788574565.373615:0:19581:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727789696 00000100:00100000:3.0:1788574565.373617:0:19581:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727789696 00000100:00100000:3.0:1788574565.377622:0:21039:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 4 00000100:00100000:3.0:1788574565.377651:0:21039:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7bfb0d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0ef7cddc-b831-4237-948c-b4fc5b50b382+12:2354:x1875455727789824:12345-192.168.201.57@tcp:4:dd.0 00010000:00010000:3.0:1788574565.377719:0:21039:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000db62b7b9/0x10531a153b5376d8 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x42:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 21039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574565.377744:0:21039:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788574565.377750:0:21039:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788574565.377763:0:21039:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000db62b7b9/0x10531a153b5376d8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x42:0x0].0x0 rrc: 4 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574565.377785:0:21039:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000db62b7b9/0x10531a153b5376d8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x42:0x0].0x0 rrc: 4 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 21039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788574565.540151:0:6739:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 12884901896 is committed 00002000:00010000:2.0:1788574565.543112:0:19584:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x42:0x0] updating lvb size from disk: 3145728 -> 6291456 00002000:00010000:2.0:1788574565.543126:0:19584:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x42:0x0] updating lvb blocks from disk: 4103 -> 10247 00010000:00010000:2.0:1788574565.543147:0:19584:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cd412172/0x10531a153b5376ca lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x42:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 19584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574565.543163:0:19584:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000cd412172/0x10531a153b5376ca lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x42:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 19584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574565.543173:0:19584:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000cd412172/0x10531a153b5376ca lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x42:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 19584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574565.543194:0:19584:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a68116b200 already unused, calling callback (ffffffffc159f4f0) 00010000:00010000:2.0:1788574565.543200:0:19584:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000cd412172/0x10531a153b5376ca lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x42:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 19584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574565.543210:0:19584:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000cd412172/0x10531a153b5376ca lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x42:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 19584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574565.543236:0:19584:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000cd412172/0x10531a153b5376ca lrc: 2/0,0 mode: --/PW res: [0x240000400:0x42:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 19584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574565.543246:0:19584:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000cd412172/0x10531a153b5376ca lrc: 0/0,0 mode: --/PW res: [0x240000400:0x42:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 19584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788574565.543428:0:19584:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7bfb0c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0ef7cddc-b831-4237-948c-b4fc5b50b382+16:2356:x1875455727789312:12345-192.168.201.57@tcp:4:dd.0 Request processed in 197574us (426106us total) trans 12884901896 rc 0/0 00000100:00100000:2.0:1788574565.543444:0:19584:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 2 00000100:00100000:2.0:1788574565.543502:0:19584:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 5 00000100:00100000:2.0:1788574565.543518:0:19584:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7bfb0ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0ef7cddc-b831-4237-948c-b4fc5b50b382+15:2353:x1875455727789952:12345-192.168.201.57@tcp:4:dd.0 00010000:00010000:2.0:1788574565.543561:0:19584:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006af1163b/0x10531a153b5376df lrc: 3/0,1 mode: --/PW res: [0x240000400:0x42:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574565.543577:0:19584:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788574565.543582:0:19584:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788574565.543590:0:19584:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006af1163b/0x10531a153b5376df lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x42:0x0].0x0 rrc: 4 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 19584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574565.543619:0:19584:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006af1163b/0x10531a153b5376df lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x42:0x0].0x0 rrc: 4 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 19584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788574565.616247:0:21039:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x42:0x0] updating lvb size from disk: 6291456 -> 7340032 00010000:00010000:2.0:1788574565.616275:0:21039:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000db62b7b9/0x10531a153b5376d8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x42:0x0].0x0 rrc: 4 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574565.616290:0:21039:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000db62b7b9/0x10531a153b5376d8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x42:0x0].0x0 rrc: 4 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 21039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574565.616299:0:21039:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000db62b7b9/0x10531a153b5376d8 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x42:0x0].0x0 rrc: 4 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574565.616308:0:21039:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a6824f9600 already unused, calling callback (ffffffffc159f4f0) 00010000:00010000:2.0:1788574565.616314:0:21039:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000db62b7b9/0x10531a153b5376d8 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x42:0x0].0x0 rrc: 4 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574565.616324:0:21039:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000db62b7b9/0x10531a153b5376d8 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x42:0x0].0x0 rrc: 4 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 21039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574565.616346:0:21039:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000db62b7b9/0x10531a153b5376d8 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x42:0x0].0x0 rrc: 4 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574565.616355:0:21039:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000db62b7b9/0x10531a153b5376d8 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x42:0x0].0x0 rrc: 4 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788574565.616646:0:21039:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7bfb0d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0ef7cddc-b831-4237-948c-b4fc5b50b382+17:2354:x1875455727789824:12345-192.168.201.57@tcp:4:dd.0 Request processed in 238999us (261164us total) trans 12884901898 rc 0/0 00000100:00100000:2.0:1788574565.616660:0:21039:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 4 00000100:00100000:2.0:1788574565.616710:0:21039:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 6 00000100:00100000:2.0:1788574565.616724:0:21039:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7bfb0c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0ef7cddc-b831-4237-948c-b4fc5b50b382+16:2353:x1875455727790080:12345-192.168.201.57@tcp:4:dd.0 00010000:00010000:2.0:1788574565.616767:0:21039:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006343a5d0/0x10531a153b5376e6 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x42:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 21039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574565.616782:0:21039:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788574565.616787:0:21039:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788574565.616794:0:21039:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006343a5d0/0x10531a153b5376e6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x42:0x0].0x0 rrc: 4 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574565.616809:0:21039:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006343a5d0/0x10531a153b5376e6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x42:0x0].0x0 rrc: 4 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 21039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788574565.617998:0:6739:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 12884901897 is committed 00000001:00080000:0.0:1788574565.618034:0:6739:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 12884901898 is committed 00010000:00010000:1.0:1788574565.620154:0:21038:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001cf035e6/0x10531a153b5376d1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x42:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574565.620172:0:21038:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001cf035e6/0x10531a153b5376d1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x42:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 21038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574565.620197:0:21038:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001cf035e6/0x10531a153b5376d1 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x42:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574565.620205:0:21038:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a78165aa00 already unused, calling callback (ffffffffc159f4f0) 00010000:00010000:1.0:1788574565.620210:0:21038:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001cf035e6/0x10531a153b5376d1 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x42:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574565.620219:0:21038:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001cf035e6/0x10531a153b5376d1 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x42:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 21038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574565.620239:0:21038:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001cf035e6/0x10531a153b5376d1 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x42:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574565.620247:0:21038:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001cf035e6/0x10531a153b5376d1 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x42:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788574565.620329:0:21038:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7bfb0f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:0ef7cddc-b831-4237-948c-b4fc5b50b382+12:2355:x1875455727789568:12345-192.168.201.57@tcp:4:dd.0 Request processed in 264038us (265056us total) trans 12884901897 rc 0/0 00000100:00100000:1.0:1788574565.620339:0:21038:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 3 00000100:00100000:1.0:1788574565.620464:0:21038:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 7 00000100:00100000:1.0:1788574565.620476:0:21038:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7bfb0fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:0ef7cddc-b831-4237-948c-b4fc5b50b382+11:2355:x1875455727789696:12345-192.168.201.57@tcp:4:dd.0 00010000:00010000:1.0:1788574565.620517:0:21038:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ece4f6e4/0x10531a153b5376ed lrc: 3/0,1 mode: --/PW res: [0x240000400:0x42:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 21038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574565.620529:0:21038:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788574565.620539:0:21038:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788574565.620545:0:21038:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ece4f6e4/0x10531a153b5376ed lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x42:0x0].0x0 rrc: 4 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574565.620557:0:21038:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ece4f6e4/0x10531a153b5376ed lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x42:0x0].0x0 rrc: 4 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 21038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788574565.688647:0:6739:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 12884901899 is committed 00002000:00010000:3.0:1788574565.689549:0:19584:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x42:0x0] updating lvb size from disk: 7340032 -> 7654321 00002000:00010000:3.0:1788574565.689560:0:19584:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x42:0x0] updating lvb blocks from disk: 10247 -> 12295 00010000:00010000:3.0:1788574565.689578:0:19584:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006af1163b/0x10531a153b5376df lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x42:0x0].0x0 rrc: 4 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 19584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574565.689592:0:19584:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006af1163b/0x10531a153b5376df lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x42:0x0].0x0 rrc: 4 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 19584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574565.689619:0:19584:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006af1163b/0x10531a153b5376df lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x42:0x0].0x0 rrc: 4 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 19584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574565.689628:0:19584:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a7a7ac8000 already unused, calling callback (ffffffffc159f4f0) 00010000:00010000:3.0:1788574565.689633:0:19584:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006af1163b/0x10531a153b5376df lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x42:0x0].0x0 rrc: 4 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 19584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574565.689643:0:19584:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006af1163b/0x10531a153b5376df lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x42:0x0].0x0 rrc: 4 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 19584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574565.689664:0:19584:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006af1163b/0x10531a153b5376df lrc: 2/0,0 mode: --/PW res: [0x240000400:0x42:0x0].0x0 rrc: 4 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 19584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574565.689673:0:19584:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006af1163b/0x10531a153b5376df lrc: 0/0,0 mode: --/PW res: [0x240000400:0x42:0x0].0x0 rrc: 4 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 19584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788574565.689787:0:19584:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7bfb0ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0ef7cddc-b831-4237-948c-b4fc5b50b382+13:2353:x1875455727789952:12345-192.168.201.57@tcp:4:dd.0 Request processed in 146270us (317987us total) trans 12884901899 rc 0/0 00000100:00100000:3.0:1788574565.689796:0:19584:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 5 00000001:00080000:0.0:1788574565.760173:0:6739:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 12884901901 is committed 00002000:00010000:2.0:1788574565.760759:0:21039:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x42:0x0] updating lvb blocks from disk: 12295 -> 16391 00010000:00010000:2.0:1788574565.760777:0:21039:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006343a5d0/0x10531a153b5376e6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x42:0x0].0x0 rrc: 3 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574565.760792:0:21039:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006343a5d0/0x10531a153b5376e6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x42:0x0].0x0 rrc: 3 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 21039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574565.760802:0:21039:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006343a5d0/0x10531a153b5376e6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x42:0x0].0x0 rrc: 3 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574565.760823:0:21039:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a7a7ac8a00 already unused, calling callback (ffffffffc159f4f0) 00010000:00010000:2.0:1788574565.760829:0:21039:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006343a5d0/0x10531a153b5376e6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x42:0x0].0x0 rrc: 3 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574565.760840:0:21039:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006343a5d0/0x10531a153b5376e6 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x42:0x0].0x0 rrc: 3 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 21039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574565.760865:0:21039:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006343a5d0/0x10531a153b5376e6 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x42:0x0].0x0 rrc: 3 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574565.760875:0:21039:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006343a5d0/0x10531a153b5376e6 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x42:0x0].0x0 rrc: 3 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788574565.760998:0:21039:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7bfb0c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0ef7cddc-b831-4237-948c-b4fc5b50b382+7:2353:x1875455727790080:12345-192.168.201.57@tcp:4:dd.0 Request processed in 144273us (389125us total) trans 12884901900 rc 0/0 00000100:00100000:2.0:1788574565.761011:0:21039:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 6 00010000:00010000:1.0:1788574565.761908:0:21038:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ece4f6e4/0x10531a153b5376ed lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x42:0x0].0x0 rrc: 2 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574565.761929:0:21038:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ece4f6e4/0x10531a153b5376ed lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x42:0x0].0x0 rrc: 2 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 21038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574565.761939:0:21038:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ece4f6e4/0x10531a153b5376ed lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x42:0x0].0x0 rrc: 2 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574565.761946:0:21038:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a78165b400 already unused, calling callback (ffffffffc159f4f0) 00010000:00010000:1.0:1788574565.761951:0:21038:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ece4f6e4/0x10531a153b5376ed lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x42:0x0].0x0 rrc: 2 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574565.761961:0:21038:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ece4f6e4/0x10531a153b5376ed lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x42:0x0].0x0 rrc: 2 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 21038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574565.761980:0:21038:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ece4f6e4/0x10531a153b5376ed lrc: 2/0,0 mode: --/PW res: [0x240000400:0x42:0x0].0x0 rrc: 2 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574565.761988:0:21038:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ece4f6e4/0x10531a153b5376ed lrc: 0/0,0 mode: --/PW res: [0x240000400:0x42:0x0].0x0 rrc: 2 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788574565.762106:0:21038:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7bfb0fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:0ef7cddc-b831-4237-948c-b4fc5b50b382+5:2355:x1875455727789696:12345-192.168.201.57@tcp:4:dd.0 Request processed in 141631us (390187us total) trans 12884901901 rc 0/0 00000100:00100000:1.0:1788574565.762116:0:21038:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 7 00010000:00010000:1.0:1788574566.272690:0:20565:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788574567.296653:0:18874:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788574567.729514:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:3.0:1788574567.729558:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:3.0:1788574567.729592:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:3.0:1788574567.729621:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:3.0:1788574567.729658:0:19576:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727790464 00000100:00100000:3.0:1788574567.729686:0:19576:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727790464 00000100:00100000:3.0:1788574567.729760:0:19576:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727790976 00000100:00100000:3.0:1788574567.729764:0:19576:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727790976 00000100:00100000:3.0:1788574567.729791:0:19576:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 21 00000100:00100000:3.0:1788574567.729804:0:19576:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a792459180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0ef7cddc-b831-4237-948c-b4fc5b50b382+5:2353:x1875455727790464:12345-192.168.201.57@tcp:400:kworker.0 00000100:00100000:3.0:1788574567.729893:0:19576:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a792459180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0ef7cddc-b831-4237-948c-b4fc5b50b382+5:2353:x1875455727790464:12345-192.168.201.57@tcp:400:kworker.0 Request processed in 91us (333us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574567.729900:0:19576:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 21 00000100:00100000:3.0:1788574567.729922:0:19576:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 22 00000100:00100000:3.0:1788574567.729928:0:19576:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a79245b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a406b67b-30f6-4346-815d-0b22929077a2+5:2353:x1875455727790976:12345-192.168.201.57@tcp:400:kworker.0 00000100:00100000:3.0:1788574567.729954:0:19576:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a79245b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a406b67b-30f6-4346-815d-0b22929077a2+5:2353:x1875455727790976:12345-192.168.201.57@tcp:400:kworker.0 Request processed in 27us (333us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574567.729960:0:19576:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 22 00000100:00100000:3.0:1788574567.729978:0:18887:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727790720 00000100:00100000:3.0:1788574567.729982:0:18887:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727790720 00000100:00100000:3.0:1788574567.730026:0:18887:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 36 00000100:00100000:3.0:1788574567.730033:0:18887:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a79245a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a406b67b-30f6-4346-815d-0b22929077a2+6:2353:x1875455727790720:12345-192.168.201.57@tcp:400:kworker.0 00000100:00100000:3.0:1788574567.730069:0:18887:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a79245a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a406b67b-30f6-4346-815d-0b22929077a2+6:2353:x1875455727790720:12345-192.168.201.57@tcp:400:kworker.0 Request processed in 37us (477us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574567.730076:0:18887:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 36 00000100:00080000:3.0:1788574567.730097:0:18882:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788574567.730102:0:18882:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788574567.730104:0:18882:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788574567.730194:0:18881:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727790208 00000100:00100000:0.0:1788574567.730199:0:18881:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727790208 00000100:00100000:0.0:1788574567.730234:0:18881:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 125 00000100:00100000:0.0:1788574567.730241:0:18881:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a79e7e9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:757865b4-e3c9-47dd-8b09-5caeeb506113+13:2353:x1875455727790208:12345-192.168.201.57@tcp:400:kworker.0 00000100:00100000:0.0:1788574567.730266:0:18881:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a79e7e9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:757865b4-e3c9-47dd-8b09-5caeeb506113+13:2353:x1875455727790208:12345-192.168.201.57@tcp:400:kworker.0 Request processed in 26us (764us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574567.730272:0:18881:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 125 00000100:00100000:3.0:1788574567.731903:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:3.0:1788574567.731959:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:0.0:1788574567.732087:0:18886:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727790336 00000100:00100000:0.0:1788574567.732100:0:18886:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727790336 00000100:00100000:0.0:1788574567.732188:0:18886:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 37 00000100:00100000:0.0:1788574567.732203:0:18886:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a792458380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0ef7cddc-b831-4237-948c-b4fc5b50b382+20:2354:x1875455727790336:12345-192.168.201.57@tcp:400:kworker.0 00000100:00100000:0.0:1788574567.732293:0:18886:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a792458380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0ef7cddc-b831-4237-948c-b4fc5b50b382+20:2354:x1875455727790336:12345-192.168.201.57@tcp:400:kworker.0 Request processed in 93us (403us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574567.732299:0:18886:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 37 00000100:00080000:3.0:1788574567.733061:0:18882:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788574567.733177:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.57@tcp (source: 12345-192.168.201.57@tcp) 00000100:00100000:3.0:1788574567.733259:0:19577:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727790592 00000100:00100000:3.0:1788574567.733265:0:19577:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727790592 00000100:00100000:3.0:1788574567.733303:0:19577:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455727790848 00000100:00100000:3.0:1788574567.733306:0:19577:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455727790848 00000100:00100000:3.0:1788574567.733347:0:19577:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 23 00000100:00100000:3.0:1788574567.733355:0:19577:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a792458000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0ef7cddc-b831-4237-948c-b4fc5b50b382+5:2354:x1875455727790592:12345-192.168.201.57@tcp:400:kworker.0 00000100:00100000:3.0:1788574567.733427:0:19577:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a792458000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0ef7cddc-b831-4237-948c-b4fc5b50b382+5:2354:x1875455727790592:12345-192.168.201.57@tcp:400:kworker.0 Request processed in 72us (1467us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574567.733434:0:19577:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 23 00000100:00100000:3.0:1788574567.733449:0:19577:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.57@tcp, seq: 24 00000100:00100000:3.0:1788574567.733465:0:19577:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a784097850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a406b67b-30f6-4346-815d-0b22929077a2+5:2354:x1875455727790848:12345-192.168.201.57@tcp:400:kworker.0 00000100:00100000:3.0:1788574567.733495:0:19577:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a784097850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a406b67b-30f6-4346-815d-0b22929077a2+5:2354:x1875455727790848:12345-192.168.201.57@tcp:400:kworker.0 Request processed in 40us (321us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574567.733502:0:19577:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.57@tcp, seq: 24 00000100:00080000:3.0:1788574567.733656:0:18882:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788574567.733659:0:18882:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000001:02000400:2.0:1788574568.054358:0:21076:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: sanity-pcc test_1d: @@@@@@ FAIL: expected /mnt/pcc.d1d.sanity-pcc/d1d.sanity-pcc/13a3/0x2000013a1:0x2:0x0 size: 7654321 got: 0 00010000:00010000:3.0:1788574568.331763:0:18875:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788574568.577461:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a7a788c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:64047b6f-0fa6-4004-9f51-bd636ae04daf:3314:1875455747701120:0@lo:400:kworker.0 00000100:00100000:1.0:1788574568.577521:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a7a788ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1875455747701376:0@lo:400:kworker.0 00000100:00100000:1.0:1788574568.577835:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788574568.577915:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a7bfb0df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1875455747701888:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788574568.577944:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788574568.577965:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788574568.577982:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a7a788c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3312:1875455747701504:0@lo:400:kworker.0 00000100:00100000:1.0:1788574568.578010:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788574568.578181:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a7a788ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1875455747701248:0@lo:400:kworker.0 00000100:00100000:2.0:1788574568.578216:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788574568.578237:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a7a788e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3315:1875455747701760:0@lo:400:kworker.0 00000100:00100000:2.0:1788574568.578272:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788574568.578292:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788574568.578298:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a7a788f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3315:1875455747701632:0@lo:400:kworker.0 00000100:00100000:2.0:1788574568.578319:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788574568.578421:0:18887:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747701504 00000100:00100000:2.0:1788574568.578430:0:18887:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747701504 00000100:00100000:2.0:1788574568.578495:0:18887:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747701760 00000100:00100000:2.0:1788574568.578499:0:18887:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747701760 00000100:00100000:2.0:1788574568.578523:0:18887:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747701632 00000100:00100000:2.0:1788574568.578525:0:18887:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747701632 00000100:00100000:2.0:1788574568.578540:0:18887:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1788574568.578548:0:18887:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7a788d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1875455747701504:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788574568.578610:0:18887:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7a788d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1875455747701504:12345-0@lo:400:kworker.0 Request processed in 61us (598us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574568.578618:0:18887:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1788574568.578634:0:18887:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1788574568.578640:0:18887:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a79b050e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1875455747701760:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788574568.578665:0:18887:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a79b050e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1875455747701760:12345-0@lo:400:kworker.0 Request processed in 26us (392us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574568.578670:0:18887:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1788574568.578679:0:18887:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1788574568.578684:0:18887:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a79b050000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1875455747701632:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788574568.578706:0:18887:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a79b050000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1875455747701632:12345-0@lo:400:kworker.0 Request processed in 22us (387us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574568.578712:0:18887:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1788574568.578748:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a7a788f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3315:1875455747701632:0@lo:400:kworker.0 00000100:00100000:2.0:1788574568.578759:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a7a788e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3315:1875455747701760:0@lo:400:kworker.0 00000100:00100000:2.0:1788574568.578791:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a7a788c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3312:1875455747701504:0@lo:400:kworker.0 00000100:00100000:2.0:1788574568.578829:0:20780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747701376 00000100:00100000:2.0:1788574568.578832:0:20780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747701376 00000100:00100000:2.0:1788574568.578872:0:20780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747701248 00000100:00100000:2.0:1788574568.578875:0:20780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747701248 00000100:00100000:2.0:1788574568.578894:0:20780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1788574568.578900:0:20780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7a788fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3312:x1875455747701376:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788574568.578935:0:20780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7a788fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3312:x1875455747701376:12345-0@lo:400:kworker.0 Request processed in 35us (1102us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574568.578940:0:20780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1788574568.578949:0:20780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1788574568.578954:0:20780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a79b050700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3315:x1875455747701248:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788574568.578980:0:20780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a79b050700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3315:x1875455747701248:12345-0@lo:400:kworker.0 Request processed in 26us (764us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574568.578986:0:20780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1788574568.579006:0:3315:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 12884901893 gen 2 00000004:00080000:2.0:1788574568.579011:0:3315:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff90a7926b1c00, transno 12884901891 00000004:00080000:2.0:1788574568.579021:0:3315:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 12884901893 committed transno 12884901893 00000100:00100000:2.0:1788574568.579039:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a7a788ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1875455747701248:0@lo:400:kworker.0 00000100:00100000:2.0:1788574568.579082:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a7a788ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1875455747701376:0@lo:400:kworker.0 00000100:00080000:2.0:1788574568.579104:0:18882:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788574568.579108:0:18882:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788574568.579111:0:18882:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788574568.579380:0:19579:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747701888 00000100:00100000:1.0:1788574568.579387:0:19579:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747701888 00000100:00100000:1.0:1788574568.579420:0:19579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1788574568.579427:0:19579:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7a788dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1875455747701888:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788574568.579469:0:19579:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3851419648 avail 3849322496 00000100:00100000:1.0:1788574568.579518:0:19579:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7a788dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1875455747701888:12345-0@lo:13:osp-pre-1-0.0 Request processed in 92us (1573us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574568.579524:0:19579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1788574568.584601:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a7bfb0df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1875455747701888:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788574568.590268:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788574568.590712:0:18879:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747701120 00000100:00100000:0.0:1788574568.590722:0:18879:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747701120 00000100:00100000:0.0:1788574568.590849:0:18879:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:0.0:1788574568.590860:0:18879:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a79e7e8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:64047b6f-0fa6-4004-9f51-bd636ae04daf+19:3314:x1875455747701120:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788574568.590947:0:18879:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a79e7e8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:64047b6f-0fa6-4004-9f51-bd636ae04daf+19:3314:x1875455747701120:12345-0@lo:400:kworker.0 Request processed in 88us (688us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574568.590955:0:18879:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00100000:3.0:1788574568.591049:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a7a788c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:64047b6f-0fa6-4004-9f51-bd636ae04daf:3314:1875455747701120:0@lo:400:kworker.0 00000100:00100000:0.0:1788574569.089015:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788574569.089046:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a7a788f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1875455747702016:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788574569.089133:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788574569.089308:0:19579:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455747702016 00000100:00100000:1.0:1788574569.089318:0:19579:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455747702016 00000100:00100000:1.0:1788574569.089406:0:19579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1788574569.089417:0:19579:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90a7bfb0f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1875455747702016:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788574569.089492:0:19579:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 3407872 granted 64684032 pending 0 free 3851419648 avail 3849322496 00000100:00100000:1.0:1788574569.089559:0:19579:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90a7bfb0f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1875455747702016:12345-0@lo:13:osp-pre-0-0.0 Request processed in 143us (424us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574569.089567:0:19579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1788574569.089668:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a7a788f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1875455747702016:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1788574569.344659:0:20565:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788574570.196989:0:18921:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:0.0:1788574570.197004:0:18921:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x14:0x0] at index 3 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788574570.197043:0:18921:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x14:0x0] index 2 count 2 00000040:00080000:0.0:1788574570.197052:0:18921:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 4 count 2 00000001:00080000:1.0:1788574570.239096:0:5879:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 12884901916 is committed 00000020:00080000:1.0:1788574570.239114:0:5879:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff90a7838cfcc0 refcount 2 committed 0 result 0 batchid 8589934628 00000020:00080000:1.0:1788574570.239120:0:5879:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff90a7853b8700 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff90a7838cf0c0 00000020:00080000:1.0:1788574570.239123:0:5879:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff90a7853b8900 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff90a7c1151800 00000001:00080000:1.0:1788574570.239157:0:5879:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 12884901918 is committed 00000020:00080000:1.0:1788574570.239171:0:18925:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 8589934628 committed batchid 4294967527 00000020:00080000:1.0:1788574570.239714:0:18925:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4294967527 Debug log: 10063 lines, 10063 kept, 0 dropped, 0 bad.